Sep 10 12:08:58.962889 ip-10-0-133-86 systemd[1]: Starting Kubernetes Kubelet... Sep 10 12:08:59.380668 ip-10-0-133-86 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:08:59.380668 ip-10-0-133-86 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 12:08:59.380668 ip-10-0-133-86 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:08:59.380668 ip-10-0-133-86 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 12:08:59.380668 ip-10-0-133-86 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:08:59.381298 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.380692 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 12:08:59.383916 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383900 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:08:59.383916 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383917 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383922 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383925 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383928 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383931 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383934 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383937 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383939 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383942 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383945 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383948 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383950 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383953 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383956 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383959 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383961 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383964 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383967 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383969 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383972 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:08:59.383983 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383974 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383977 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383979 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383982 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383984 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383987 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383990 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383993 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383996 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.383998 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384001 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384003 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384006 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384009 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384012 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384014 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384017 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384019 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384022 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:08:59.384485 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384024 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384026 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384029 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384031 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384034 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384036 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384039 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384042 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384046 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384050 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384053 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384063 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384067 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384070 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384073 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384076 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384080 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384083 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384085 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:08:59.385152 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384088 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384091 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384094 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384097 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384100 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384102 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384106 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384110 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384113 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384116 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384119 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384121 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384124 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384127 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384130 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384132 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384135 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384137 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384140 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384143 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:08:59.385850 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384145 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384148 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384150 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384153 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384155 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384158 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384160 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384163 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384166 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384169 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384172 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384174 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384177 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384179 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384181 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384184 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384186 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384189 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384191 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:08:59.386376 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.384194 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385502 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385520 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385531 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385537 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385542 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385547 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385551 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385555 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385560 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385564 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385568 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385572 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385576 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385581 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385590 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385596 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385620 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385625 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385630 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:08:59.386890 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385635 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385640 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385644 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385649 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385680 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385687 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385693 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385698 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385704 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385710 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385715 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385720 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385726 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385732 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385738 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385754 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385757 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385760 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385762 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385765 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:08:59.387424 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385768 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385771 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385773 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385776 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385779 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385784 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385787 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385946 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385958 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385962 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385965 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385969 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385972 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385975 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385978 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385981 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385985 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385987 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385990 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385993 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:08:59.388003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385995 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.385998 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386001 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386003 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386007 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386009 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386012 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386015 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386018 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386020 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386023 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386026 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386028 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386033 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386038 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386041 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386044 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386047 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386050 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:08:59.388530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386053 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386057 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386060 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386063 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386066 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386072 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386075 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386078 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386081 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386083 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386086 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386088 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386091 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386094 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386096 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386099 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386101 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386104 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386106 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386109 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:08:59.389037 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386111 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386497 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386502 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386504 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386507 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386510 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386512 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386515 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386517 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386520 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386522 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386525 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386536 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386540 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386543 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386546 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386549 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386552 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386555 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386557 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:08:59.389557 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386560 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386563 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386565 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386569 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386573 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386576 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386578 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386581 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386583 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386586 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386589 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386591 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386593 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386598 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386619 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386622 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386625 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386628 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386631 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:08:59.390081 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386633 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386636 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386638 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386641 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386643 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386646 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386649 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386652 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386655 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386658 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386660 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386663 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386666 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386668 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386671 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386675 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386678 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386681 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386684 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:08:59.390580 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386686 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386689 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386692 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386694 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386697 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386700 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386703 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386705 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386707 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386710 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386713 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386715 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386718 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386720 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386723 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386725 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386728 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386730 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386738 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386740 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:08:59.391067 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386743 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386746 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386748 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386751 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386753 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386756 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386759 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386761 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386764 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386766 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386769 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386771 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386774 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386777 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386779 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386782 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386784 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386787 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386790 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386792 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:08:59.391578 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386794 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.386797 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386873 2563 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386907 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386913 2563 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386918 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386922 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386925 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386929 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386933 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386937 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386940 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386944 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386947 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386950 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386952 2563 flags.go:64] FLAG: --cgroup-root="" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386955 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386958 2563 flags.go:64] FLAG: --client-ca-file="" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386964 2563 flags.go:64] FLAG: --cloud-provider="external" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386967 2563 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386970 2563 flags.go:64] FLAG: --cluster-domain="" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386973 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386976 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386979 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 12:08:59.392112 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386983 2563 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386986 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386989 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386992 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386995 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.386998 2563 flags.go:64] FLAG: --contention-profiling="false" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387001 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387004 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387007 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387009 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387016 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387019 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387021 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387024 2563 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387027 2563 flags.go:64] FLAG: --enable-server="true" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387030 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387034 2563 flags.go:64] FLAG: --event-burst="100" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387038 2563 flags.go:64] FLAG: --event-qps="50" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387042 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387045 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387048 2563 flags.go:64] FLAG: --eviction-hard="" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387051 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387054 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387057 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387059 2563 flags.go:64] FLAG: --eviction-soft="" Sep 10 12:08:59.392729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387062 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387065 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387068 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387071 2563 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387074 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387077 2563 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387080 2563 flags.go:64] FLAG: --feature-gates="" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387084 2563 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387086 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387090 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387093 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387096 2563 flags.go:64] FLAG: --healthz-port="10248" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387099 2563 flags.go:64] FLAG: --help="false" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387102 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387105 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387108 2563 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387110 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387115 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387118 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387121 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387124 2563 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387126 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387129 2563 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 12:08:59.393372 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387132 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387135 2563 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387139 2563 flags.go:64] FLAG: --kube-reserved="" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387141 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387144 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387147 2563 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387150 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387153 2563 flags.go:64] FLAG: --lock-file="" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387155 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387159 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387161 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387171 2563 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387174 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387177 2563 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387180 2563 flags.go:64] FLAG: --logging-format="text" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387183 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387186 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387189 2563 flags.go:64] FLAG: --manifest-url="" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387192 2563 flags.go:64] FLAG: --manifest-url-header="" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387196 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387198 2563 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387202 2563 flags.go:64] FLAG: --max-pods="110" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387205 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387208 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387211 2563 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 12:08:59.394010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387213 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387217 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387220 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387223 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387230 2563 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387233 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387236 2563 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387239 2563 flags.go:64] FLAG: --pod-cidr="" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387241 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387247 2563 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387251 2563 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387254 2563 flags.go:64] FLAG: --pods-per-core="0" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387257 2563 flags.go:64] FLAG: --port="10250" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387260 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387262 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a769fd4f4d467bba" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387265 2563 flags.go:64] FLAG: --qos-reserved="" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387268 2563 flags.go:64] FLAG: --read-only-port="10255" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387271 2563 flags.go:64] FLAG: --register-node="true" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387274 2563 flags.go:64] FLAG: --register-with-taints="" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387281 2563 flags.go:64] FLAG: --registry-burst="10" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387286 2563 flags.go:64] FLAG: --registry-qps="5" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387288 2563 flags.go:64] FLAG: --reserved-cpus="" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387292 2563 flags.go:64] FLAG: --reserved-memory="" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387295 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387298 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 12:08:59.394680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387301 2563 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387303 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387307 2563 flags.go:64] FLAG: --runonce="false" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387310 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387313 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387316 2563 flags.go:64] FLAG: --seccomp-default="false" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387319 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387321 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387325 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387328 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387331 2563 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387334 2563 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387337 2563 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387339 2563 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387342 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387345 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387348 2563 flags.go:64] FLAG: --system-cgroups="" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387352 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387358 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387360 2563 flags.go:64] FLAG: --tls-cert-file="" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387363 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387367 2563 flags.go:64] FLAG: --tls-min-version="" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387369 2563 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387372 2563 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387375 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 12:08:59.395344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387378 2563 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387380 2563 flags.go:64] FLAG: --v="2" Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387384 2563 flags.go:64] FLAG: --version="false" Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387388 2563 flags.go:64] FLAG: --vmodule="" Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387392 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.387395 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387528 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387532 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387535 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387538 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387541 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387544 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387546 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387549 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387552 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387556 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387558 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387561 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387563 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387566 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387569 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:08:59.396119 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387573 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387576 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387579 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387583 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387586 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387589 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387592 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387594 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387597 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387599 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387616 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387619 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387621 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387624 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387627 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387631 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387634 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387637 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387640 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387643 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:08:59.396688 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387646 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387649 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387651 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387654 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387656 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387659 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387663 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387665 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387668 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387670 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387673 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387675 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387678 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387680 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387683 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387686 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387689 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387692 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387694 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387697 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:08:59.397209 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387699 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387702 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387704 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387706 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387709 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387711 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387714 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387716 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387719 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387722 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387724 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387727 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387729 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387731 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387734 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387736 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387739 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387741 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387745 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387747 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:08:59.397786 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387750 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387753 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387770 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387773 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387776 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387779 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387781 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387785 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387787 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387790 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387792 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387794 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387797 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387810 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387814 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387817 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387820 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387822 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387825 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387827 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:08:59.398302 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387830 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387833 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387836 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.387839 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.388594 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.395937 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.395953 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.396850 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.396858 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396911 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396915 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396918 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396921 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396924 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396926 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:08:59.398895 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396929 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396931 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396934 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396936 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396939 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396941 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396943 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396946 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396948 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396950 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396953 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396955 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396958 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396960 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396962 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396966 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396970 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396972 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396975 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:08:59.399478 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396977 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396980 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396983 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396986 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396990 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396993 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.396996 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397000 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397005 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397008 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397012 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397016 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397019 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397023 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397026 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397031 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397035 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397039 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397042 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397046 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:08:59.399994 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397049 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397052 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397055 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397059 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397063 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397066 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397070 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397074 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397078 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397082 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397085 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397090 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397094 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397097 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397101 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397107 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397113 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397120 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397125 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:08:59.400510 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397129 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397133 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397137 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397141 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397145 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397149 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397153 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397156 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397161 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397166 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397170 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397174 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397178 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397182 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397186 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397191 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397195 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397200 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397204 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:08:59.401011 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397208 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397212 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397216 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397221 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397225 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397229 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397235 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397241 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397246 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397251 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397257 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397261 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397266 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397270 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397274 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:08:59.401532 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397278 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.397285 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397458 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397466 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397471 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397476 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397481 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397489 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397496 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397502 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397507 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397512 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397516 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397521 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:08:59.401952 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397525 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397529 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397534 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397538 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397542 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397545 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397549 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397553 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397557 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397560 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397564 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397567 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397572 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397576 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397580 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397583 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397588 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397593 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397597 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397620 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:08:59.402322 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397625 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397629 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397633 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397637 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397640 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397644 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397649 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397652 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397656 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397660 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397664 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397668 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397671 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397675 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397678 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397682 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397685 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397689 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397692 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397696 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:08:59.402987 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397699 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397703 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397707 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397711 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397716 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397720 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397724 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397728 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397732 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397737 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397742 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397745 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397750 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397754 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397758 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397763 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397767 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397771 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397775 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397779 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:08:59.403499 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397783 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397788 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397792 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397796 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397801 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397805 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397809 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397813 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397818 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397822 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397826 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397830 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397834 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397837 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397841 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397845 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397850 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397854 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397858 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397861 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:08:59.404024 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397865 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:08:59.404548 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397869 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:08:59.404548 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397874 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:08:59.404548 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397878 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:08:59.404548 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397883 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:08:59.404548 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397888 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:08:59.404548 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:08:59.397892 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:08:59.404548 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.397901 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:08:59.404548 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.398059 2563 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 12:08:59.404548 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.400981 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 12:08:59.404548 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.401995 2563 server.go:1019] "Starting client certificate rotation" Sep 10 12:08:59.404548 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.402090 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 12:08:59.404548 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.402116 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 12:08:59.406463 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.406449 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 12:08:59.414131 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.414117 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 12:08:59.427249 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.427229 2563 log.go:25] "Validated CRI v1 runtime API" Sep 10 12:08:59.432726 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.432707 2563 log.go:25] "Validated CRI v1 image API" Sep 10 12:08:59.433464 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.433438 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 12:08:59.433587 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.433571 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 12:08:59.436018 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.436000 2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e3be9d9b-8b7a-42f0-88ec-885532f0c38b:/dev/nvme0n1p4 e8fac56a-912f-48bc-8310-684f3ed7a728:/dev/nvme0n1p3] Sep 10 12:08:59.436065 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.436019 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 12:08:59.441242 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.441142 2563 manager.go:216] Machine: {Timestamp:2026-09-10 12:08:59.439839049 +0000 UTC m=+0.370140955 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112142 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ec3b7e58ad0859d498ee99f30504c SystemUUID:ec2ec3b7-e58a-d085-9d49-8ee99f30504c BootID:32c14bb3-44b4-4315-988c-d18e2a3e4cde Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d7:42:e9:ae:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d7:42:e9:ae:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:52:69:99:e2:88 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 12:08:59.441242 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.441239 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 12:08:59.441344 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.441309 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 12:08:59.444965 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.444945 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 12:08:59.445123 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.444969 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-86.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 12:08:59.445876 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.445866 2563 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 12:08:59.445913 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.445879 2563 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 12:08:59.445913 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.445887 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 12:08:59.446691 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.446681 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 12:08:59.448446 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.448437 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 12:08:59.451961 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.451951 2563 state_mem.go:36] "Initialized new in-memory state store" Sep 10 12:08:59.452066 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.452057 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 12:08:59.452095 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.452084 2563 kubelet.go:486] "Attempting to sync node with API server" Sep 10 12:08:59.452095 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.452094 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 12:08:59.452150 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.452107 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 12:08:59.452150 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.452120 2563 kubelet.go:398] "Adding apiserver pod source" Sep 10 12:08:59.452150 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.452128 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 12:08:59.452441 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.452430 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 12:08:59.452502 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.452447 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 12:08:59.454845 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.454830 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 12:08:59.457804 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.457788 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 12:08:59.457881 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.457826 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 12:08:59.458673 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.458659 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 12:08:59.458737 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.458681 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 12:08:59.458737 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.458689 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 12:08:59.458737 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.458697 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 12:08:59.458737 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.458708 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 12:08:59.458737 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.458716 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 12:08:59.458940 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.458799 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 12:08:59.458940 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.458809 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 12:08:59.458940 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.458819 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 12:08:59.458940 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.458828 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 12:08:59.458940 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.458847 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 12:08:59.458940 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.458858 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 12:08:59.460470 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.460456 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 12:08:59.460539 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.460472 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 12:08:59.464316 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.464208 2563 server.go:1268] "Started kubelet" Sep 10 12:08:59.464388 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.464309 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 12:08:59.464388 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.464349 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 12:08:59.464388 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.464271 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 12:08:59.465015 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.464994 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 12:08:59.465117 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.465045 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 12:08:59.465117 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.465063 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-86.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 12:08:59.465076 ip-10-0-133-86 systemd[1]: Started Kubernetes Kubelet. Sep 10 12:08:59.465934 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.465914 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 12:08:59.466647 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.466632 2563 server.go:310] "Adding debug handlers to kubelet server" Sep 10 12:08:59.468811 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.468794 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 12:08:59.472778 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.471698 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-86.ec2.internal.18d3f458daf7a6d9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-86.ec2.internal,UID:ip-10-0-133-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-86.ec2.internal,},FirstTimestamp:2026-09-10 12:08:59.464181465 +0000 UTC m=+0.394483372,LastTimestamp:2026-09-10 12:08:59.464181465 +0000 UTC m=+0.394483372,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-86.ec2.internal,}" Sep 10 12:08:59.473711 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.473691 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 12:08:59.473812 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.473776 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-86.ec2.internal\" not found" Sep 10 12:08:59.473856 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.473693 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 12:08:59.474498 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.474477 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 12:08:59.474498 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.474499 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 12:08:59.474718 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.474544 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 12:08:59.474718 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.474573 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 12:08:59.474718 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.474621 2563 factory.go:55] Registering systemd factory Sep 10 12:08:59.474718 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.474634 2563 factory.go:223] Registration of the systemd container factory successfully Sep 10 12:08:59.474718 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.474637 2563 reconstruct.go:97] "Volume reconstruction finished" Sep 10 12:08:59.474718 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.474645 2563 reconciler.go:29] "Reconciler: start to sync state" Sep 10 12:08:59.474950 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.474897 2563 factory.go:153] Registering CRI-O factory Sep 10 12:08:59.474950 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.474909 2563 factory.go:223] Registration of the crio container factory successfully Sep 10 12:08:59.474950 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.474922 2563 factory.go:103] Registering Raw factory Sep 10 12:08:59.474950 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.474931 2563 manager.go:1196] Started watching for new ooms in manager Sep 10 12:08:59.475292 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.475280 2563 manager.go:349] Starting recovery of all containers Sep 10 12:08:59.478426 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.478398 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 12:08:59.478537 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.478480 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 12:08:59.484020 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.484001 2563 manager.go:354] Recovery completed Sep 10 12:08:59.485470 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.485450 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7vgg6" Sep 10 12:08:59.489414 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.489401 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:08:59.491363 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.491347 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:08:59.491430 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.491376 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:08:59.491430 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.491388 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:08:59.491910 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.491895 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 12:08:59.491910 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.491907 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 12:08:59.492044 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.491919 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:08:59.492044 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.491922 2563 state_mem.go:36] "Initialized new in-memory state store" Sep 10 12:08:59.492649 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.492631 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:08:59.492754 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.492660 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:08:59.492754 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.492675 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:08:59.493414 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.493403 2563 policy_none.go:49] "None policy: Start" Sep 10 12:08:59.493465 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.493420 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 12:08:59.493465 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.493436 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 12:08:59.493542 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.493478 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-86.ec2.internal.18d3f458dc966677 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-86.ec2.internal,UID:ip-10-0-133-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-86.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-86.ec2.internal,},FirstTimestamp:2026-09-10 12:08:59.491362423 +0000 UTC m=+0.421664330,LastTimestamp:2026-09-10 12:08:59.491362423 +0000 UTC m=+0.421664330,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-86.ec2.internal,}" Sep 10 12:08:59.494005 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.493983 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7vgg6" Sep 10 12:08:59.494593 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.494577 2563 policy_none.go:47] "Start" Sep 10 12:08:59.543712 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.530308 2563 manager.go:337] "Starting Device Plugin manager" Sep 10 12:08:59.543712 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.530344 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 12:08:59.543712 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.530354 2563 server.go:87] "Starting device plugin registration server" Sep 10 12:08:59.543712 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.530707 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 12:08:59.543712 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.530718 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 12:08:59.543712 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.530824 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 12:08:59.543712 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.530903 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 12:08:59.543712 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.530915 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 12:08:59.543712 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.531464 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 12:08:59.543712 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.531518 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-86.ec2.internal\" not found" Sep 10 12:08:59.573313 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.573288 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 12:08:59.574564 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.574547 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 12:08:59.574688 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.574596 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 12:08:59.574688 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.574639 2563 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 12:08:59.574688 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.574684 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 12:08:59.577000 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.576979 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:08:59.631777 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.631711 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:08:59.632567 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.632552 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:08:59.632661 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.632580 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:08:59.632661 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.632591 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:08:59.632661 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.632634 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.641659 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.641642 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.641730 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.641662 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-86.ec2.internal\": node \"ip-10-0-133-86.ec2.internal\" not found" Sep 10 12:08:59.666032 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.666011 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-86.ec2.internal\" not found" Sep 10 12:08:59.675650 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.675629 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-86.ec2.internal"] Sep 10 12:08:59.675731 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.675696 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:08:59.676939 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.676920 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:08:59.677018 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.676946 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:08:59.677018 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.676955 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:08:59.677958 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.677946 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:08:59.678081 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.678068 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.678118 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.678096 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:08:59.678680 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.678665 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:08:59.678785 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.678690 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:08:59.678785 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.678706 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:08:59.679165 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.679146 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:08:59.679241 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.679180 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:08:59.679241 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.679193 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:08:59.680298 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.680285 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.680347 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.680310 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:08:59.680981 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.680968 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:08:59.681062 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.680994 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:08:59.681062 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.681008 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:08:59.705111 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.705093 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-86.ec2.internal\" not found" node="ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.708926 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.708904 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-86.ec2.internal\" not found" node="ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.766318 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.766299 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-86.ec2.internal\" not found" Sep 10 12:08:59.776658 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.776640 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07e331d80984eff18313939d2e1216c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal\" (UID: \"07e331d80984eff18313939d2e1216c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.776710 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.776664 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07e331d80984eff18313939d2e1216c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal\" (UID: \"07e331d80984eff18313939d2e1216c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.776710 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.776681 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b02c4f22155d7d9f12bc6266564b08c5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-86.ec2.internal\" (UID: \"b02c4f22155d7d9f12bc6266564b08c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.866609 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.866588 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-86.ec2.internal\" not found" Sep 10 12:08:59.876926 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.876906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07e331d80984eff18313939d2e1216c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal\" (UID: \"07e331d80984eff18313939d2e1216c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.876983 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.876931 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07e331d80984eff18313939d2e1216c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal\" (UID: \"07e331d80984eff18313939d2e1216c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.876983 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.876949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b02c4f22155d7d9f12bc6266564b08c5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-86.ec2.internal\" (UID: \"b02c4f22155d7d9f12bc6266564b08c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.877046 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.877013 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b02c4f22155d7d9f12bc6266564b08c5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-86.ec2.internal\" (UID: \"b02c4f22155d7d9f12bc6266564b08c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.877046 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.877012 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07e331d80984eff18313939d2e1216c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal\" (UID: \"07e331d80984eff18313939d2e1216c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.877110 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:08:59.877012 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07e331d80984eff18313939d2e1216c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal\" (UID: \"07e331d80984eff18313939d2e1216c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" Sep 10 12:08:59.967369 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:08:59.967300 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-86.ec2.internal\" not found" Sep 10 12:09:00.007810 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.007789 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" Sep 10 12:09:00.011388 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.011314 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-86.ec2.internal" Sep 10 12:09:00.068007 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:00.067974 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-86.ec2.internal\" not found" Sep 10 12:09:00.168520 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:00.168496 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-86.ec2.internal\" not found" Sep 10 12:09:00.269031 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:00.268965 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-86.ec2.internal\" not found" Sep 10 12:09:00.369657 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:00.369619 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-86.ec2.internal\" not found" Sep 10 12:09:00.402075 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.402057 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 12:09:00.402440 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.402194 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 12:09:00.470201 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:00.470174 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-86.ec2.internal\" not found" Sep 10 12:09:00.493087 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.493066 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:09:00.496309 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.496281 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 12:03:59 +0000 UTC" deadline="2028-03-08 04:43:34.86450847 +0000 UTC" Sep 10 12:09:00.496362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.496310 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13072h34m34.368201734s" Sep 10 12:09:00.512646 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.512628 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:09:00.574106 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.574034 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" Sep 10 12:09:00.587551 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.587530 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 12:09:00.588571 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.588554 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-86.ec2.internal" Sep 10 12:09:00.591793 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.591776 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:09:00.597872 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.597858 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 12:09:00.864908 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:00.864776 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:09:00.901627 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:00.901590 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e331d80984eff18313939d2e1216c6.slice/crio-98215507f72de714dcecc92cc078597b8ff4ba6a3e266e80c19f227ac4250aaa WatchSource:0}: Error finding container 98215507f72de714dcecc92cc078597b8ff4ba6a3e266e80c19f227ac4250aaa: Status 404 returned error can't find the container with id 98215507f72de714dcecc92cc078597b8ff4ba6a3e266e80c19f227ac4250aaa Sep 10 12:09:01.231952 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.231877 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:09:01.452845 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.452813 2563 apiserver.go:52] "Watching apiserver" Sep 10 12:09:01.462716 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.462684 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 12:09:01.463072 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.463050 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-s7gp4","kube-system/konnectivity-agent-7zjnn","kube-system/kube-apiserver-proxy-ip-10-0-133-86.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr","openshift-cluster-node-tuning-operator/tuned-wjhd5","openshift-dns/node-resolver-fhqgx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal","openshift-multus/multus-v2k8h","openshift-image-registry/node-ca-95pgz","openshift-multus/multus-additional-cni-plugins-5z2dk","openshift-multus/network-metrics-daemon-hmnrj","openshift-network-diagnostics/network-check-target-wj2kf","openshift-network-operator/iptables-alerter-9bqkt","openshift-ovn-kubernetes/ovnkube-node-2dzmb"] Sep 10 12:09:01.465569 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.465547 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.467005 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.466985 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9bqkt" Sep 10 12:09:01.468594 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.468577 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 12:09:01.468688 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.468579 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 12:09:01.468833 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.468776 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.468962 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.468943 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 12:09:01.469068 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.468970 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 12:09:01.469394 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.469363 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 12:09:01.469480 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.469420 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2w9q5\"" Sep 10 12:09:01.469742 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.469726 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 12:09:01.470146 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.470126 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:09:01.470214 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.470142 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 12:09:01.470214 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.470155 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8l6bw\"" Sep 10 12:09:01.470445 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.470431 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.471982 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.471963 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.472240 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.472224 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 12:09:01.472337 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.472322 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 12:09:01.472428 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.472362 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9568t\"" Sep 10 12:09:01.472530 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.472506 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 12:09:01.472657 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.472612 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 12:09:01.473155 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.473130 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 12:09:01.473253 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.473172 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 12:09:01.473550 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.473537 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fhqgx" Sep 10 12:09:01.473742 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.473725 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 12:09:01.473892 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.473874 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 12:09:01.473966 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.473909 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 12:09:01.473966 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.473952 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jv4x5\"" Sep 10 12:09:01.474489 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.474473 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 12:09:01.474840 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.474821 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5rb8z\"" Sep 10 12:09:01.474840 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.474836 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-95pgz" Sep 10 12:09:01.474976 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.474821 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:09:01.474976 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.474932 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 12:09:01.476423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.476404 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.476549 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.476405 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 12:09:01.476549 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.476413 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 12:09:01.476864 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.476850 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2g66l\"" Sep 10 12:09:01.477560 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.477543 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 12:09:01.478001 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.477983 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7zjnn" Sep 10 12:09:01.478720 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.478705 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 12:09:01.478968 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.478946 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 12:09:01.479055 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.479027 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fhx7m\"" Sep 10 12:09:01.479339 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.479309 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 12:09:01.479522 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.479494 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t5n45\"" Sep 10 12:09:01.479522 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.479506 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:01.479675 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:01.479651 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:01.480421 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.480404 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8rwkm\"" Sep 10 12:09:01.481072 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.481052 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 12:09:01.481072 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.481070 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 12:09:01.481908 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.481886 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:01.482024 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:01.481976 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:01.483046 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.483027 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:01.483123 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:01.483091 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:01.487500 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.487478 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-systemd-units\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.487578 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.487519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-tuned\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.487622 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.487574 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d8f2f44-03ac-4f00-82d2-49234f75482c-ovnkube-config\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.487622 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.487603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czx8z\" (UniqueName: \"kubernetes.io/projected/47ec9902-997e-47ec-a043-54bf600ae741-kube-api-access-czx8z\") pod \"iptables-alerter-9bqkt\" (UID: \"47ec9902-997e-47ec-a043-54bf600ae741\") " pod="openshift-network-operator/iptables-alerter-9bqkt" Sep 10 12:09:01.487710 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.487639 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47ec9902-997e-47ec-a043-54bf600ae741-host-slash\") pod \"iptables-alerter-9bqkt\" (UID: \"47ec9902-997e-47ec-a043-54bf600ae741\") " pod="openshift-network-operator/iptables-alerter-9bqkt" Sep 10 12:09:01.487753 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.487664 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-socket-dir\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.487801 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.487755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-device-dir\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.487801 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.487782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv5tw\" (UniqueName: \"kubernetes.io/projected/78dc7f2b-aa77-4b4c-b336-10eb72da7282-kube-api-access-cv5tw\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.487902 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.487847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-node-log\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.488523 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.488474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-host\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.488614 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.488574 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e311b1dd-0f42-4a67-b40b-2077db0a85cc-tmp\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.488738 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.488618 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-run-ovn\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.488819 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.488735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/47ec9902-997e-47ec-a043-54bf600ae741-iptables-alerter-script\") pod \"iptables-alerter-9bqkt\" (UID: \"47ec9902-997e-47ec-a043-54bf600ae741\") " pod="openshift-network-operator/iptables-alerter-9bqkt" Sep 10 12:09:01.488819 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.488782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-modprobe-d\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.488819 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.488815 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-sysctl-conf\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.488977 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.488847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-sys\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.488977 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.488881 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29703f37-ff31-4fd2-8357-2978267cf4dc-host\") pod \"node-ca-95pgz\" (UID: \"29703f37-ff31-4fd2-8357-2978267cf4dc\") " pod="openshift-image-registry/node-ca-95pgz" Sep 10 12:09:01.488977 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.488915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bntc4\" (UniqueName: \"kubernetes.io/projected/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-kube-api-access-bntc4\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.488977 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.488945 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-run-systemd\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.489236 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-run-openvswitch\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.489236 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489127 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-slash\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.489236 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489203 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-cni-bin\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.489376 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d8f2f44-03ac-4f00-82d2-49234f75482c-env-overrides\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.489376 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d8f2f44-03ac-4f00-82d2-49234f75482c-ovn-node-metrics-cert\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.489376 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d8f2f44-03ac-4f00-82d2-49234f75482c-ovnkube-script-lib\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.489503 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489376 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-systemd\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.489503 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-lib-modules\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.489503 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.489635 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489507 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.489635 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-log-socket\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.489635 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489592 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-kubernetes\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.489635 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489622 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5j8r\" (UniqueName: \"kubernetes.io/projected/e311b1dd-0f42-4a67-b40b-2077db0a85cc-kube-api-access-k5j8r\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.489817 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489657 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-kubelet\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.489817 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.489817 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489749 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-run\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.489817 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-var-lib-kubelet\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.490000 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qqvp\" (UniqueName: \"kubernetes.io/projected/29703f37-ff31-4fd2-8357-2978267cf4dc-kube-api-access-6qqvp\") pod \"node-ca-95pgz\" (UID: \"29703f37-ff31-4fd2-8357-2978267cf4dc\") " pod="openshift-image-registry/node-ca-95pgz" Sep 10 12:09:01.490000 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489848 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-var-lib-openvswitch\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.490000 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29703f37-ff31-4fd2-8357-2978267cf4dc-serviceca\") pod \"node-ca-95pgz\" (UID: \"29703f37-ff31-4fd2-8357-2978267cf4dc\") " pod="openshift-image-registry/node-ca-95pgz" Sep 10 12:09:01.490000 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489938 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.490190 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.489980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-sysconfig\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.490190 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490028 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.490190 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2lj\" (UniqueName: \"kubernetes.io/projected/7d8f2f44-03ac-4f00-82d2-49234f75482c-kube-api-access-7p2lj\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.490190 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-sys-fs\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.490190 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/332fde89-b3a7-47d8-a0ae-ed81cd1d3a09-tmp-dir\") pod \"node-resolver-fhqgx\" (UID: \"332fde89-b3a7-47d8-a0ae-ed81cd1d3a09\") " pod="openshift-dns/node-resolver-fhqgx" Sep 10 12:09:01.490422 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-run-netns\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.490422 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-etc-openvswitch\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.490422 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-cni-netd\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.490422 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-sysctl-d\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.490422 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-registration-dir\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.490422 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490400 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/332fde89-b3a7-47d8-a0ae-ed81cd1d3a09-hosts-file\") pod \"node-resolver-fhqgx\" (UID: \"332fde89-b3a7-47d8-a0ae-ed81cd1d3a09\") " pod="openshift-dns/node-resolver-fhqgx" Sep 10 12:09:01.490747 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-etc-selinux\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.490747 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-system-cni-dir\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.490747 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-cnibin\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.490747 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.490747 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490600 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9wr7\" (UniqueName: \"kubernetes.io/projected/332fde89-b3a7-47d8-a0ae-ed81cd1d3a09-kube-api-access-p9wr7\") pod \"node-resolver-fhqgx\" (UID: \"332fde89-b3a7-47d8-a0ae-ed81cd1d3a09\") " pod="openshift-dns/node-resolver-fhqgx" Sep 10 12:09:01.490747 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-cni-binary-copy\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.491052 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.490816 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 12:09:01.514826 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.514807 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bftc8" Sep 10 12:09:01.523388 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.523371 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bftc8" Sep 10 12:09:01.575625 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.575582 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 12:09:01.579025 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.578982 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" event={"ID":"07e331d80984eff18313939d2e1216c6","Type":"ContainerStarted","Data":"98215507f72de714dcecc92cc078597b8ff4ba6a3e266e80c19f227ac4250aaa"} Sep 10 12:09:01.580215 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.580192 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-86.ec2.internal" event={"ID":"b02c4f22155d7d9f12bc6266564b08c5","Type":"ContainerStarted","Data":"921a50de761b8a680d924fc76a858eefa3ee1b4a94e5166f0a09d7f8df450dbe"} Sep 10 12:09:01.590790 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.590765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d8f2f44-03ac-4f00-82d2-49234f75482c-ovnkube-config\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.590890 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.590801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb177a6e-8da1-4dd5-8932-89846403bc31-multus-daemon-config\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.590890 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.590829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-etc-kubernetes\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.591028 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.590890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czx8z\" (UniqueName: \"kubernetes.io/projected/47ec9902-997e-47ec-a043-54bf600ae741-kube-api-access-czx8z\") pod \"iptables-alerter-9bqkt\" (UID: \"47ec9902-997e-47ec-a043-54bf600ae741\") " pod="openshift-network-operator/iptables-alerter-9bqkt" Sep 10 12:09:01.591028 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.590941 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-multus-cni-dir\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.591028 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.590969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47ec9902-997e-47ec-a043-54bf600ae741-host-slash\") pod \"iptables-alerter-9bqkt\" (UID: \"47ec9902-997e-47ec-a043-54bf600ae741\") " pod="openshift-network-operator/iptables-alerter-9bqkt" Sep 10 12:09:01.591028 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-socket-dir\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.591251 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591019 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-device-dir\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.591251 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591048 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47ec9902-997e-47ec-a043-54bf600ae741-host-slash\") pod \"iptables-alerter-9bqkt\" (UID: \"47ec9902-997e-47ec-a043-54bf600ae741\") " pod="openshift-network-operator/iptables-alerter-9bqkt" Sep 10 12:09:01.591251 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591071 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv5tw\" (UniqueName: \"kubernetes.io/projected/78dc7f2b-aa77-4b4c-b336-10eb72da7282-kube-api-access-cv5tw\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.591251 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591088 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-run-multus-certs\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.591251 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591115 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1b13cb2b-db12-4f3a-ba9f-04739617dff7-konnectivity-ca\") pod \"konnectivity-agent-7zjnn\" (UID: \"1b13cb2b-db12-4f3a-ba9f-04739617dff7\") " pod="kube-system/konnectivity-agent-7zjnn" Sep 10 12:09:01.591251 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-node-log\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.591251 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591194 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-host\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.591251 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591219 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e311b1dd-0f42-4a67-b40b-2077db0a85cc-tmp\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-multus-socket-dir-parent\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591278 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-host\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591312 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-var-lib-cni-bin\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591261 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-node-log\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591217 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-device-dir\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skrgz\" (UniqueName: \"kubernetes.io/projected/cb177a6e-8da1-4dd5-8932-89846403bc31-kube-api-access-skrgz\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-run-ovn\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-var-lib-cni-multus\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591428 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-run-ovn\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591428 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-hostroot\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591464 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-socket-dir\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591469 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/47ec9902-997e-47ec-a043-54bf600ae741-iptables-alerter-script\") pod \"iptables-alerter-9bqkt\" (UID: \"47ec9902-997e-47ec-a043-54bf600ae741\") " pod="openshift-network-operator/iptables-alerter-9bqkt" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-modprobe-d\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591573 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-sysctl-conf\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.591636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591607 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-sys\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591682 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-modprobe-d\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29703f37-ff31-4fd2-8357-2978267cf4dc-host\") pod \"node-ca-95pgz\" (UID: \"29703f37-ff31-4fd2-8357-2978267cf4dc\") " pod="openshift-image-registry/node-ca-95pgz" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591730 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-sys\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591767 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29703f37-ff31-4fd2-8357-2978267cf4dc-host\") pod \"node-ca-95pgz\" (UID: \"29703f37-ff31-4fd2-8357-2978267cf4dc\") " pod="openshift-image-registry/node-ca-95pgz" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-multus-conf-dir\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591764 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-sysctl-conf\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591815 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-dbus\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591849 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bntc4\" (UniqueName: \"kubernetes.io/projected/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-kube-api-access-bntc4\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-run-systemd\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-run-openvswitch\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591953 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-run-systemd\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.591975 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592009 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-slash\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592032 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-run-openvswitch\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-cni-bin\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d8f2f44-03ac-4f00-82d2-49234f75482c-env-overrides\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.592362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592157 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-cni-bin\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592111 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-slash\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592141 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/47ec9902-997e-47ec-a043-54bf600ae741-iptables-alerter-script\") pod \"iptables-alerter-9bqkt\" (UID: \"47ec9902-997e-47ec-a043-54bf600ae741\") " pod="openshift-network-operator/iptables-alerter-9bqkt" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592164 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d8f2f44-03ac-4f00-82d2-49234f75482c-ovnkube-config\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592179 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d8f2f44-03ac-4f00-82d2-49234f75482c-ovn-node-metrics-cert\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592254 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d8f2f44-03ac-4f00-82d2-49234f75482c-ovnkube-script-lib\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-systemd\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592304 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-lib-modules\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592364 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-systemd\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592394 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-log-socket\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592446 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-kubernetes\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592470 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5j8r\" (UniqueName: \"kubernetes.io/projected/e311b1dd-0f42-4a67-b40b-2077db0a85cc-kube-api-access-k5j8r\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-kubelet\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592520 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592528 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-log-socket\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.593233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592535 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-lib-modules\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592564 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d8f2f44-03ac-4f00-82d2-49234f75482c-env-overrides\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592546 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-run\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-var-lib-kubelet\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592632 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-kubelet\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592705 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592751 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-kubernetes\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592831 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d8f2f44-03ac-4f00-82d2-49234f75482c-ovnkube-script-lib\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592835 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-run\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592867 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592904 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-var-lib-kubelet\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.592625 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qqvp\" (UniqueName: \"kubernetes.io/projected/29703f37-ff31-4fd2-8357-2978267cf4dc-kube-api-access-6qqvp\") pod \"node-ca-95pgz\" (UID: \"29703f37-ff31-4fd2-8357-2978267cf4dc\") " pod="openshift-image-registry/node-ca-95pgz" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593150 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-kubelet-config\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593180 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-var-lib-openvswitch\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29703f37-ff31-4fd2-8357-2978267cf4dc-serviceca\") pod \"node-ca-95pgz\" (UID: \"29703f37-ff31-4fd2-8357-2978267cf4dc\") " pod="openshift-image-registry/node-ca-95pgz" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593205 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-system-cni-dir\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.594166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593296 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-var-lib-openvswitch\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-var-lib-kubelet\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593385 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-sysconfig\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593497 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593495 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-sysconfig\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb177a6e-8da1-4dd5-8932-89846403bc31-cni-binary-copy\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2lj\" (UniqueName: \"kubernetes.io/projected/7d8f2f44-03ac-4f00-82d2-49234f75482c-kube-api-access-7p2lj\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-sys-fs\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/332fde89-b3a7-47d8-a0ae-ed81cd1d3a09-tmp-dir\") pod \"node-resolver-fhqgx\" (UID: \"332fde89-b3a7-47d8-a0ae-ed81cd1d3a09\") " pod="openshift-dns/node-resolver-fhqgx" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-run-k8s-cni-cncf-io\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593757 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1b13cb2b-db12-4f3a-ba9f-04739617dff7-agent-certs\") pod \"konnectivity-agent-7zjnn\" (UID: \"1b13cb2b-db12-4f3a-ba9f-04739617dff7\") " pod="kube-system/konnectivity-agent-7zjnn" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-run-netns\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593811 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-etc-openvswitch\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-cni-netd\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-sysctl-d\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.594914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-registration-dir\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593900 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-sys-fs\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593930 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-etc-openvswitch\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593914 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/332fde89-b3a7-47d8-a0ae-ed81cd1d3a09-hosts-file\") pod \"node-resolver-fhqgx\" (UID: \"332fde89-b3a7-47d8-a0ae-ed81cd1d3a09\") " pod="openshift-dns/node-resolver-fhqgx" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593956 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-run-netns\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593958 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29703f37-ff31-4fd2-8357-2978267cf4dc-serviceca\") pod \"node-ca-95pgz\" (UID: \"29703f37-ff31-4fd2-8357-2978267cf4dc\") " pod="openshift-image-registry/node-ca-95pgz" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593968 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593970 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrp9j\" (UniqueName: \"kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j\") pod \"network-check-target-wj2kf\" (UID: \"a3436123-bd81-439e-92cf-d0c7ef0d8b74\") " pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.593993 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-cni-netd\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594009 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-etc-selinux\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594017 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/332fde89-b3a7-47d8-a0ae-ed81cd1d3a09-hosts-file\") pod \"node-resolver-fhqgx\" (UID: \"332fde89-b3a7-47d8-a0ae-ed81cd1d3a09\") " pod="openshift-dns/node-resolver-fhqgx" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594038 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-system-cni-dir\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594046 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-registration-dir\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594056 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-sysctl-d\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-cnibin\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594094 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-system-cni-dir\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.596094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9wr7\" (UniqueName: \"kubernetes.io/projected/332fde89-b3a7-47d8-a0ae-ed81cd1d3a09-kube-api-access-p9wr7\") pod \"node-resolver-fhqgx\" (UID: \"332fde89-b3a7-47d8-a0ae-ed81cd1d3a09\") " pod="openshift-dns/node-resolver-fhqgx" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594107 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78dc7f2b-aa77-4b4c-b336-10eb72da7282-etc-selinux\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594142 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-cnibin\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594143 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-cnibin\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-run-netns\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594266 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-cni-binary-copy\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-systemd-units\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594325 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-tuned\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m62f4\" (UniqueName: \"kubernetes.io/projected/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-kube-api-access-m62f4\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594399 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d8f2f44-03ac-4f00-82d2-49234f75482c-systemd-units\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594706 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-cni-binary-copy\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.594835 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/332fde89-b3a7-47d8-a0ae-ed81cd1d3a09-tmp-dir\") pod \"node-resolver-fhqgx\" (UID: \"332fde89-b3a7-47d8-a0ae-ed81cd1d3a09\") " pod="openshift-dns/node-resolver-fhqgx" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.596123 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e311b1dd-0f42-4a67-b40b-2077db0a85cc-tmp\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.596179 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d8f2f44-03ac-4f00-82d2-49234f75482c-ovn-node-metrics-cert\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.596941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.596897 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e311b1dd-0f42-4a67-b40b-2077db0a85cc-etc-tuned\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.601113 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.601073 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv5tw\" (UniqueName: \"kubernetes.io/projected/78dc7f2b-aa77-4b4c-b336-10eb72da7282-kube-api-access-cv5tw\") pod \"aws-ebs-csi-driver-node-7sdnr\" (UID: \"78dc7f2b-aa77-4b4c-b336-10eb72da7282\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.601568 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.601541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czx8z\" (UniqueName: \"kubernetes.io/projected/47ec9902-997e-47ec-a043-54bf600ae741-kube-api-access-czx8z\") pod \"iptables-alerter-9bqkt\" (UID: \"47ec9902-997e-47ec-a043-54bf600ae741\") " pod="openshift-network-operator/iptables-alerter-9bqkt" Sep 10 12:09:01.602198 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.602178 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qqvp\" (UniqueName: \"kubernetes.io/projected/29703f37-ff31-4fd2-8357-2978267cf4dc-kube-api-access-6qqvp\") pod \"node-ca-95pgz\" (UID: \"29703f37-ff31-4fd2-8357-2978267cf4dc\") " pod="openshift-image-registry/node-ca-95pgz" Sep 10 12:09:01.602473 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.602453 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bntc4\" (UniqueName: \"kubernetes.io/projected/48d6e21d-93d7-4316-a6e4-d3cf1a87979d-kube-api-access-bntc4\") pod \"multus-additional-cni-plugins-5z2dk\" (UID: \"48d6e21d-93d7-4316-a6e4-d3cf1a87979d\") " pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.602569 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.602552 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2lj\" (UniqueName: \"kubernetes.io/projected/7d8f2f44-03ac-4f00-82d2-49234f75482c-kube-api-access-7p2lj\") pod \"ovnkube-node-2dzmb\" (UID: \"7d8f2f44-03ac-4f00-82d2-49234f75482c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.602610 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.602565 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5j8r\" (UniqueName: \"kubernetes.io/projected/e311b1dd-0f42-4a67-b40b-2077db0a85cc-kube-api-access-k5j8r\") pod \"tuned-wjhd5\" (UID: \"e311b1dd-0f42-4a67-b40b-2077db0a85cc\") " pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.603421 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.603404 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9wr7\" (UniqueName: \"kubernetes.io/projected/332fde89-b3a7-47d8-a0ae-ed81cd1d3a09-kube-api-access-p9wr7\") pod \"node-resolver-fhqgx\" (UID: \"332fde89-b3a7-47d8-a0ae-ed81cd1d3a09\") " pod="openshift-dns/node-resolver-fhqgx" Sep 10 12:09:01.695144 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-multus-conf-dir\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.695144 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-dbus\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:01.695308 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:01.695308 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-kubelet-config\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:01.695308 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695220 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-multus-conf-dir\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.695308 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695243 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-kubelet-config\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:01.695308 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:01.695299 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:01.695497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695304 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-dbus\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:01.695497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-system-cni-dir\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.695497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-var-lib-kubelet\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.695497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695372 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-system-cni-dir\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.695497 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:01.695379 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs podName:d0707d93-ef7a-4969-9d05-9ec91e8f7e4b nodeName:}" failed. No retries permitted until 2026-09-10 12:09:02.195349518 +0000 UTC m=+3.125651455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs") pod "network-metrics-daemon-hmnrj" (UID: "d0707d93-ef7a-4969-9d05-9ec91e8f7e4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:01.695497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695378 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-var-lib-kubelet\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.695497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695408 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb177a6e-8da1-4dd5-8932-89846403bc31-cni-binary-copy\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.695497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-run-k8s-cni-cncf-io\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.695497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695444 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1b13cb2b-db12-4f3a-ba9f-04739617dff7-agent-certs\") pod \"konnectivity-agent-7zjnn\" (UID: \"1b13cb2b-db12-4f3a-ba9f-04739617dff7\") " pod="kube-system/konnectivity-agent-7zjnn" Sep 10 12:09:01.695497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrp9j\" (UniqueName: \"kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j\") pod \"network-check-target-wj2kf\" (UID: \"a3436123-bd81-439e-92cf-d0c7ef0d8b74\") " pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:01.695497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-cnibin\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.695497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-run-netns\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695507 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-run-k8s-cni-cncf-io\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695546 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m62f4\" (UniqueName: \"kubernetes.io/projected/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-kube-api-access-m62f4\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695562 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-cnibin\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695573 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb177a6e-8da1-4dd5-8932-89846403bc31-multus-daemon-config\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695587 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-run-netns\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-etc-kubernetes\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695647 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-etc-kubernetes\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-multus-cni-dir\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695710 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-run-multus-certs\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:01.695726 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1b13cb2b-db12-4f3a-ba9f-04739617dff7-konnectivity-ca\") pod \"konnectivity-agent-7zjnn\" (UID: \"1b13cb2b-db12-4f3a-ba9f-04739617dff7\") " pod="kube-system/konnectivity-agent-7zjnn" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:01.695773 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret podName:d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb nodeName:}" failed. No retries permitted until 2026-09-10 12:09:02.195755628 +0000 UTC m=+3.126057523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret") pod "global-pull-secret-syncer-s7gp4" (UID: "d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695781 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-multus-cni-dir\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-multus-socket-dir-parent\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695828 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-var-lib-cni-bin\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695844 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-run-multus-certs\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skrgz\" (UniqueName: \"kubernetes.io/projected/cb177a6e-8da1-4dd5-8932-89846403bc31-kube-api-access-skrgz\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-var-lib-cni-multus\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695910 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-multus-socket-dir-parent\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695913 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-var-lib-cni-bin\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-hostroot\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695956 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-hostroot\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.695984 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb177a6e-8da1-4dd5-8932-89846403bc31-host-var-lib-cni-multus\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.696102 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb177a6e-8da1-4dd5-8932-89846403bc31-cni-binary-copy\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.696235 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb177a6e-8da1-4dd5-8932-89846403bc31-multus-daemon-config\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.696822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.696352 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1b13cb2b-db12-4f3a-ba9f-04739617dff7-konnectivity-ca\") pod \"konnectivity-agent-7zjnn\" (UID: \"1b13cb2b-db12-4f3a-ba9f-04739617dff7\") " pod="kube-system/konnectivity-agent-7zjnn" Sep 10 12:09:01.697920 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.697904 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1b13cb2b-db12-4f3a-ba9f-04739617dff7-agent-certs\") pod \"konnectivity-agent-7zjnn\" (UID: \"1b13cb2b-db12-4f3a-ba9f-04739617dff7\") " pod="kube-system/konnectivity-agent-7zjnn" Sep 10 12:09:01.706345 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:01.706327 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:01.706345 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:01.706348 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:01.706508 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:01.706363 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nrp9j for pod openshift-network-diagnostics/network-check-target-wj2kf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:01.706508 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:01.706425 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j podName:a3436123-bd81-439e-92cf-d0c7ef0d8b74 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:02.206413992 +0000 UTC m=+3.136715887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nrp9j" (UniqueName: "kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j") pod "network-check-target-wj2kf" (UID: "a3436123-bd81-439e-92cf-d0c7ef0d8b74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:01.711758 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.711730 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skrgz\" (UniqueName: \"kubernetes.io/projected/cb177a6e-8da1-4dd5-8932-89846403bc31-kube-api-access-skrgz\") pod \"multus-v2k8h\" (UID: \"cb177a6e-8da1-4dd5-8932-89846403bc31\") " pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.711985 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.711961 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m62f4\" (UniqueName: \"kubernetes.io/projected/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-kube-api-access-m62f4\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:01.777282 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.777222 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5z2dk" Sep 10 12:09:01.785220 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.785204 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9bqkt" Sep 10 12:09:01.787425 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:01.787405 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d6e21d_93d7_4316_a6e4_d3cf1a87979d.slice/crio-d4116d4f4bdba42fecf11274dabb83eb4e1e473c06e5a4a6e7b52f71904bfcc0 WatchSource:0}: Error finding container d4116d4f4bdba42fecf11274dabb83eb4e1e473c06e5a4a6e7b52f71904bfcc0: Status 404 returned error can't find the container with id d4116d4f4bdba42fecf11274dabb83eb4e1e473c06e5a4a6e7b52f71904bfcc0 Sep 10 12:09:01.793380 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:01.793359 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ec9902_997e_47ec_a043_54bf600ae741.slice/crio-3db98f5393b4a3e524fdfa5226d090c16ec068e18d5da2a0598a133fccfc6777 WatchSource:0}: Error finding container 3db98f5393b4a3e524fdfa5226d090c16ec068e18d5da2a0598a133fccfc6777: Status 404 returned error can't find the container with id 3db98f5393b4a3e524fdfa5226d090c16ec068e18d5da2a0598a133fccfc6777 Sep 10 12:09:01.794109 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.794088 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:01.797828 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.797766 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" Sep 10 12:09:01.804029 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.804013 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" Sep 10 12:09:01.805977 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:01.805950 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8f2f44_03ac_4f00_82d2_49234f75482c.slice/crio-5227ba0d84c5a7768e1fe75f12b95f5d3aed0413a7ba2f8c04ade39a5ded24a2 WatchSource:0}: Error finding container 5227ba0d84c5a7768e1fe75f12b95f5d3aed0413a7ba2f8c04ade39a5ded24a2: Status 404 returned error can't find the container with id 5227ba0d84c5a7768e1fe75f12b95f5d3aed0413a7ba2f8c04ade39a5ded24a2 Sep 10 12:09:01.806668 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:01.806644 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78dc7f2b_aa77_4b4c_b336_10eb72da7282.slice/crio-3c3640d0809b0adca947c49f8e0aa9fe11b2d52c934defd1ff6863d888df9d7b WatchSource:0}: Error finding container 3c3640d0809b0adca947c49f8e0aa9fe11b2d52c934defd1ff6863d888df9d7b: Status 404 returned error can't find the container with id 3c3640d0809b0adca947c49f8e0aa9fe11b2d52c934defd1ff6863d888df9d7b Sep 10 12:09:01.808841 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.808821 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fhqgx" Sep 10 12:09:01.811725 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:01.811674 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode311b1dd_0f42_4a67_b40b_2077db0a85cc.slice/crio-95b24ba5d34acb919b2bfbdcdacd32416cfcdb3387ef1adf71394a9661b2f17c WatchSource:0}: Error finding container 95b24ba5d34acb919b2bfbdcdacd32416cfcdb3387ef1adf71394a9661b2f17c: Status 404 returned error can't find the container with id 95b24ba5d34acb919b2bfbdcdacd32416cfcdb3387ef1adf71394a9661b2f17c Sep 10 12:09:01.815472 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.815395 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-95pgz" Sep 10 12:09:01.816633 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:01.816614 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332fde89_b3a7_47d8_a0ae_ed81cd1d3a09.slice/crio-ad8e3af7167d8042730d421ad0ed50a8f058ba97743ca40d8e6ce1cb448a8544 WatchSource:0}: Error finding container ad8e3af7167d8042730d421ad0ed50a8f058ba97743ca40d8e6ce1cb448a8544: Status 404 returned error can't find the container with id ad8e3af7167d8042730d421ad0ed50a8f058ba97743ca40d8e6ce1cb448a8544 Sep 10 12:09:01.820843 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.820825 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v2k8h" Sep 10 12:09:01.823505 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:01.823484 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29703f37_ff31_4fd2_8357_2978267cf4dc.slice/crio-b124758503974534cd39883c8bcb2d3c538d635dedf307f13c241ba7ed675a9d WatchSource:0}: Error finding container b124758503974534cd39883c8bcb2d3c538d635dedf307f13c241ba7ed675a9d: Status 404 returned error can't find the container with id b124758503974534cd39883c8bcb2d3c538d635dedf307f13c241ba7ed675a9d Sep 10 12:09:01.825686 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:01.825516 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7zjnn" Sep 10 12:09:01.828155 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:01.828137 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb177a6e_8da1_4dd5_8932_89846403bc31.slice/crio-88f6c989628bc0fd14ad0c71abbeffaa31fcb877b404f60bd1f4832c6daab860 WatchSource:0}: Error finding container 88f6c989628bc0fd14ad0c71abbeffaa31fcb877b404f60bd1f4832c6daab860: Status 404 returned error can't find the container with id 88f6c989628bc0fd14ad0c71abbeffaa31fcb877b404f60bd1f4832c6daab860 Sep 10 12:09:01.833233 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:01.833209 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b13cb2b_db12_4f3a_ba9f_04739617dff7.slice/crio-c87c5bcb2014e7127237f0f754b9a78f1b824c6b6638132d7b14c4bd9edb5736 WatchSource:0}: Error finding container c87c5bcb2014e7127237f0f754b9a78f1b824c6b6638132d7b14c4bd9edb5736: Status 404 returned error can't find the container with id c87c5bcb2014e7127237f0f754b9a78f1b824c6b6638132d7b14c4bd9edb5736 Sep 10 12:09:02.199963 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.199867 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:02.199963 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.199946 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:02.200195 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:02.200033 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:02.200195 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:02.200037 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:02.200195 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:02.200096 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs podName:d0707d93-ef7a-4969-9d05-9ec91e8f7e4b nodeName:}" failed. No retries permitted until 2026-09-10 12:09:03.200077163 +0000 UTC m=+4.130379073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs") pod "network-metrics-daemon-hmnrj" (UID: "d0707d93-ef7a-4969-9d05-9ec91e8f7e4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:02.200195 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:02.200116 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret podName:d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb nodeName:}" failed. No retries permitted until 2026-09-10 12:09:03.200106818 +0000 UTC m=+4.130408713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret") pod "global-pull-secret-syncer-s7gp4" (UID: "d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:02.300690 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.300644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrp9j\" (UniqueName: \"kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j\") pod \"network-check-target-wj2kf\" (UID: \"a3436123-bd81-439e-92cf-d0c7ef0d8b74\") " pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:02.300882 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:02.300804 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:02.300882 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:02.300827 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:02.300882 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:02.300837 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nrp9j for pod openshift-network-diagnostics/network-check-target-wj2kf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:02.301049 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:02.300894 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j podName:a3436123-bd81-439e-92cf-d0c7ef0d8b74 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:03.300875643 +0000 UTC m=+4.231177553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrp9j" (UniqueName: "kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j") pod "network-check-target-wj2kf" (UID: "a3436123-bd81-439e-92cf-d0c7ef0d8b74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:02.525740 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.525635 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:04:01 +0000 UTC" deadline="2028-06-28 01:25:24.677068302 +0000 UTC" Sep 10 12:09:02.525740 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.525676 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15757h16m22.151396567s" Sep 10 12:09:02.575301 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.575268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:02.575468 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:02.575432 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:02.583773 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.583735 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7zjnn" event={"ID":"1b13cb2b-db12-4f3a-ba9f-04739617dff7","Type":"ContainerStarted","Data":"c87c5bcb2014e7127237f0f754b9a78f1b824c6b6638132d7b14c4bd9edb5736"} Sep 10 12:09:02.585423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.585393 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v2k8h" event={"ID":"cb177a6e-8da1-4dd5-8932-89846403bc31","Type":"ContainerStarted","Data":"88f6c989628bc0fd14ad0c71abbeffaa31fcb877b404f60bd1f4832c6daab860"} Sep 10 12:09:02.587019 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.586989 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-95pgz" event={"ID":"29703f37-ff31-4fd2-8357-2978267cf4dc","Type":"ContainerStarted","Data":"b124758503974534cd39883c8bcb2d3c538d635dedf307f13c241ba7ed675a9d"} Sep 10 12:09:02.588596 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.588572 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fhqgx" event={"ID":"332fde89-b3a7-47d8-a0ae-ed81cd1d3a09","Type":"ContainerStarted","Data":"ad8e3af7167d8042730d421ad0ed50a8f058ba97743ca40d8e6ce1cb448a8544"} Sep 10 12:09:02.590160 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.590134 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9bqkt" event={"ID":"47ec9902-997e-47ec-a043-54bf600ae741","Type":"ContainerStarted","Data":"3db98f5393b4a3e524fdfa5226d090c16ec068e18d5da2a0598a133fccfc6777"} Sep 10 12:09:02.591783 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.591758 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" event={"ID":"e311b1dd-0f42-4a67-b40b-2077db0a85cc","Type":"ContainerStarted","Data":"95b24ba5d34acb919b2bfbdcdacd32416cfcdb3387ef1adf71394a9661b2f17c"} Sep 10 12:09:02.593515 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.593489 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" event={"ID":"78dc7f2b-aa77-4b4c-b336-10eb72da7282","Type":"ContainerStarted","Data":"3c3640d0809b0adca947c49f8e0aa9fe11b2d52c934defd1ff6863d888df9d7b"} Sep 10 12:09:02.596077 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.596045 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" event={"ID":"7d8f2f44-03ac-4f00-82d2-49234f75482c","Type":"ContainerStarted","Data":"5227ba0d84c5a7768e1fe75f12b95f5d3aed0413a7ba2f8c04ade39a5ded24a2"} Sep 10 12:09:02.598064 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:02.598036 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z2dk" event={"ID":"48d6e21d-93d7-4316-a6e4-d3cf1a87979d","Type":"ContainerStarted","Data":"d4116d4f4bdba42fecf11274dabb83eb4e1e473c06e5a4a6e7b52f71904bfcc0"} Sep 10 12:09:03.208880 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:03.208747 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:03.208880 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:03.208829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:03.209138 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:03.208996 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:03.209138 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:03.209068 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs podName:d0707d93-ef7a-4969-9d05-9ec91e8f7e4b nodeName:}" failed. No retries permitted until 2026-09-10 12:09:05.209046805 +0000 UTC m=+6.139348725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs") pod "network-metrics-daemon-hmnrj" (UID: "d0707d93-ef7a-4969-9d05-9ec91e8f7e4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:03.209732 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:03.209564 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:03.209732 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:03.209625 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret podName:d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb nodeName:}" failed. No retries permitted until 2026-09-10 12:09:05.209608555 +0000 UTC m=+6.139910455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret") pod "global-pull-secret-syncer-s7gp4" (UID: "d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:03.309834 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:03.309795 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrp9j\" (UniqueName: \"kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j\") pod \"network-check-target-wj2kf\" (UID: \"a3436123-bd81-439e-92cf-d0c7ef0d8b74\") " pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:03.310031 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:03.310015 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:03.310111 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:03.310044 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:03.310111 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:03.310059 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nrp9j for pod openshift-network-diagnostics/network-check-target-wj2kf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:03.310211 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:03.310119 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j podName:a3436123-bd81-439e-92cf-d0c7ef0d8b74 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:05.310101185 +0000 UTC m=+6.240403087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrp9j" (UniqueName: "kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j") pod "network-check-target-wj2kf" (UID: "a3436123-bd81-439e-92cf-d0c7ef0d8b74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:03.526858 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:03.526763 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:04:01 +0000 UTC" deadline="2028-02-08 11:56:43.732331055 +0000 UTC" Sep 10 12:09:03.526858 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:03.526805 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12383h47m40.205530693s" Sep 10 12:09:03.593036 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:03.592987 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:03.593215 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:03.593183 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:03.594758 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:03.594728 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:03.594929 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:03.594904 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:04.575422 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:04.575374 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:04.575935 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:04.575526 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:05.228935 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:05.228893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:05.229099 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:05.228991 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:05.229171 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:05.229123 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:05.229229 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:05.229190 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret podName:d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb nodeName:}" failed. No retries permitted until 2026-09-10 12:09:09.229169944 +0000 UTC m=+10.159471844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret") pod "global-pull-secret-syncer-s7gp4" (UID: "d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:05.229613 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:05.229592 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:05.229747 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:05.229646 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs podName:d0707d93-ef7a-4969-9d05-9ec91e8f7e4b nodeName:}" failed. No retries permitted until 2026-09-10 12:09:09.229630186 +0000 UTC m=+10.159932082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs") pod "network-metrics-daemon-hmnrj" (UID: "d0707d93-ef7a-4969-9d05-9ec91e8f7e4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:05.330456 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:05.329730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrp9j\" (UniqueName: \"kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j\") pod \"network-check-target-wj2kf\" (UID: \"a3436123-bd81-439e-92cf-d0c7ef0d8b74\") " pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:05.330456 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:05.329979 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:05.330456 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:05.330000 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:05.330456 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:05.330013 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nrp9j for pod openshift-network-diagnostics/network-check-target-wj2kf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:05.330456 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:05.330070 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j podName:a3436123-bd81-439e-92cf-d0c7ef0d8b74 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:09.330051247 +0000 UTC m=+10.260353159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrp9j" (UniqueName: "kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j") pod "network-check-target-wj2kf" (UID: "a3436123-bd81-439e-92cf-d0c7ef0d8b74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:05.576396 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:05.575802 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:05.576396 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:05.575808 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:05.576396 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:05.575956 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:05.576396 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:05.576068 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:06.575884 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:06.575847 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:06.576073 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:06.575997 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:07.575310 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:07.575279 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:07.575873 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:07.575410 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:07.575873 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:07.575686 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:07.575873 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:07.575826 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:08.575036 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:08.574996 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:08.575200 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:08.575136 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:09.263832 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:09.263793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:09.264277 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:09.263875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:09.264277 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:09.264005 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:09.264277 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:09.264066 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret podName:d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb nodeName:}" failed. No retries permitted until 2026-09-10 12:09:17.264047632 +0000 UTC m=+18.194349530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret") pod "global-pull-secret-syncer-s7gp4" (UID: "d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:09.264277 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:09.264106 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:09.264277 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:09.264166 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs podName:d0707d93-ef7a-4969-9d05-9ec91e8f7e4b nodeName:}" failed. No retries permitted until 2026-09-10 12:09:17.264146721 +0000 UTC m=+18.194448635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs") pod "network-metrics-daemon-hmnrj" (UID: "d0707d93-ef7a-4969-9d05-9ec91e8f7e4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:09.364624 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:09.364577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrp9j\" (UniqueName: \"kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j\") pod \"network-check-target-wj2kf\" (UID: \"a3436123-bd81-439e-92cf-d0c7ef0d8b74\") " pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:09.364801 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:09.364736 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:09.364801 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:09.364765 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:09.364801 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:09.364780 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nrp9j for pod openshift-network-diagnostics/network-check-target-wj2kf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:09.364904 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:09.364838 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j podName:a3436123-bd81-439e-92cf-d0c7ef0d8b74 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:17.364822521 +0000 UTC m=+18.295124416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrp9j" (UniqueName: "kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j") pod "network-check-target-wj2kf" (UID: "a3436123-bd81-439e-92cf-d0c7ef0d8b74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:09.576369 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:09.576299 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:09.576528 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:09.576372 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:09.576683 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:09.576666 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:09.576781 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:09.576761 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:10.575762 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:10.575728 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:10.576211 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:10.575859 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:11.577672 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:11.574937 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:11.577672 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:11.575067 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:11.577672 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:11.575440 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:11.577672 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:11.575540 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:12.575313 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:12.575232 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:12.575436 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:12.575386 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:13.575011 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:13.574974 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:13.575011 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:13.575006 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:13.575474 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:13.575115 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:13.575474 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:13.575266 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:14.575651 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:14.575618 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:14.576085 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:14.575725 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:15.578584 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:15.578554 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:15.579065 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:15.578686 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:15.579065 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:15.578737 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:15.579065 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:15.578854 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:16.574860 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:16.574837 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:16.574966 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:16.574947 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:17.323476 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:17.323443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:17.324011 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:17.323498 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:17.324011 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:17.323592 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:17.324011 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:17.323596 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:17.324011 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:17.323657 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs podName:d0707d93-ef7a-4969-9d05-9ec91e8f7e4b nodeName:}" failed. No retries permitted until 2026-09-10 12:09:33.323640423 +0000 UTC m=+34.253942319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs") pod "network-metrics-daemon-hmnrj" (UID: "d0707d93-ef7a-4969-9d05-9ec91e8f7e4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:17.324011 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:17.323671 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret podName:d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb nodeName:}" failed. No retries permitted until 2026-09-10 12:09:33.323665206 +0000 UTC m=+34.253967100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret") pod "global-pull-secret-syncer-s7gp4" (UID: "d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:17.424165 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:17.424126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrp9j\" (UniqueName: \"kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j\") pod \"network-check-target-wj2kf\" (UID: \"a3436123-bd81-439e-92cf-d0c7ef0d8b74\") " pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:17.424323 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:17.424261 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:17.424323 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:17.424284 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:17.424323 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:17.424294 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nrp9j for pod openshift-network-diagnostics/network-check-target-wj2kf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:17.424507 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:17.424346 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j podName:a3436123-bd81-439e-92cf-d0c7ef0d8b74 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:33.424332105 +0000 UTC m=+34.354633998 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrp9j" (UniqueName: "kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j") pod "network-check-target-wj2kf" (UID: "a3436123-bd81-439e-92cf-d0c7ef0d8b74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:17.577350 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:17.575164 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:17.577350 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:17.575173 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:17.577350 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:17.575278 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:17.577350 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:17.575374 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:18.575082 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:18.575049 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:18.575578 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:18.575191 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:19.575982 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:19.575950 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:19.576378 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:19.576071 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:19.576444 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:19.576423 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:19.576548 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:19.576522 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:20.575284 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:20.575225 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:20.575366 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:20.575323 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:20.649836 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:20.649800 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" event={"ID":"7d8f2f44-03ac-4f00-82d2-49234f75482c","Type":"ContainerStarted","Data":"f23f3923a222b083ec9e89192922d7bbe894bf41aa508df84397e9be6ced3d1b"} Sep 10 12:09:20.650274 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:20.649921 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" event={"ID":"7d8f2f44-03ac-4f00-82d2-49234f75482c","Type":"ContainerStarted","Data":"3f26ecaaa6a88491ea7db9ea84024ffa54b9a15a2fc811378e5a7c7aa03bf9f8"} Sep 10 12:09:20.653696 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:20.653654 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v2k8h" event={"ID":"cb177a6e-8da1-4dd5-8932-89846403bc31","Type":"ContainerStarted","Data":"575978de7c3837c52c590e2175400beb905790e053195d2d949b83b6fda6cea2"} Sep 10 12:09:20.655028 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:20.655001 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-86.ec2.internal" event={"ID":"b02c4f22155d7d9f12bc6266564b08c5","Type":"ContainerStarted","Data":"5492a4e40f11e51c548fd0b0da371ed287a193d88a5922f3900546e744ae0ce7"} Sep 10 12:09:20.657411 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:20.657392 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" event={"ID":"e311b1dd-0f42-4a67-b40b-2077db0a85cc","Type":"ContainerStarted","Data":"de15da20bcf71635c9da0e40fc79abe64f2a4e59bba44f3ae87ad94411a267db"} Sep 10 12:09:20.683214 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:20.683165 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v2k8h" podStartSLOduration=2.233358803 podStartE2EDuration="20.683152972s" totalImagesPullingTime="18.449794169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:20.68298321 +0000 UTC m=+21.613285126" watchObservedRunningTime="2026-09-10 12:09:20.683152972 +0000 UTC m=+21.613454887" Sep 10 12:09:20.697296 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:20.697259 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-86.ec2.internal" podStartSLOduration=19.69724509 podStartE2EDuration="19.69724509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:20.696815585 +0000 UTC m=+21.627117502" watchObservedRunningTime="2026-09-10 12:09:20.69724509 +0000 UTC m=+21.627547007" Sep 10 12:09:20.713917 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:20.713882 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wjhd5" podStartSLOduration=2.26807414 podStartE2EDuration="20.713867948s" totalImagesPullingTime="18.445793808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:20.713100121 +0000 UTC m=+21.643402037" watchObservedRunningTime="2026-09-10 12:09:20.713867948 +0000 UTC m=+21.644169864" Sep 10 12:09:21.575713 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:21.575542 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:21.575892 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:21.575599 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:21.575892 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:21.575817 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:21.575892 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:21.575856 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:21.662588 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:21.662567 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-acl-logging/0.log" Sep 10 12:09:21.662997 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:21.662906 2563 generic.go:356] "Generic (PLEG): container finished" podID="7d8f2f44-03ac-4f00-82d2-49234f75482c" containerID="f23f3923a222b083ec9e89192922d7bbe894bf41aa508df84397e9be6ced3d1b" exitCode=1 Sep 10 12:09:21.662997 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:21.662980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" event={"ID":"7d8f2f44-03ac-4f00-82d2-49234f75482c","Type":"ContainerDied","Data":"f23f3923a222b083ec9e89192922d7bbe894bf41aa508df84397e9be6ced3d1b"} Sep 10 12:09:21.663084 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:21.663066 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" event={"ID":"7d8f2f44-03ac-4f00-82d2-49234f75482c","Type":"ContainerStarted","Data":"dde13041b8dde531c161f2abed94801a737efc4dd0b6871eb6b6c63ad5d4d5b6"} Sep 10 12:09:21.663137 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:21.663125 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" event={"ID":"7d8f2f44-03ac-4f00-82d2-49234f75482c","Type":"ContainerStarted","Data":"c041878c56e26758ae74a345ac30b9096f891fc7ce629e3b053e95eb54ab4945"} Sep 10 12:09:21.663189 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:21.663176 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" event={"ID":"7d8f2f44-03ac-4f00-82d2-49234f75482c","Type":"ContainerStarted","Data":"71b4f1d2b442d275d335b1930e8ca83cc957f891da34f790c5448aa472282011"} Sep 10 12:09:21.663229 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:21.663219 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" event={"ID":"7d8f2f44-03ac-4f00-82d2-49234f75482c","Type":"ContainerStarted","Data":"1d92732943e6d4ecbaf98c6a984fd6fa50ff4411dd8ca13721e42dbaa8e66c86"} Sep 10 12:09:21.664642 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:21.664620 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9bqkt" event={"ID":"47ec9902-997e-47ec-a043-54bf600ae741","Type":"ContainerStarted","Data":"a64990235906270b09cc73f74423121ae4d38cb7393ccd71dbf6c4129c636bf9"} Sep 10 12:09:22.575903 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:22.575869 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:22.576120 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:22.575977 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:22.667692 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:22.667648 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-95pgz" event={"ID":"29703f37-ff31-4fd2-8357-2978267cf4dc","Type":"ContainerStarted","Data":"3b156df9089cfa1667d2eeec64ec1a21548b50a73dbe41d26306bc68bef69964"} Sep 10 12:09:22.669132 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:22.669113 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fhqgx" event={"ID":"332fde89-b3a7-47d8-a0ae-ed81cd1d3a09","Type":"ContainerStarted","Data":"b40aef703245108617ed28edfec9ff20a3119e2b1b8c95cbfc50fd13894f18bd"} Sep 10 12:09:22.670689 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:22.670660 2563 generic.go:356] "Generic (PLEG): container finished" podID="07e331d80984eff18313939d2e1216c6" containerID="ba515f1d09985fe76f068b5b373c203658e89a9e8403fd443e5d6f68a07b38da" exitCode=0 Sep 10 12:09:22.670790 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:22.670732 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" event={"ID":"07e331d80984eff18313939d2e1216c6","Type":"ContainerDied","Data":"ba515f1d09985fe76f068b5b373c203658e89a9e8403fd443e5d6f68a07b38da"} Sep 10 12:09:22.673255 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:22.673221 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" event={"ID":"78dc7f2b-aa77-4b4c-b336-10eb72da7282","Type":"ContainerStarted","Data":"8b2044fae9bcc3fad39f931584c411280fb446e376677c4233be05575ac76f83"} Sep 10 12:09:22.674626 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:22.674589 2563 generic.go:356] "Generic (PLEG): container finished" podID="48d6e21d-93d7-4316-a6e4-d3cf1a87979d" containerID="c6434a4934a799dc8e5b9d29bb79d152d7d124576bf13c6587cefec045f52bec" exitCode=0 Sep 10 12:09:22.674712 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:22.674634 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z2dk" event={"ID":"48d6e21d-93d7-4316-a6e4-d3cf1a87979d","Type":"ContainerDied","Data":"c6434a4934a799dc8e5b9d29bb79d152d7d124576bf13c6587cefec045f52bec"} Sep 10 12:09:22.676083 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:22.675992 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7zjnn" event={"ID":"1b13cb2b-db12-4f3a-ba9f-04739617dff7","Type":"ContainerStarted","Data":"4d00c75699319b7a2d4ae90e4f8c95b017877131f8c6bd5cef40ae1c0e326f2a"} Sep 10 12:09:22.682041 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:22.682006 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9bqkt" podStartSLOduration=11.659537341 podStartE2EDuration="22.68199517s" totalImagesPullingTime="11.022457829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:21.681052003 +0000 UTC m=+22.611353918" watchObservedRunningTime="2026-09-10 12:09:22.68199517 +0000 UTC m=+23.612297103" Sep 10 12:09:22.682492 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:22.682470 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-95pgz" podStartSLOduration=4.291255002 podStartE2EDuration="22.682462293s" totalImagesPullingTime="18.391207291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:22.681986641 +0000 UTC m=+23.612288556" watchObservedRunningTime="2026-09-10 12:09:22.682462293 +0000 UTC m=+23.612764209" Sep 10 12:09:22.734769 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:22.734733 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fhqgx" podStartSLOduration=13.242712211 podStartE2EDuration="22.734718207s" totalImagesPullingTime="9.492005996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:22.734476302 +0000 UTC m=+23.664778219" watchObservedRunningTime="2026-09-10 12:09:22.734718207 +0000 UTC m=+23.665020124" Sep 10 12:09:23.214251 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.214027 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7zjnn" Sep 10 12:09:23.214657 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.214638 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7zjnn" Sep 10 12:09:23.229165 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.229117 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7zjnn" podStartSLOduration=4.847333479 podStartE2EDuration="23.229103103s" totalImagesPullingTime="18.381769624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:22.748498025 +0000 UTC m=+23.678799940" watchObservedRunningTime="2026-09-10 12:09:23.229103103 +0000 UTC m=+24.159405018" Sep 10 12:09:23.577134 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.577109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:23.577240 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:23.577203 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:23.577495 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.577482 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:23.577562 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:23.577545 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:23.660223 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.660196 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 12:09:23.680382 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.680345 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" event={"ID":"07e331d80984eff18313939d2e1216c6","Type":"ContainerStarted","Data":"b71d8d644ff6d0104ca39c3602f79e68aba9b617f1844db7cecd11f18dd49880"} Sep 10 12:09:23.682479 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.682451 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" event={"ID":"78dc7f2b-aa77-4b4c-b336-10eb72da7282","Type":"ContainerStarted","Data":"3b5e4540c4e611e1492ffb0c219b6eb6d51b5081c00798f2e24f708fe3bc96bf"} Sep 10 12:09:23.686129 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.686105 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-acl-logging/0.log" Sep 10 12:09:23.686619 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.686578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" event={"ID":"7d8f2f44-03ac-4f00-82d2-49234f75482c","Type":"ContainerStarted","Data":"15d068c6664f99ec0635f1c419e3ee7394ff330d477c69204f28b4ef915e0cf4"} Sep 10 12:09:23.686780 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.686762 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7zjnn" Sep 10 12:09:23.687266 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.687252 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7zjnn" Sep 10 12:09:23.696034 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:23.695999 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-86.ec2.internal" podStartSLOduration=22.695987748 podStartE2EDuration="22.695987748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:23.695448407 +0000 UTC m=+24.625750322" watchObservedRunningTime="2026-09-10 12:09:23.695987748 +0000 UTC m=+24.626289664" Sep 10 12:09:24.545433 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:24.545329 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T12:09:23.660220004Z","UUID":"5025e829-27e7-478c-9038-79e0df32c180","Handler":null,"Name":"","Endpoint":""} Sep 10 12:09:24.547003 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:24.546982 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 12:09:24.547133 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:24.547014 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 12:09:24.574899 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:24.574871 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:24.575056 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:24.574999 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:25.577243 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:25.576830 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:25.577243 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:25.576954 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:25.578423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:25.577322 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:25.578423 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:25.577416 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:25.693679 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:25.693436 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" event={"ID":"78dc7f2b-aa77-4b4c-b336-10eb72da7282","Type":"ContainerStarted","Data":"6345b2a4e928839ef7a6d4303a46ff1398bd004ff79aa47c710e1a35228a20d3"} Sep 10 12:09:25.697191 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:25.697167 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-acl-logging/0.log" Sep 10 12:09:25.697676 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:25.697648 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" event={"ID":"7d8f2f44-03ac-4f00-82d2-49234f75482c","Type":"ContainerStarted","Data":"63aa0d9020ca9efb7ef657e7b64fb3e7bc0a1a67e673a3ed4ec093dceb573ae9"} Sep 10 12:09:25.697979 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:25.697956 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:25.698096 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:25.698041 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:25.698146 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:25.698118 2563 scope.go:117] "RemoveContainer" containerID="f23f3923a222b083ec9e89192922d7bbe894bf41aa508df84397e9be6ced3d1b" Sep 10 12:09:25.717616 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:25.717530 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:25.717910 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:25.717893 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:25.744113 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:25.744070 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7sdnr" podStartSLOduration=4.376272639 podStartE2EDuration="25.744054949s" totalImagesPullingTime="21.36778231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:25.714819873 +0000 UTC m=+26.645121790" watchObservedRunningTime="2026-09-10 12:09:25.744054949 +0000 UTC m=+26.674356903" Sep 10 12:09:26.575337 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:26.575308 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:26.575718 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:26.575429 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:26.581383 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:26.581353 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:26.705498 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:26.705463 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-acl-logging/0.log" Sep 10 12:09:26.705958 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:26.705912 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" event={"ID":"7d8f2f44-03ac-4f00-82d2-49234f75482c","Type":"ContainerStarted","Data":"7c62e800c59ea520c50dc3b7da10666987943342e12441cdba0c1f85f20c069c"} Sep 10 12:09:26.744867 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:26.744818 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" podStartSLOduration=8.203486468 podStartE2EDuration="26.744802974s" totalImagesPullingTime="18.541316506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:26.743074808 +0000 UTC m=+27.673376726" watchObservedRunningTime="2026-09-10 12:09:26.744802974 +0000 UTC m=+27.675104889" Sep 10 12:09:27.391150 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:27.391105 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s7gp4"] Sep 10 12:09:27.391336 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:27.391260 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:27.391392 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:27.391360 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:27.394989 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:27.394966 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hmnrj"] Sep 10 12:09:27.395133 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:27.395018 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wj2kf"] Sep 10 12:09:27.395133 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:27.395083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:27.395225 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:27.395165 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:27.395269 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:27.395228 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:27.395325 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:27.395310 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:28.575666 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:28.575635 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:28.576156 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:28.575749 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:28.711458 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:28.711380 2563 generic.go:356] "Generic (PLEG): container finished" podID="48d6e21d-93d7-4316-a6e4-d3cf1a87979d" containerID="c02fc555a0d9a9ff6de1120536b67c351b4cdb7fdd03eb6dba48809cf0f828a8" exitCode=0 Sep 10 12:09:28.711458 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:28.711429 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z2dk" event={"ID":"48d6e21d-93d7-4316-a6e4-d3cf1a87979d","Type":"ContainerDied","Data":"c02fc555a0d9a9ff6de1120536b67c351b4cdb7fdd03eb6dba48809cf0f828a8"} Sep 10 12:09:29.576340 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:29.576310 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:29.576697 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:29.576426 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:29.576697 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:29.576473 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:29.576697 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:29.576585 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:30.575770 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:30.575598 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:30.575909 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:30.575844 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:30.718249 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:30.718219 2563 generic.go:356] "Generic (PLEG): container finished" podID="48d6e21d-93d7-4316-a6e4-d3cf1a87979d" containerID="5102c17c8ed3eb6a6aecdd1db102e996033e15da96e97729ea711a45640e83d5" exitCode=0 Sep 10 12:09:30.718590 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:30.718272 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z2dk" event={"ID":"48d6e21d-93d7-4316-a6e4-d3cf1a87979d","Type":"ContainerDied","Data":"5102c17c8ed3eb6a6aecdd1db102e996033e15da96e97729ea711a45640e83d5"} Sep 10 12:09:31.575492 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:31.575459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:31.575664 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:31.575557 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj2kf" podUID="a3436123-bd81-439e-92cf-d0c7ef0d8b74" Sep 10 12:09:31.575664 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:31.575628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:31.575769 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:31.575750 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s7gp4" podUID="d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb" Sep 10 12:09:32.575637 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:32.575591 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:32.576171 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:32.575734 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmnrj" podUID="d0707d93-ef7a-4969-9d05-9ec91e8f7e4b" Sep 10 12:09:32.725568 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:32.725532 2563 generic.go:356] "Generic (PLEG): container finished" podID="48d6e21d-93d7-4316-a6e4-d3cf1a87979d" containerID="ea0f55deb5a377cb05a1a5d2889a370a6d238a67a0103bb198fab1253ddd0b3f" exitCode=0 Sep 10 12:09:32.725796 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:32.725588 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z2dk" event={"ID":"48d6e21d-93d7-4316-a6e4-d3cf1a87979d","Type":"ContainerDied","Data":"ea0f55deb5a377cb05a1a5d2889a370a6d238a67a0103bb198fab1253ddd0b3f"} Sep 10 12:09:33.347150 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.347099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:33.347322 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.347161 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:33.347322 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.347245 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:33.347322 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.347246 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:33.347322 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.347301 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs podName:d0707d93-ef7a-4969-9d05-9ec91e8f7e4b nodeName:}" failed. No retries permitted until 2026-09-10 12:10:05.347286301 +0000 UTC m=+66.277588194 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs") pod "network-metrics-daemon-hmnrj" (UID: "d0707d93-ef7a-4969-9d05-9ec91e8f7e4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:33.347322 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.347314 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret podName:d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb nodeName:}" failed. No retries permitted until 2026-09-10 12:10:05.347307978 +0000 UTC m=+66.277609872 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret") pod "global-pull-secret-syncer-s7gp4" (UID: "d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:33.357584 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.357557 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-86.ec2.internal" event="NodeReady" Sep 10 12:09:33.357738 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.357726 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 12:09:33.391202 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.391170 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c9c5d996-4lf9h"] Sep 10 12:09:33.392968 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.392954 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.395556 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.395528 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 12:09:33.395700 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.395536 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 12:09:33.395700 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.395592 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 12:09:33.395700 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.395641 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5dtql\"" Sep 10 12:09:33.403974 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.403909 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 12:09:33.404858 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.404839 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fhp57"] Sep 10 12:09:33.406421 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.406407 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:33.408175 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.408158 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9c5d996-4lf9h"] Sep 10 12:09:33.408738 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.408719 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jp47d"] Sep 10 12:09:33.409013 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.408998 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 12:09:33.409216 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.409201 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 12:09:33.409346 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.409331 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r24lb\"" Sep 10 12:09:33.410398 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.410380 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jp47d" Sep 10 12:09:33.412731 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.412679 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 12:09:33.412999 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.412882 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 12:09:33.412999 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.412913 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 12:09:33.413393 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.413378 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zzmgg\"" Sep 10 12:09:33.422976 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.422956 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fhp57"] Sep 10 12:09:33.425308 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.425284 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jp47d"] Sep 10 12:09:33.448261 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.448238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrp9j\" (UniqueName: \"kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j\") pod \"network-check-target-wj2kf\" (UID: \"a3436123-bd81-439e-92cf-d0c7ef0d8b74\") " pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:33.448373 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.448360 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:33.448414 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.448377 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:33.448414 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.448387 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nrp9j for pod openshift-network-diagnostics/network-check-target-wj2kf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:33.448481 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.448460 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j podName:a3436123-bd81-439e-92cf-d0c7ef0d8b74 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:05.4484485 +0000 UTC m=+66.378750408 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nrp9j" (UniqueName: "kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j") pod "network-check-target-wj2kf" (UID: "a3436123-bd81-439e-92cf-d0c7ef0d8b74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:33.543719 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.543696 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:33.548762 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.548742 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-installation-pull-secrets\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.548865 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.548775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv26l\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-kube-api-access-jv26l\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.548865 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.548803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8792w\" (UniqueName: \"kubernetes.io/projected/f06abec5-e894-4483-b88a-3c28655e00fe-kube-api-access-8792w\") pod \"ingress-canary-jp47d\" (UID: \"f06abec5-e894-4483-b88a-3c28655e00fe\") " pod="openshift-ingress-canary/ingress-canary-jp47d" Sep 10 12:09:33.548973 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.548867 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-ca-trust-extracted\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.548973 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.548896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:33.548973 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.548917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b7326e5-af04-42de-bfcd-b04612763113-tmp-dir\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:33.548973 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.548949 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-certificates\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.549166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.548973 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b7326e5-af04-42de-bfcd-b04612763113-config-volume\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:33.549166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.549025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hht78\" (UniqueName: \"kubernetes.io/projected/3b7326e5-af04-42de-bfcd-b04612763113-kube-api-access-hht78\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:33.549166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.549067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-image-registry-private-configuration\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.549166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.549091 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-trusted-ca\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.549166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.549113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-bound-sa-token\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.549166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.549137 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f06abec5-e894-4483-b88a-3c28655e00fe-cert\") pod \"ingress-canary-jp47d\" (UID: \"f06abec5-e894-4483-b88a-3c28655e00fe\") " pod="openshift-ingress-canary/ingress-canary-jp47d" Sep 10 12:09:33.549352 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.549171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.575396 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.575361 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:09:33.575396 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.575361 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:09:33.578779 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.578745 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-twc65\"" Sep 10 12:09:33.579139 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.578853 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 12:09:33.579139 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.578853 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 12:09:33.579139 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.578938 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 12:09:33.628223 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.628116 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:33.649948 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.649913 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-ca-trust-extracted\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.650089 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.649956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:33.650089 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.650069 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:09:33.650215 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b7326e5-af04-42de-bfcd-b04612763113-tmp-dir\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:33.650215 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.650138 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls podName:3b7326e5-af04-42de-bfcd-b04612763113 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:34.150110529 +0000 UTC m=+35.080412426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls") pod "dns-default-fhp57" (UID: "3b7326e5-af04-42de-bfcd-b04612763113") : secret "dns-default-metrics-tls" not found Sep 10 12:09:33.650215 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650183 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-certificates\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.650215 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650204 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b7326e5-af04-42de-bfcd-b04612763113-config-volume\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:33.650423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hht78\" (UniqueName: \"kubernetes.io/projected/3b7326e5-af04-42de-bfcd-b04612763113-kube-api-access-hht78\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:33.650423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-image-registry-private-configuration\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.650423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-trusted-ca\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.650423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650324 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-bound-sa-token\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.650423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f06abec5-e894-4483-b88a-3c28655e00fe-cert\") pod \"ingress-canary-jp47d\" (UID: \"f06abec5-e894-4483-b88a-3c28655e00fe\") " pod="openshift-ingress-canary/ingress-canary-jp47d" Sep 10 12:09:33.650423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.650423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-installation-pull-secrets\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.650423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650402 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv26l\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-kube-api-access-jv26l\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.650423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8792w\" (UniqueName: \"kubernetes.io/projected/f06abec5-e894-4483-b88a-3c28655e00fe-kube-api-access-8792w\") pod \"ingress-canary-jp47d\" (UID: \"f06abec5-e894-4483-b88a-3c28655e00fe\") " pod="openshift-ingress-canary/ingress-canary-jp47d" Sep 10 12:09:33.650842 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650420 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b7326e5-af04-42de-bfcd-b04612763113-tmp-dir\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:33.650842 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.650475 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-ca-trust-extracted\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.650842 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.650514 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:09:33.650842 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.650522 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9c5d996-4lf9h: secret "image-registry-tls" not found Sep 10 12:09:33.650842 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:33.650548 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls podName:aaf36803-32cb-4779-b066-bdb5d0d0a3f6 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:34.150539776 +0000 UTC m=+35.080841669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls") pod "image-registry-c9c5d996-4lf9h" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6") : secret "image-registry-tls" not found Sep 10 12:09:33.651082 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.651011 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b7326e5-af04-42de-bfcd-b04612763113-config-volume\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:33.651747 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.651445 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-certificates\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.651871 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.651853 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-trusted-ca\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.655626 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.654897 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-installation-pull-secrets\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.655626 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.654928 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-image-registry-private-configuration\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.655626 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.654966 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f06abec5-e894-4483-b88a-3c28655e00fe-cert\") pod \"ingress-canary-jp47d\" (UID: \"f06abec5-e894-4483-b88a-3c28655e00fe\") " pod="openshift-ingress-canary/ingress-canary-jp47d" Sep 10 12:09:33.660749 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.660729 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-bound-sa-token\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.660944 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.660925 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hht78\" (UniqueName: \"kubernetes.io/projected/3b7326e5-af04-42de-bfcd-b04612763113-kube-api-access-hht78\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:33.661016 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.660999 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8792w\" (UniqueName: \"kubernetes.io/projected/f06abec5-e894-4483-b88a-3c28655e00fe-kube-api-access-8792w\") pod \"ingress-canary-jp47d\" (UID: \"f06abec5-e894-4483-b88a-3c28655e00fe\") " pod="openshift-ingress-canary/ingress-canary-jp47d" Sep 10 12:09:33.662691 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.662672 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv26l\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-kube-api-access-jv26l\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:33.721353 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:33.721322 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jp47d" Sep 10 12:09:34.007891 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:34.007728 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jp47d"] Sep 10 12:09:34.011888 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:34.011863 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06abec5_e894_4483_b88a_3c28655e00fe.slice/crio-6133149026e4dfd01ae5a0661e91515ad383c4aaaf34c9f04cf5a65411621c17 WatchSource:0}: Error finding container 6133149026e4dfd01ae5a0661e91515ad383c4aaaf34c9f04cf5a65411621c17: Status 404 returned error can't find the container with id 6133149026e4dfd01ae5a0661e91515ad383c4aaaf34c9f04cf5a65411621c17 Sep 10 12:09:34.154307 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:34.154274 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:34.154461 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:34.154380 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:34.154461 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:34.154433 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:09:34.154591 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:34.154520 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls podName:3b7326e5-af04-42de-bfcd-b04612763113 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:35.154500907 +0000 UTC m=+36.084802809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls") pod "dns-default-fhp57" (UID: "3b7326e5-af04-42de-bfcd-b04612763113") : secret "dns-default-metrics-tls" not found Sep 10 12:09:34.154591 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:34.154551 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:09:34.154591 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:34.154572 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9c5d996-4lf9h: secret "image-registry-tls" not found Sep 10 12:09:34.154710 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:34.154641 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls podName:aaf36803-32cb-4779-b066-bdb5d0d0a3f6 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:35.15462404 +0000 UTC m=+36.084925957 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls") pod "image-registry-c9c5d996-4lf9h" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6") : secret "image-registry-tls" not found Sep 10 12:09:34.575852 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:34.575808 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:09:34.578417 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:34.578393 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 12:09:34.578526 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:34.578393 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4nkk9\"" Sep 10 12:09:34.732310 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:34.732279 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jp47d" event={"ID":"f06abec5-e894-4483-b88a-3c28655e00fe","Type":"ContainerStarted","Data":"6133149026e4dfd01ae5a0661e91515ad383c4aaaf34c9f04cf5a65411621c17"} Sep 10 12:09:35.162172 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:35.162132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:35.162365 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:35.162227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:35.162365 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:35.162306 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:09:35.162365 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:35.162331 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9c5d996-4lf9h: secret "image-registry-tls" not found Sep 10 12:09:35.162478 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:35.162396 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls podName:aaf36803-32cb-4779-b066-bdb5d0d0a3f6 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:37.162375661 +0000 UTC m=+38.092677568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls") pod "image-registry-c9c5d996-4lf9h" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6") : secret "image-registry-tls" not found Sep 10 12:09:35.162478 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:35.162423 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:09:35.162478 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:35.162473 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls podName:3b7326e5-af04-42de-bfcd-b04612763113 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:37.16245761 +0000 UTC m=+38.092759524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls") pod "dns-default-fhp57" (UID: "3b7326e5-af04-42de-bfcd-b04612763113") : secret "dns-default-metrics-tls" not found Sep 10 12:09:37.179066 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:37.178979 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:37.179587 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:37.179068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:37.179587 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:37.179157 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:09:37.179587 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:37.179167 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:09:37.179587 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:37.179184 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9c5d996-4lf9h: secret "image-registry-tls" not found Sep 10 12:09:37.179587 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:37.179234 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls podName:3b7326e5-af04-42de-bfcd-b04612763113 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:41.179212936 +0000 UTC m=+42.109514836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls") pod "dns-default-fhp57" (UID: "3b7326e5-af04-42de-bfcd-b04612763113") : secret "dns-default-metrics-tls" not found Sep 10 12:09:37.179587 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:37.179256 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls podName:aaf36803-32cb-4779-b066-bdb5d0d0a3f6 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:41.179245298 +0000 UTC m=+42.109547199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls") pod "image-registry-c9c5d996-4lf9h" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6") : secret "image-registry-tls" not found Sep 10 12:09:38.751398 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:38.751363 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:39.747675 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.747642 2563 generic.go:356] "Generic (PLEG): container finished" podID="48d6e21d-93d7-4316-a6e4-d3cf1a87979d" containerID="76d57618879026a8be2895b612d57a9eb3f8d7c3a88a0c495af974884bf0692f" exitCode=0 Sep 10 12:09:39.747843 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.747708 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z2dk" event={"ID":"48d6e21d-93d7-4316-a6e4-d3cf1a87979d","Type":"ContainerDied","Data":"76d57618879026a8be2895b612d57a9eb3f8d7c3a88a0c495af974884bf0692f"} Sep 10 12:09:39.749167 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.749146 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jp47d" event={"ID":"f06abec5-e894-4483-b88a-3c28655e00fe","Type":"ContainerStarted","Data":"3dd1b4d6a95c6033bfe25594fda0a5315abe583d07db960d47575aa9bfa6eac0"} Sep 10 12:09:39.783313 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.783264 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jp47d" podStartSLOduration=2.078881408 podStartE2EDuration="6.783247403s" totalImagesPullingTime="4.704365995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:39.782457039 +0000 UTC m=+40.712758955" watchObservedRunningTime="2026-09-10 12:09:39.783247403 +0000 UTC m=+40.713549319" Sep 10 12:09:39.815248 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.815226 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt"] Sep 10 12:09:39.840285 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.840248 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l72wf"] Sep 10 12:09:39.841686 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.841330 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" Sep 10 12:09:39.844117 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.844091 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 10 12:09:39.844244 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.844138 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:09:39.844244 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.844189 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 10 12:09:39.844453 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.844417 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rx5kh\"" Sep 10 12:09:39.844539 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.844454 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 10 12:09:39.862431 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.862402 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9"] Sep 10 12:09:39.862551 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.862514 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l72wf" Sep 10 12:09:39.865127 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.865107 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9sd4m\"" Sep 10 12:09:39.865127 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.865119 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:09:39.865276 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.865134 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 10 12:09:39.883340 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.883288 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-686b5bf69d-pmhrm"] Sep 10 12:09:39.883522 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.883402 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:39.886273 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.886253 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 10 12:09:39.886490 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.886477 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 12:09:39.887469 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.887451 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 10 12:09:39.887533 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.887488 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 12:09:39.887588 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.887540 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jfgt2\"" Sep 10 12:09:39.897489 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.897470 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt"] Sep 10 12:09:39.897583 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.897503 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9"] Sep 10 12:09:39.897583 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.897523 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l72wf"] Sep 10 12:09:39.897583 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.897542 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-686b5bf69d-pmhrm"] Sep 10 12:09:39.897737 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.897582 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:39.900876 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.900339 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 10 12:09:39.900993 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.900970 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 12:09:39.901089 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.900996 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 10 12:09:39.901089 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.901004 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sk4cs\"" Sep 10 12:09:39.901089 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.901071 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 10 12:09:39.901228 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.901002 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 10 12:09:39.901228 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.901117 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 12:09:39.995269 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:39.995241 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:40.000724 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.000651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.000836 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.000727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76e40a68-4dae-467c-818a-aff5f4267b6b-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:40.000836 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.000753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.000836 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.000778 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvrvn\" (UniqueName: \"kubernetes.io/projected/76e40a68-4dae-467c-818a-aff5f4267b6b-kube-api-access-dvrvn\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:40.000836 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.000823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-default-certificate\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.000978 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.000847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-stats-auth\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.000978 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.000872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fwdj\" (UniqueName: \"kubernetes.io/projected/4eae3f77-21e5-4515-9502-c42a046e80b4-kube-api-access-4fwdj\") pod \"volume-data-source-validator-695c895bd6-l72wf\" (UID: \"4eae3f77-21e5-4515-9502-c42a046e80b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l72wf" Sep 10 12:09:40.000978 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.000921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:40.000978 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.000962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d696086e-b822-4f80-8c5b-64c6166408b2-config\") pod \"service-ca-operator-859f94c4b-nvjtt\" (UID: \"d696086e-b822-4f80-8c5b-64c6166408b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" Sep 10 12:09:40.001115 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.000989 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59t7n\" (UniqueName: \"kubernetes.io/projected/d696086e-b822-4f80-8c5b-64c6166408b2-kube-api-access-59t7n\") pod \"service-ca-operator-859f94c4b-nvjtt\" (UID: \"d696086e-b822-4f80-8c5b-64c6166408b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" Sep 10 12:09:40.001115 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.001010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d696086e-b822-4f80-8c5b-64c6166408b2-serving-cert\") pod \"service-ca-operator-859f94c4b-nvjtt\" (UID: \"d696086e-b822-4f80-8c5b-64c6166408b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" Sep 10 12:09:40.001115 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.001035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tfvg\" (UniqueName: \"kubernetes.io/projected/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-kube-api-access-7tfvg\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.063779 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.063746 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:40.101828 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.101805 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d696086e-b822-4f80-8c5b-64c6166408b2-config\") pod \"service-ca-operator-859f94c4b-nvjtt\" (UID: \"d696086e-b822-4f80-8c5b-64c6166408b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" Sep 10 12:09:40.101925 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.101834 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59t7n\" (UniqueName: \"kubernetes.io/projected/d696086e-b822-4f80-8c5b-64c6166408b2-kube-api-access-59t7n\") pod \"service-ca-operator-859f94c4b-nvjtt\" (UID: \"d696086e-b822-4f80-8c5b-64c6166408b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" Sep 10 12:09:40.101925 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.101855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d696086e-b822-4f80-8c5b-64c6166408b2-serving-cert\") pod \"service-ca-operator-859f94c4b-nvjtt\" (UID: \"d696086e-b822-4f80-8c5b-64c6166408b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" Sep 10 12:09:40.101925 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.101882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfvg\" (UniqueName: \"kubernetes.io/projected/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-kube-api-access-7tfvg\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.101925 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.101903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.102131 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.101941 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76e40a68-4dae-467c-818a-aff5f4267b6b-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:40.102131 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.101970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.102131 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.102001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvrvn\" (UniqueName: \"kubernetes.io/projected/76e40a68-4dae-467c-818a-aff5f4267b6b-kube-api-access-dvrvn\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:40.102131 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.102025 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-default-certificate\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.102131 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.102048 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-stats-auth\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.102131 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:40.102060 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 12:09:40.102131 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.102077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fwdj\" (UniqueName: \"kubernetes.io/projected/4eae3f77-21e5-4515-9502-c42a046e80b4-kube-api-access-4fwdj\") pod \"volume-data-source-validator-695c895bd6-l72wf\" (UID: \"4eae3f77-21e5-4515-9502-c42a046e80b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l72wf" Sep 10 12:09:40.102131 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.102118 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:40.102510 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:40.102143 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle podName:de72c6f8-1f0d-4aaa-b0ec-ae75249388e2 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:40.602105441 +0000 UTC m=+41.532407337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle") pod "router-default-686b5bf69d-pmhrm" (UID: "de72c6f8-1f0d-4aaa-b0ec-ae75249388e2") : configmap references non-existent config key: service-ca.crt Sep 10 12:09:40.102510 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:40.102178 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:09:40.102510 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:40.102226 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls podName:76e40a68-4dae-467c-818a-aff5f4267b6b nodeName:}" failed. No retries permitted until 2026-09-10 12:09:40.602210808 +0000 UTC m=+41.532512704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-lbvc9" (UID: "76e40a68-4dae-467c-818a-aff5f4267b6b") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:09:40.102510 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:40.102298 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs podName:de72c6f8-1f0d-4aaa-b0ec-ae75249388e2 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:40.602282658 +0000 UTC m=+41.532584571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs") pod "router-default-686b5bf69d-pmhrm" (UID: "de72c6f8-1f0d-4aaa-b0ec-ae75249388e2") : secret "router-metrics-certs-default" not found Sep 10 12:09:40.102510 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.102500 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d696086e-b822-4f80-8c5b-64c6166408b2-config\") pod \"service-ca-operator-859f94c4b-nvjtt\" (UID: \"d696086e-b822-4f80-8c5b-64c6166408b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" Sep 10 12:09:40.103020 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.102995 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76e40a68-4dae-467c-818a-aff5f4267b6b-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:40.104785 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.104767 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d696086e-b822-4f80-8c5b-64c6166408b2-serving-cert\") pod \"service-ca-operator-859f94c4b-nvjtt\" (UID: \"d696086e-b822-4f80-8c5b-64c6166408b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" Sep 10 12:09:40.105065 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.105047 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-default-certificate\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.105136 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.105052 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-stats-auth\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.111707 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.111688 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fwdj\" (UniqueName: \"kubernetes.io/projected/4eae3f77-21e5-4515-9502-c42a046e80b4-kube-api-access-4fwdj\") pod \"volume-data-source-validator-695c895bd6-l72wf\" (UID: \"4eae3f77-21e5-4515-9502-c42a046e80b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l72wf" Sep 10 12:09:40.111824 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.111803 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59t7n\" (UniqueName: \"kubernetes.io/projected/d696086e-b822-4f80-8c5b-64c6166408b2-kube-api-access-59t7n\") pod \"service-ca-operator-859f94c4b-nvjtt\" (UID: \"d696086e-b822-4f80-8c5b-64c6166408b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" Sep 10 12:09:40.112027 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.112009 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tfvg\" (UniqueName: \"kubernetes.io/projected/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-kube-api-access-7tfvg\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.112284 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.112263 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvrvn\" (UniqueName: \"kubernetes.io/projected/76e40a68-4dae-467c-818a-aff5f4267b6b-kube-api-access-dvrvn\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:40.152194 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.152170 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" Sep 10 12:09:40.171488 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.171465 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l72wf" Sep 10 12:09:40.435841 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.435774 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt"] Sep 10 12:09:40.439935 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:40.439914 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd696086e_b822_4f80_8c5b_64c6166408b2.slice/crio-8c6bbead5fc5acb980127cea7a945170d96fd8f44e8a25071b51e3fdfaaa7598 WatchSource:0}: Error finding container 8c6bbead5fc5acb980127cea7a945170d96fd8f44e8a25071b51e3fdfaaa7598: Status 404 returned error can't find the container with id 8c6bbead5fc5acb980127cea7a945170d96fd8f44e8a25071b51e3fdfaaa7598 Sep 10 12:09:40.462941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.462917 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l72wf"] Sep 10 12:09:40.465265 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:40.465244 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eae3f77_21e5_4515_9502_c42a046e80b4.slice/crio-c51e7dece497bf0ac5fa8a124b869c8c87e2dff0858308e90cf6c5e50967cc65 WatchSource:0}: Error finding container c51e7dece497bf0ac5fa8a124b869c8c87e2dff0858308e90cf6c5e50967cc65: Status 404 returned error can't find the container with id c51e7dece497bf0ac5fa8a124b869c8c87e2dff0858308e90cf6c5e50967cc65 Sep 10 12:09:40.607103 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.607073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.607241 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.607117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:40.607241 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:40.607215 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:09:40.607349 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:40.607258 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls podName:76e40a68-4dae-467c-818a-aff5f4267b6b nodeName:}" failed. No retries permitted until 2026-09-10 12:09:41.607245629 +0000 UTC m=+42.537547522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-lbvc9" (UID: "76e40a68-4dae-467c-818a-aff5f4267b6b") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:09:40.607349 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:40.607273 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle podName:de72c6f8-1f0d-4aaa-b0ec-ae75249388e2 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:41.607266919 +0000 UTC m=+42.537568829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle") pod "router-default-686b5bf69d-pmhrm" (UID: "de72c6f8-1f0d-4aaa-b0ec-ae75249388e2") : configmap references non-existent config key: service-ca.crt Sep 10 12:09:40.607349 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.607284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:40.607349 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:40.607334 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 12:09:40.607545 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:40.607360 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs podName:de72c6f8-1f0d-4aaa-b0ec-ae75249388e2 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:41.607353872 +0000 UTC m=+42.537655766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs") pod "router-default-686b5bf69d-pmhrm" (UID: "de72c6f8-1f0d-4aaa-b0ec-ae75249388e2") : secret "router-metrics-certs-default" not found Sep 10 12:09:40.752975 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.752941 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l72wf" event={"ID":"4eae3f77-21e5-4515-9502-c42a046e80b4","Type":"ContainerStarted","Data":"c51e7dece497bf0ac5fa8a124b869c8c87e2dff0858308e90cf6c5e50967cc65"} Sep 10 12:09:40.755886 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.755861 2563 generic.go:356] "Generic (PLEG): container finished" podID="48d6e21d-93d7-4316-a6e4-d3cf1a87979d" containerID="73554795dc50c00a14c86bdebb71c05a7f4cd241bbd54ad0fb17834bbca563b9" exitCode=0 Sep 10 12:09:40.755963 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.755938 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z2dk" event={"ID":"48d6e21d-93d7-4316-a6e4-d3cf1a87979d","Type":"ContainerDied","Data":"73554795dc50c00a14c86bdebb71c05a7f4cd241bbd54ad0fb17834bbca563b9"} Sep 10 12:09:40.757138 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:40.757119 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" event={"ID":"d696086e-b822-4f80-8c5b-64c6166408b2","Type":"ContainerStarted","Data":"8c6bbead5fc5acb980127cea7a945170d96fd8f44e8a25071b51e3fdfaaa7598"} Sep 10 12:09:41.212922 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:41.212840 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:41.213250 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:41.212948 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:41.213250 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:41.212985 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:09:41.213250 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:41.213004 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9c5d996-4lf9h: secret "image-registry-tls" not found Sep 10 12:09:41.213250 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:41.213046 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:09:41.213250 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:41.213062 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls podName:aaf36803-32cb-4779-b066-bdb5d0d0a3f6 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:49.213046551 +0000 UTC m=+50.143348474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls") pod "image-registry-c9c5d996-4lf9h" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6") : secret "image-registry-tls" not found Sep 10 12:09:41.213250 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:41.213089 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls podName:3b7326e5-af04-42de-bfcd-b04612763113 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:49.213077004 +0000 UTC m=+50.143378902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls") pod "dns-default-fhp57" (UID: "3b7326e5-af04-42de-bfcd-b04612763113") : secret "dns-default-metrics-tls" not found Sep 10 12:09:41.617560 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:41.617521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:41.617823 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:41.617586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:41.617823 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:41.617687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:41.617823 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:41.617704 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle podName:de72c6f8-1f0d-4aaa-b0ec-ae75249388e2 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:43.617687504 +0000 UTC m=+44.547989398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle") pod "router-default-686b5bf69d-pmhrm" (UID: "de72c6f8-1f0d-4aaa-b0ec-ae75249388e2") : configmap references non-existent config key: service-ca.crt Sep 10 12:09:41.617823 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:41.617704 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:09:41.617823 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:41.617767 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 12:09:41.617823 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:41.617821 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs podName:de72c6f8-1f0d-4aaa-b0ec-ae75249388e2 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:43.617806826 +0000 UTC m=+44.548108737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs") pod "router-default-686b5bf69d-pmhrm" (UID: "de72c6f8-1f0d-4aaa-b0ec-ae75249388e2") : secret "router-metrics-certs-default" not found Sep 10 12:09:41.618098 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:41.617839 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls podName:76e40a68-4dae-467c-818a-aff5f4267b6b nodeName:}" failed. No retries permitted until 2026-09-10 12:09:43.61782904 +0000 UTC m=+44.548130946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-lbvc9" (UID: "76e40a68-4dae-467c-818a-aff5f4267b6b") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:09:41.765272 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:41.765228 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z2dk" event={"ID":"48d6e21d-93d7-4316-a6e4-d3cf1a87979d","Type":"ContainerStarted","Data":"718d563646837f4082d012d1bdfeba9299e508616310e7752df6dda642cf7451"} Sep 10 12:09:41.788470 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:41.788428 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5z2dk" podStartSLOduration=9.203831409 podStartE2EDuration="41.788410984s" totalImagesPullingTime="32.584579575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:41.786840589 +0000 UTC m=+42.717142502" watchObservedRunningTime="2026-09-10 12:09:41.788410984 +0000 UTC m=+42.718712891" Sep 10 12:09:41.908594 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:41.908516 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:41.974029 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:41.973998 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:42.770284 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:42.770247 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l72wf" event={"ID":"4eae3f77-21e5-4515-9502-c42a046e80b4","Type":"ContainerStarted","Data":"ccac9deec86c42705946ab36f47555390e9712e118d6e5e1ed3c09b363f8edd7"} Sep 10 12:09:42.785176 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:42.785130 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l72wf" podStartSLOduration=1.712067419 podStartE2EDuration="3.785114328s" totalImagesPullingTime="2.073046909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:42.784739864 +0000 UTC m=+43.715041780" watchObservedRunningTime="2026-09-10 12:09:42.785114328 +0000 UTC m=+43.715416235" Sep 10 12:09:42.882783 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:42.882684 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:42.991085 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:42.991051 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:43.638265 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:43.638215 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:43.638456 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:43.638292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:43.638456 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:43.638341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:43.638456 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:43.638365 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 12:09:43.638456 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:43.638421 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs podName:de72c6f8-1f0d-4aaa-b0ec-ae75249388e2 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:47.638406432 +0000 UTC m=+48.568708326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs") pod "router-default-686b5bf69d-pmhrm" (UID: "de72c6f8-1f0d-4aaa-b0ec-ae75249388e2") : secret "router-metrics-certs-default" not found Sep 10 12:09:43.638456 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:43.638440 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle podName:de72c6f8-1f0d-4aaa-b0ec-ae75249388e2 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:47.638426364 +0000 UTC m=+48.568728262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle") pod "router-default-686b5bf69d-pmhrm" (UID: "de72c6f8-1f0d-4aaa-b0ec-ae75249388e2") : configmap references non-existent config key: service-ca.crt Sep 10 12:09:43.638456 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:43.638441 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:09:43.638696 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:43.638476 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls podName:76e40a68-4dae-467c-818a-aff5f4267b6b nodeName:}" failed. No retries permitted until 2026-09-10 12:09:47.638469369 +0000 UTC m=+48.568771263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-lbvc9" (UID: "76e40a68-4dae-467c-818a-aff5f4267b6b") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:09:44.780633 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:44.780583 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" event={"ID":"d696086e-b822-4f80-8c5b-64c6166408b2","Type":"ContainerStarted","Data":"8a887ae6eea62cdeebe1f2af1d02660f630dec60eebc78c0a4cadc82b295254a"} Sep 10 12:09:44.796896 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:44.796854 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" podStartSLOduration=2.456437651 podStartE2EDuration="5.796839465s" totalImagesPullingTime="3.340401814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:44.795711858 +0000 UTC m=+45.726013774" watchObservedRunningTime="2026-09-10 12:09:44.796839465 +0000 UTC m=+45.727141451" Sep 10 12:09:44.945346 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:44.945313 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:45.000445 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:45.000414 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:45.357188 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:45.357159 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:45.456620 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:45.456578 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:45.621989 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:45.621916 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:45.811841 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:45.811807 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:45.999907 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:45.999878 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:46.066824 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:46.066791 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:46.270339 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:46.270273 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:46.375571 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:46.375540 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:47.669985 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:47.669950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:47.670420 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:47.670011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:47.670420 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:47.670054 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:47.670420 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:47.670138 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 12:09:47.670420 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:47.670186 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:09:47.670420 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:47.670221 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs podName:de72c6f8-1f0d-4aaa-b0ec-ae75249388e2 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:55.670200835 +0000 UTC m=+56.600502745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs") pod "router-default-686b5bf69d-pmhrm" (UID: "de72c6f8-1f0d-4aaa-b0ec-ae75249388e2") : secret "router-metrics-certs-default" not found Sep 10 12:09:47.670420 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:47.670242 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls podName:76e40a68-4dae-467c-818a-aff5f4267b6b nodeName:}" failed. No retries permitted until 2026-09-10 12:09:55.670232859 +0000 UTC m=+56.600534753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-lbvc9" (UID: "76e40a68-4dae-467c-818a-aff5f4267b6b") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:09:47.670420 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:47.670264 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle podName:de72c6f8-1f0d-4aaa-b0ec-ae75249388e2 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:55.670252588 +0000 UTC m=+56.600554522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle") pod "router-default-686b5bf69d-pmhrm" (UID: "de72c6f8-1f0d-4aaa-b0ec-ae75249388e2") : configmap references non-existent config key: service-ca.crt Sep 10 12:09:47.893024 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:47.892998 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-7t8qr"] Sep 10 12:09:47.933367 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:47.933307 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-7t8qr"] Sep 10 12:09:47.933475 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:47.933393 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-7t8qr" Sep 10 12:09:47.936046 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:47.936026 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 10 12:09:47.936273 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:47.936254 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 10 12:09:47.936359 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:47.936339 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 10 12:09:47.937534 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:47.937513 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8dmjg\"" Sep 10 12:09:47.937644 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:47.937553 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 10 12:09:47.972662 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:47.972636 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:48.073723 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.073697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1f4ada1d-46b6-4be7-9906-9adc6b5b2808-signing-key\") pod \"service-ca-75d99c484-7t8qr\" (UID: \"1f4ada1d-46b6-4be7-9906-9adc6b5b2808\") " pod="openshift-service-ca/service-ca-75d99c484-7t8qr" Sep 10 12:09:48.073723 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.073724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnw84\" (UniqueName: \"kubernetes.io/projected/1f4ada1d-46b6-4be7-9906-9adc6b5b2808-kube-api-access-cnw84\") pod \"service-ca-75d99c484-7t8qr\" (UID: \"1f4ada1d-46b6-4be7-9906-9adc6b5b2808\") " pod="openshift-service-ca/service-ca-75d99c484-7t8qr" Sep 10 12:09:48.073937 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.073771 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1f4ada1d-46b6-4be7-9906-9adc6b5b2808-signing-cabundle\") pod \"service-ca-75d99c484-7t8qr\" (UID: \"1f4ada1d-46b6-4be7-9906-9adc6b5b2808\") " pod="openshift-service-ca/service-ca-75d99c484-7t8qr" Sep 10 12:09:48.174389 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.174357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1f4ada1d-46b6-4be7-9906-9adc6b5b2808-signing-key\") pod \"service-ca-75d99c484-7t8qr\" (UID: \"1f4ada1d-46b6-4be7-9906-9adc6b5b2808\") " pod="openshift-service-ca/service-ca-75d99c484-7t8qr" Sep 10 12:09:48.174389 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.174390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnw84\" (UniqueName: \"kubernetes.io/projected/1f4ada1d-46b6-4be7-9906-9adc6b5b2808-kube-api-access-cnw84\") pod \"service-ca-75d99c484-7t8qr\" (UID: \"1f4ada1d-46b6-4be7-9906-9adc6b5b2808\") " pod="openshift-service-ca/service-ca-75d99c484-7t8qr" Sep 10 12:09:48.174593 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.174445 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1f4ada1d-46b6-4be7-9906-9adc6b5b2808-signing-cabundle\") pod \"service-ca-75d99c484-7t8qr\" (UID: \"1f4ada1d-46b6-4be7-9906-9adc6b5b2808\") " pod="openshift-service-ca/service-ca-75d99c484-7t8qr" Sep 10 12:09:48.175146 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.175126 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1f4ada1d-46b6-4be7-9906-9adc6b5b2808-signing-cabundle\") pod \"service-ca-75d99c484-7t8qr\" (UID: \"1f4ada1d-46b6-4be7-9906-9adc6b5b2808\") " pod="openshift-service-ca/service-ca-75d99c484-7t8qr" Sep 10 12:09:48.176942 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.176927 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1f4ada1d-46b6-4be7-9906-9adc6b5b2808-signing-key\") pod \"service-ca-75d99c484-7t8qr\" (UID: \"1f4ada1d-46b6-4be7-9906-9adc6b5b2808\") " pod="openshift-service-ca/service-ca-75d99c484-7t8qr" Sep 10 12:09:48.184598 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.184554 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnw84\" (UniqueName: \"kubernetes.io/projected/1f4ada1d-46b6-4be7-9906-9adc6b5b2808-kube-api-access-cnw84\") pod \"service-ca-75d99c484-7t8qr\" (UID: \"1f4ada1d-46b6-4be7-9906-9adc6b5b2808\") " pod="openshift-service-ca/service-ca-75d99c484-7t8qr" Sep 10 12:09:48.242566 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.242538 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-7t8qr" Sep 10 12:09:48.392953 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.392923 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:48.496278 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.496243 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:48.529635 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.529599 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-7t8qr"] Sep 10 12:09:48.531975 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:09:48.531952 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4ada1d_46b6_4be7_9906_9adc6b5b2808.slice/crio-77eac527e25808f3896063c7f5caffaf00d456389c1e12241d6a8ac05b346128 WatchSource:0}: Error finding container 77eac527e25808f3896063c7f5caffaf00d456389c1e12241d6a8ac05b346128: Status 404 returned error can't find the container with id 77eac527e25808f3896063c7f5caffaf00d456389c1e12241d6a8ac05b346128 Sep 10 12:09:48.791966 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.791887 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-7t8qr" event={"ID":"1f4ada1d-46b6-4be7-9906-9adc6b5b2808","Type":"ContainerStarted","Data":"55a2cd08587e2bedd7428513fe95aae9b73bfb52e39c957eb9217fadf88d9fe6"} Sep 10 12:09:48.791966 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.791933 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-7t8qr" event={"ID":"1f4ada1d-46b6-4be7-9906-9adc6b5b2808","Type":"ContainerStarted","Data":"77eac527e25808f3896063c7f5caffaf00d456389c1e12241d6a8ac05b346128"} Sep 10 12:09:48.820935 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:48.820890 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-7t8qr" podStartSLOduration=1.8208748780000001 podStartE2EDuration="1.820874878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:48.820384787 +0000 UTC m=+49.750686702" watchObservedRunningTime="2026-09-10 12:09:48.820874878 +0000 UTC m=+49.751176795" Sep 10 12:09:49.179204 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:49.179127 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:49.283934 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:49.283904 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:09:49.284084 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:49.283968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:09:49.284084 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:49.284037 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:09:49.284084 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:49.284074 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:09:49.284188 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:49.284088 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9c5d996-4lf9h: secret "image-registry-tls" not found Sep 10 12:09:49.284188 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:49.284097 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls podName:3b7326e5-af04-42de-bfcd-b04612763113 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:05.284082613 +0000 UTC m=+66.214384507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls") pod "dns-default-fhp57" (UID: "3b7326e5-af04-42de-bfcd-b04612763113") : secret "dns-default-metrics-tls" not found Sep 10 12:09:49.284188 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:49.284128 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls podName:aaf36803-32cb-4779-b066-bdb5d0d0a3f6 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:05.284117521 +0000 UTC m=+66.214419420 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls") pod "image-registry-c9c5d996-4lf9h" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6") : secret "image-registry-tls" not found Sep 10 12:09:50.063472 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:50.063432 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:50.161212 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:50.161178 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:50.259146 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:50.259112 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:50.371502 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:50.371405 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:51.011132 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:51.011104 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:51.353049 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:51.352976 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:51.451129 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:51.451098 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:51.607228 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:51.607155 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:51.840256 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:51.840226 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fhqgx_332fde89-b3a7-47d8-a0ae-ed81cd1d3a09/dns-node-resolver/0.log" Sep 10 12:09:51.855887 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:51.855858 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:51.967038 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:51.966970 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:52.037222 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:52.037194 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:52.405111 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:52.405071 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:52.643639 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:52.643592 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-95pgz_29703f37-ff31-4fd2-8357-2978267cf4dc/node-ca/0.log" Sep 10 12:09:53.440623 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:53.440549 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jp47d_f06abec5-e894-4483-b88a-3c28655e00fe/serve-healthcheck-canary/0.log" Sep 10 12:09:53.447499 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:53.447477 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:53.503094 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:53.503063 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:53.729712 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:53.729629 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:53.825278 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:53.825245 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:53.929351 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:53.929316 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:54.114210 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:54.114181 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:54.710882 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:54.710845 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:54.810340 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:54.810309 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:54.867697 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:54.867669 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:54.997413 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:54.997389 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:55.208451 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:55.208424 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:55.735092 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:55.735058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:09:55.735531 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:55.735111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:55.735531 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:55.735205 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 12:09:55.735531 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:55.735316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:55.735531 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:55.735445 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls podName:76e40a68-4dae-467c-818a-aff5f4267b6b nodeName:}" failed. No retries permitted until 2026-09-10 12:10:11.735399342 +0000 UTC m=+72.665701235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-lbvc9" (UID: "76e40a68-4dae-467c-818a-aff5f4267b6b") : secret "cluster-monitoring-operator-tls" not found Sep 10 12:09:55.735531 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:09:55.735472 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle podName:de72c6f8-1f0d-4aaa-b0ec-ae75249388e2 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:11.735463149 +0000 UTC m=+72.665765048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle") pod "router-default-686b5bf69d-pmhrm" (UID: "de72c6f8-1f0d-4aaa-b0ec-ae75249388e2") : configmap references non-existent config key: service-ca.crt Sep 10 12:09:55.737363 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:55.737344 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-metrics-certs\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:09:55.810767 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:55.810741 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:56.208047 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:56.207971 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:56.306065 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:56.306037 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:56.413558 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:56.413531 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:56.793802 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:56.793766 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:57.458860 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:57.458829 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:57.604559 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:57.604523 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:57.718888 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:57.718810 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dzmb" Sep 10 12:09:58.209799 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:58.209770 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:58.657579 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:58.657542 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:58.998968 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:58.998930 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:59.211758 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:59.211728 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:59.812939 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:59.812905 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:09:59.994148 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:09:59.994111 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:00.210900 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:00.210822 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:01.210254 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:01.210225 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:01.374191 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:01.374157 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:01.526856 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:01.526832 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:01.663278 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:01.663250 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:02.110616 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:02.110563 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:02.277060 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:02.277026 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:02.712160 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:02.712128 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:02.771003 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:02.770973 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:02.875180 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:02.875153 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:03.265322 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:03.265285 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:03.360617 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:03.360574 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:04.608557 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:04.608520 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:04.709069 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:04.709041 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:04.810081 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:04.810046 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:05.312844 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.312812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:10:05.313002 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.312869 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:10:05.315380 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.315355 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b7326e5-af04-42de-bfcd-b04612763113-metrics-tls\") pod \"dns-default-fhp57\" (UID: \"3b7326e5-af04-42de-bfcd-b04612763113\") " pod="openshift-dns/dns-default-fhp57" Sep 10 12:10:05.315477 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.315442 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls\") pod \"image-registry-c9c5d996-4lf9h\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:10:05.414120 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.414088 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:10:05.414279 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.414133 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:10:05.416946 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.416928 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 12:10:05.417044 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.416951 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 12:10:05.427435 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.427412 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb-original-pull-secret\") pod \"global-pull-secret-syncer-s7gp4\" (UID: \"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb\") " pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:10:05.427520 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.427462 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0707d93-ef7a-4969-9d05-9ec91e8f7e4b-metrics-certs\") pod \"network-metrics-daemon-hmnrj\" (UID: \"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b\") " pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:10:05.487428 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.487405 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4nkk9\"" Sep 10 12:10:05.495647 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.495622 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmnrj" Sep 10 12:10:05.505889 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.505872 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5dtql\"" Sep 10 12:10:05.514035 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.514019 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:10:05.515422 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.515403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrp9j\" (UniqueName: \"kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j\") pod \"network-check-target-wj2kf\" (UID: \"a3436123-bd81-439e-92cf-d0c7ef0d8b74\") " pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:10:05.517962 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.517939 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 12:10:05.518060 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.518004 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r24lb\"" Sep 10 12:10:05.526218 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.526202 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fhp57" Sep 10 12:10:05.528741 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.528582 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 12:10:05.539795 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.539767 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrp9j\" (UniqueName: \"kubernetes.io/projected/a3436123-bd81-439e-92cf-d0c7ef0d8b74-kube-api-access-nrp9j\") pod \"network-check-target-wj2kf\" (UID: \"a3436123-bd81-439e-92cf-d0c7ef0d8b74\") " pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:10:05.689921 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.689890 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-twc65\"" Sep 10 12:10:05.693907 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.693888 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s7gp4" Sep 10 12:10:05.698329 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.698306 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:10:05.773788 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.773738 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hmnrj"] Sep 10 12:10:05.776462 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:05.776426 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0707d93_ef7a_4969_9d05_9ec91e8f7e4b.slice/crio-b26a7a882e147a45bedcad480a8b3b76adcd9a89a14f105ca277f5061a9466ce WatchSource:0}: Error finding container b26a7a882e147a45bedcad480a8b3b76adcd9a89a14f105ca277f5061a9466ce: Status 404 returned error can't find the container with id b26a7a882e147a45bedcad480a8b3b76adcd9a89a14f105ca277f5061a9466ce Sep 10 12:10:05.804739 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.804716 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9c5d996-4lf9h"] Sep 10 12:10:05.806517 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:05.806489 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf36803_32cb_4779_b066_bdb5d0d0a3f6.slice/crio-64281432ca4c60716c98d4d16c1becaa991b5dfa52a2fa65ff020f72e970cac3 WatchSource:0}: Error finding container 64281432ca4c60716c98d4d16c1becaa991b5dfa52a2fa65ff020f72e970cac3: Status 404 returned error can't find the container with id 64281432ca4c60716c98d4d16c1becaa991b5dfa52a2fa65ff020f72e970cac3 Sep 10 12:10:05.823803 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.823784 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fhp57"] Sep 10 12:10:05.831474 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:05.831450 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7326e5_af04_42de_bfcd_b04612763113.slice/crio-5cdce94b613990a39a66c95302354598cc571e5166c79185f3da675f82cfdd25 WatchSource:0}: Error finding container 5cdce94b613990a39a66c95302354598cc571e5166c79185f3da675f82cfdd25: Status 404 returned error can't find the container with id 5cdce94b613990a39a66c95302354598cc571e5166c79185f3da675f82cfdd25 Sep 10 12:10:05.836128 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.836099 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" event={"ID":"aaf36803-32cb-4779-b066-bdb5d0d0a3f6","Type":"ContainerStarted","Data":"64281432ca4c60716c98d4d16c1becaa991b5dfa52a2fa65ff020f72e970cac3"} Sep 10 12:10:05.837289 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.837269 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fhp57" event={"ID":"3b7326e5-af04-42de-bfcd-b04612763113","Type":"ContainerStarted","Data":"5cdce94b613990a39a66c95302354598cc571e5166c79185f3da675f82cfdd25"} Sep 10 12:10:05.838488 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.838468 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmnrj" event={"ID":"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b","Type":"ContainerStarted","Data":"b26a7a882e147a45bedcad480a8b3b76adcd9a89a14f105ca277f5061a9466ce"} Sep 10 12:10:05.966284 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.966252 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s7gp4"] Sep 10 12:10:05.969651 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:05.969590 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04bf30c_edfd_45d9_85bd_b3da3ef3d1eb.slice/crio-d6845015300d5ef5a3d3abe2d5eefb2b5c4af4d01547f7783b76033965d7950b WatchSource:0}: Error finding container d6845015300d5ef5a3d3abe2d5eefb2b5c4af4d01547f7783b76033965d7950b: Status 404 returned error can't find the container with id d6845015300d5ef5a3d3abe2d5eefb2b5c4af4d01547f7783b76033965d7950b Sep 10 12:10:05.978760 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:05.978734 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wj2kf"] Sep 10 12:10:05.982040 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:05.982018 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3436123_bd81_439e_92cf_d0c7ef0d8b74.slice/crio-7749ea2a7bab02ffc4c5ced4237c57b4121787ab3fec90058a9c084981e99b36 WatchSource:0}: Error finding container 7749ea2a7bab02ffc4c5ced4237c57b4121787ab3fec90058a9c084981e99b36: Status 404 returned error can't find the container with id 7749ea2a7bab02ffc4c5ced4237c57b4121787ab3fec90058a9c084981e99b36 Sep 10 12:10:06.845411 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:06.845373 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wj2kf" event={"ID":"a3436123-bd81-439e-92cf-d0c7ef0d8b74","Type":"ContainerStarted","Data":"7749ea2a7bab02ffc4c5ced4237c57b4121787ab3fec90058a9c084981e99b36"} Sep 10 12:10:06.847226 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:06.847202 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s7gp4" event={"ID":"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb","Type":"ContainerStarted","Data":"d6845015300d5ef5a3d3abe2d5eefb2b5c4af4d01547f7783b76033965d7950b"} Sep 10 12:10:06.849183 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:06.849155 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" event={"ID":"aaf36803-32cb-4779-b066-bdb5d0d0a3f6","Type":"ContainerStarted","Data":"a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f"} Sep 10 12:10:06.849942 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:06.849926 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:10:06.874473 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:06.874424 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" podStartSLOduration=44.874406659 podStartE2EDuration="44.874406659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:06.874266809 +0000 UTC m=+67.804568725" watchObservedRunningTime="2026-09-10 12:10:06.874406659 +0000 UTC m=+67.804708577" Sep 10 12:10:07.572670 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.561277 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8"] Sep 10 12:10:07.592070 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.591902 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8" Sep 10 12:10:07.596792 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.596766 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 12:10:07.596954 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.596931 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 12:10:07.599647 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.597183 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 12:10:07.600457 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.600052 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 10 12:10:07.600457 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.600302 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xhvlr\"" Sep 10 12:10:07.600457 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.600350 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8"] Sep 10 12:10:07.604214 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.604188 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:07.615809 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.615655 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l6fxj"] Sep 10 12:10:07.617896 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.617877 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.623062 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.623047 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 12:10:07.623326 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.623314 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9zfc5\"" Sep 10 12:10:07.623679 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.623664 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 12:10:07.623980 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.623737 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 12:10:07.623980 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.623881 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 12:10:07.632044 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.632022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwlzv\" (UniqueName: \"kubernetes.io/projected/c497df69-3ad1-48a8-a7ba-efef6e02fee0-kube-api-access-zwlzv\") pod \"managed-serviceaccount-addon-agent-6d798b645d-xwhp8\" (UID: \"c497df69-3ad1-48a8-a7ba-efef6e02fee0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8" Sep 10 12:10:07.632231 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.632198 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c497df69-3ad1-48a8-a7ba-efef6e02fee0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d798b645d-xwhp8\" (UID: \"c497df69-3ad1-48a8-a7ba-efef6e02fee0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8" Sep 10 12:10:07.646139 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.646067 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l6fxj"] Sep 10 12:10:07.657403 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.657368 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-pjhdr"] Sep 10 12:10:07.661651 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.661627 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-pjhdr" Sep 10 12:10:07.664069 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.663669 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-pnxm7"] Sep 10 12:10:07.665908 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.665883 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-pnxm7" Sep 10 12:10:07.666446 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.666406 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 12:10:07.666552 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.666448 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 12:10:07.667297 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.667079 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84"] Sep 10 12:10:07.668284 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.668093 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bkm6f\"" Sep 10 12:10:07.670124 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.669397 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84" Sep 10 12:10:07.670124 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.670000 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 10 12:10:07.671206 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.671052 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 10 12:10:07.673457 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.672154 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-n258j\"" Sep 10 12:10:07.673457 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.672379 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 10 12:10:07.673457 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.672776 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 10 12:10:07.673457 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.672991 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-s7fbk\"" Sep 10 12:10:07.677957 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.677941 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-pjhdr"] Sep 10 12:10:07.681508 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.681483 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-pnxm7"] Sep 10 12:10:07.709595 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.709569 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84"] Sep 10 12:10:07.732900 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.732864 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4419ae7d-bf51-4006-8c9f-dc0f3846de32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.733033 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.732919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4419ae7d-bf51-4006-8c9f-dc0f3846de32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.733033 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.732946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs5jv\" (UniqueName: \"kubernetes.io/projected/4419ae7d-bf51-4006-8c9f-dc0f3846de32-kube-api-access-xs5jv\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.733033 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.732998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4419ae7d-bf51-4006-8c9f-dc0f3846de32-crio-socket\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.733229 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.733038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8gnh\" (UniqueName: \"kubernetes.io/projected/89b2e6d1-92aa-4496-af1c-ba5357ceb884-kube-api-access-f8gnh\") pod \"downloads-85d98c998f-pjhdr\" (UID: \"89b2e6d1-92aa-4496-af1c-ba5357ceb884\") " pod="openshift-console/downloads-85d98c998f-pjhdr" Sep 10 12:10:07.733229 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.733061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk2dk\" (UniqueName: \"kubernetes.io/projected/34a07fb0-9069-4bb6-afb4-e0c5d85e71b6-kube-api-access-lk2dk\") pod \"migrator-fdbb8fdff-m8q84\" (UID: \"34a07fb0-9069-4bb6-afb4-e0c5d85e71b6\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84" Sep 10 12:10:07.733229 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.733115 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4419ae7d-bf51-4006-8c9f-dc0f3846de32-data-volume\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.733229 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.733142 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7326ab48-db32-4ae6-8f6e-023548063048-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pnxm7\" (UID: \"7326ab48-db32-4ae6-8f6e-023548063048\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pnxm7" Sep 10 12:10:07.733229 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.733169 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7326ab48-db32-4ae6-8f6e-023548063048-nginx-conf\") pod \"networking-console-plugin-79977f9844-pnxm7\" (UID: \"7326ab48-db32-4ae6-8f6e-023548063048\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pnxm7" Sep 10 12:10:07.733229 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.733204 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlzv\" (UniqueName: \"kubernetes.io/projected/c497df69-3ad1-48a8-a7ba-efef6e02fee0-kube-api-access-zwlzv\") pod \"managed-serviceaccount-addon-agent-6d798b645d-xwhp8\" (UID: \"c497df69-3ad1-48a8-a7ba-efef6e02fee0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8" Sep 10 12:10:07.733437 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.733240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c497df69-3ad1-48a8-a7ba-efef6e02fee0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d798b645d-xwhp8\" (UID: \"c497df69-3ad1-48a8-a7ba-efef6e02fee0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8" Sep 10 12:10:07.736732 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.736687 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c497df69-3ad1-48a8-a7ba-efef6e02fee0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d798b645d-xwhp8\" (UID: \"c497df69-3ad1-48a8-a7ba-efef6e02fee0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8" Sep 10 12:10:07.755741 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.755691 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:07.760456 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.760409 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwlzv\" (UniqueName: \"kubernetes.io/projected/c497df69-3ad1-48a8-a7ba-efef6e02fee0-kube-api-access-zwlzv\") pod \"managed-serviceaccount-addon-agent-6d798b645d-xwhp8\" (UID: \"c497df69-3ad1-48a8-a7ba-efef6e02fee0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8" Sep 10 12:10:07.834395 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.834356 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4419ae7d-bf51-4006-8c9f-dc0f3846de32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.834561 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.834409 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4419ae7d-bf51-4006-8c9f-dc0f3846de32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.834561 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.834432 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs5jv\" (UniqueName: \"kubernetes.io/projected/4419ae7d-bf51-4006-8c9f-dc0f3846de32-kube-api-access-xs5jv\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.834561 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.834477 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4419ae7d-bf51-4006-8c9f-dc0f3846de32-crio-socket\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.834561 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.834509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8gnh\" (UniqueName: \"kubernetes.io/projected/89b2e6d1-92aa-4496-af1c-ba5357ceb884-kube-api-access-f8gnh\") pod \"downloads-85d98c998f-pjhdr\" (UID: \"89b2e6d1-92aa-4496-af1c-ba5357ceb884\") " pod="openshift-console/downloads-85d98c998f-pjhdr" Sep 10 12:10:07.834561 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.834532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk2dk\" (UniqueName: \"kubernetes.io/projected/34a07fb0-9069-4bb6-afb4-e0c5d85e71b6-kube-api-access-lk2dk\") pod \"migrator-fdbb8fdff-m8q84\" (UID: \"34a07fb0-9069-4bb6-afb4-e0c5d85e71b6\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84" Sep 10 12:10:07.834904 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.834578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4419ae7d-bf51-4006-8c9f-dc0f3846de32-data-volume\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.834904 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.834625 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7326ab48-db32-4ae6-8f6e-023548063048-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pnxm7\" (UID: \"7326ab48-db32-4ae6-8f6e-023548063048\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pnxm7" Sep 10 12:10:07.834904 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.834655 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7326ab48-db32-4ae6-8f6e-023548063048-nginx-conf\") pod \"networking-console-plugin-79977f9844-pnxm7\" (UID: \"7326ab48-db32-4ae6-8f6e-023548063048\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pnxm7" Sep 10 12:10:07.835052 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.835034 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4419ae7d-bf51-4006-8c9f-dc0f3846de32-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.835242 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.835214 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4419ae7d-bf51-4006-8c9f-dc0f3846de32-crio-socket\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.835379 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.835358 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7326ab48-db32-4ae6-8f6e-023548063048-nginx-conf\") pod \"networking-console-plugin-79977f9844-pnxm7\" (UID: \"7326ab48-db32-4ae6-8f6e-023548063048\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pnxm7" Sep 10 12:10:07.835856 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.835814 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4419ae7d-bf51-4006-8c9f-dc0f3846de32-data-volume\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.838384 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.838333 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4419ae7d-bf51-4006-8c9f-dc0f3846de32-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.838721 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.838678 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7326ab48-db32-4ae6-8f6e-023548063048-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pnxm7\" (UID: \"7326ab48-db32-4ae6-8f6e-023548063048\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pnxm7" Sep 10 12:10:07.843273 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.843248 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:07.845387 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:10:07.845366 2563 projected.go:291] Couldn't get configMap openshift-kube-storage-version-migrator/openshift-service-ca.crt: configmap "openshift-service-ca.crt" not found Sep 10 12:10:07.845485 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:10:07.845391 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lk2dk for pod openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84: configmap "openshift-service-ca.crt" not found Sep 10 12:10:07.845485 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:10:07.845452 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34a07fb0-9069-4bb6-afb4-e0c5d85e71b6-kube-api-access-lk2dk podName:34a07fb0-9069-4bb6-afb4-e0c5d85e71b6 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:08.345434074 +0000 UTC m=+69.275735991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lk2dk" (UniqueName: "kubernetes.io/projected/34a07fb0-9069-4bb6-afb4-e0c5d85e71b6-kube-api-access-lk2dk") pod "migrator-fdbb8fdff-m8q84" (UID: "34a07fb0-9069-4bb6-afb4-e0c5d85e71b6") : configmap "openshift-service-ca.crt" not found Sep 10 12:10:07.849304 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.849279 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs5jv\" (UniqueName: \"kubernetes.io/projected/4419ae7d-bf51-4006-8c9f-dc0f3846de32-kube-api-access-xs5jv\") pod \"insights-runtime-extractor-l6fxj\" (UID: \"4419ae7d-bf51-4006-8c9f-dc0f3846de32\") " pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.853411 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.853388 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8gnh\" (UniqueName: \"kubernetes.io/projected/89b2e6d1-92aa-4496-af1c-ba5357ceb884-kube-api-access-f8gnh\") pod \"downloads-85d98c998f-pjhdr\" (UID: \"89b2e6d1-92aa-4496-af1c-ba5357ceb884\") " pod="openshift-console/downloads-85d98c998f-pjhdr" Sep 10 12:10:07.857004 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.856979 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmnrj" event={"ID":"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b","Type":"ContainerStarted","Data":"fa1e2b60761540af44c5fcf302a390acfc0e31898c44db1b49f558832dc1ead7"} Sep 10 12:10:07.918346 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.918270 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8" Sep 10 12:10:07.930176 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.930142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l6fxj" Sep 10 12:10:07.939313 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.939289 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:07.978279 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.978247 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-pjhdr" Sep 10 12:10:07.987504 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:07.987479 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-pnxm7" Sep 10 12:10:08.071791 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.071764 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:08.442042 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.441975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk2dk\" (UniqueName: \"kubernetes.io/projected/34a07fb0-9069-4bb6-afb4-e0c5d85e71b6-kube-api-access-lk2dk\") pod \"migrator-fdbb8fdff-m8q84\" (UID: \"34a07fb0-9069-4bb6-afb4-e0c5d85e71b6\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84" Sep 10 12:10:08.446404 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.446349 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk2dk\" (UniqueName: \"kubernetes.io/projected/34a07fb0-9069-4bb6-afb4-e0c5d85e71b6-kube-api-access-lk2dk\") pod \"migrator-fdbb8fdff-m8q84\" (UID: \"34a07fb0-9069-4bb6-afb4-e0c5d85e71b6\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84" Sep 10 12:10:08.539423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.539361 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8"] Sep 10 12:10:08.540432 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.539725 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-pjhdr"] Sep 10 12:10:08.545298 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:08.545268 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc497df69_3ad1_48a8_a7ba_efef6e02fee0.slice/crio-925b866e045e913a565c86d2f84e4c9fc43c4f8bf526a4832ed95958107f6f41 WatchSource:0}: Error finding container 925b866e045e913a565c86d2f84e4c9fc43c4f8bf526a4832ed95958107f6f41: Status 404 returned error can't find the container with id 925b866e045e913a565c86d2f84e4c9fc43c4f8bf526a4832ed95958107f6f41 Sep 10 12:10:08.545636 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:08.545521 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89b2e6d1_92aa_4496_af1c_ba5357ceb884.slice/crio-01fdeed6e66868272c5c8b7bc1c66054adde6a6b8bdda7be223c327b1de9089b WatchSource:0}: Error finding container 01fdeed6e66868272c5c8b7bc1c66054adde6a6b8bdda7be223c327b1de9089b: Status 404 returned error can't find the container with id 01fdeed6e66868272c5c8b7bc1c66054adde6a6b8bdda7be223c327b1de9089b Sep 10 12:10:08.555454 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.555414 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-pnxm7"] Sep 10 12:10:08.593765 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.593732 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84" Sep 10 12:10:08.599802 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.599697 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l6fxj"] Sep 10 12:10:08.861435 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.861356 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8" event={"ID":"c497df69-3ad1-48a8-a7ba-efef6e02fee0","Type":"ContainerStarted","Data":"925b866e045e913a565c86d2f84e4c9fc43c4f8bf526a4832ed95958107f6f41"} Sep 10 12:10:08.863973 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.863936 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fhp57" event={"ID":"3b7326e5-af04-42de-bfcd-b04612763113","Type":"ContainerStarted","Data":"499a0fbe08e098979a1c466ecf328ba83e381d4ac6040474cd5310d4e8c33521"} Sep 10 12:10:08.864115 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.864007 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fhp57" event={"ID":"3b7326e5-af04-42de-bfcd-b04612763113","Type":"ContainerStarted","Data":"c3240559f06f90756cfeac4338efcd5dc95c20e070e0e357f6d8ad103540b863"} Sep 10 12:10:08.864192 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.864148 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fhp57" Sep 10 12:10:08.867083 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.866660 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmnrj" event={"ID":"d0707d93-ef7a-4969-9d05-9ec91e8f7e4b","Type":"ContainerStarted","Data":"3ebbf3efd07d1c0afd8145d7e6222a52fec0d264f3e0c343aa08c4933d27cf32"} Sep 10 12:10:08.868244 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.868217 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-pjhdr" event={"ID":"89b2e6d1-92aa-4496-af1c-ba5357ceb884","Type":"ContainerStarted","Data":"01fdeed6e66868272c5c8b7bc1c66054adde6a6b8bdda7be223c327b1de9089b"} Sep 10 12:10:08.886179 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:08.886126 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fhp57" podStartSLOduration=33.44612511 podStartE2EDuration="35.886114562s" totalImagesPullingTime="2.439989452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:08.884752625 +0000 UTC m=+69.815054542" watchObservedRunningTime="2026-09-10 12:10:08.886114562 +0000 UTC m=+69.816416477" Sep 10 12:10:09.571995 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:09.571958 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:09.633752 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:09.633715 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4419ae7d_bf51_4006_8c9f_dc0f3846de32.slice/crio-545a3e518c0f93b397911dde0b12501a974a1376984bbe1a1d5266a5bb8914a9 WatchSource:0}: Error finding container 545a3e518c0f93b397911dde0b12501a974a1376984bbe1a1d5266a5bb8914a9: Status 404 returned error can't find the container with id 545a3e518c0f93b397911dde0b12501a974a1376984bbe1a1d5266a5bb8914a9 Sep 10 12:10:09.634595 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:09.634570 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7326ab48_db32_4ae6_8f6e_023548063048.slice/crio-3656e1c1cb23c8a67ec7eafb482dbd86ef7d96071cb996bee1c603be1a327dd4 WatchSource:0}: Error finding container 3656e1c1cb23c8a67ec7eafb482dbd86ef7d96071cb996bee1c603be1a327dd4: Status 404 returned error can't find the container with id 3656e1c1cb23c8a67ec7eafb482dbd86ef7d96071cb996bee1c603be1a327dd4 Sep 10 12:10:09.873876 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:09.873792 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-pnxm7" event={"ID":"7326ab48-db32-4ae6-8f6e-023548063048","Type":"ContainerStarted","Data":"3656e1c1cb23c8a67ec7eafb482dbd86ef7d96071cb996bee1c603be1a327dd4"} Sep 10 12:10:09.875324 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:09.875293 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6fxj" event={"ID":"4419ae7d-bf51-4006-8c9f-dc0f3846de32","Type":"ContainerStarted","Data":"545a3e518c0f93b397911dde0b12501a974a1376984bbe1a1d5266a5bb8914a9"} Sep 10 12:10:09.978211 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:09.978174 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:10.494910 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:10.494877 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:11.690354 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.690292 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hmnrj" podStartSLOduration=70.048987967 podStartE2EDuration="1m11.690269633s" totalImagesPullingTime="1.641281666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:08.906946807 +0000 UTC m=+69.837248722" watchObservedRunningTime="2026-09-10 12:10:11.690269633 +0000 UTC m=+72.620571553" Sep 10 12:10:11.691911 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.691772 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84"] Sep 10 12:10:11.694708 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:11.694671 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a07fb0_9069_4bb6_afb4_e0c5d85e71b6.slice/crio-d99adc376977c33847ebb053de644d92b06e3ba3275d87ba677fc7d259b5a529 WatchSource:0}: Error finding container d99adc376977c33847ebb053de644d92b06e3ba3275d87ba677fc7d259b5a529: Status 404 returned error can't find the container with id d99adc376977c33847ebb053de644d92b06e3ba3275d87ba677fc7d259b5a529 Sep 10 12:10:11.772398 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.772350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:10:11.772563 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.772454 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:10:11.773450 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.773394 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de72c6f8-1f0d-4aaa-b0ec-ae75249388e2-service-ca-bundle\") pod \"router-default-686b5bf69d-pmhrm\" (UID: \"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2\") " pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:10:11.775635 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.775591 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e40a68-4dae-467c-818a-aff5f4267b6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-lbvc9\" (UID: \"76e40a68-4dae-467c-818a-aff5f4267b6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:10:11.886846 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.886764 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6fxj" event={"ID":"4419ae7d-bf51-4006-8c9f-dc0f3846de32","Type":"ContainerStarted","Data":"a13db661d62960a4fed113f8305217ac23ec6803e3900ac5398aee8850444390"} Sep 10 12:10:11.889981 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.889949 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wj2kf" event={"ID":"a3436123-bd81-439e-92cf-d0c7ef0d8b74","Type":"ContainerStarted","Data":"876a76db3563aee1d295a1f1988162bc21a767c40f4cd1becb90fe325cfeb4a6"} Sep 10 12:10:11.890283 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.890215 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:10:11.892956 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.892598 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s7gp4" event={"ID":"d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb","Type":"ContainerStarted","Data":"63dfe781f454a630ae8c88b2b6f344277345bd333737fca0beae69fc8eb0cf10"} Sep 10 12:10:11.895340 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.895250 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84" event={"ID":"34a07fb0-9069-4bb6-afb4-e0c5d85e71b6","Type":"ContainerStarted","Data":"d99adc376977c33847ebb053de644d92b06e3ba3275d87ba677fc7d259b5a529"} Sep 10 12:10:11.924754 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.924699 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wj2kf" podStartSLOduration=66.497405634 podStartE2EDuration="1m11.924679967s" totalImagesPullingTime="5.427274333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:11.908567247 +0000 UTC m=+72.838869163" watchObservedRunningTime="2026-09-10 12:10:11.924679967 +0000 UTC m=+72.854981886" Sep 10 12:10:11.995536 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:11.995373 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jfgt2\"" Sep 10 12:10:12.003909 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:12.003697 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" Sep 10 12:10:12.009496 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:12.009472 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sk4cs\"" Sep 10 12:10:12.017528 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:12.017309 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:10:12.313436 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:12.313220 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s7gp4" podStartSLOduration=66.86344716 podStartE2EDuration="1m12.31320072s" totalImagesPullingTime="5.44975356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:11.925806391 +0000 UTC m=+72.856108309" watchObservedRunningTime="2026-09-10 12:10:12.31320072 +0000 UTC m=+73.243502635" Sep 10 12:10:12.313572 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:12.313552 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9"] Sep 10 12:10:12.341324 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:12.341231 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-686b5bf69d-pmhrm"] Sep 10 12:10:12.433015 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:12.432984 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e40a68_4dae_467c_818a_aff5f4267b6b.slice/crio-fdcdc2ac2b5b57e780ee100144c5e14088ed0baa0a9adfba51ff0f5f4f505bf5 WatchSource:0}: Error finding container fdcdc2ac2b5b57e780ee100144c5e14088ed0baa0a9adfba51ff0f5f4f505bf5: Status 404 returned error can't find the container with id fdcdc2ac2b5b57e780ee100144c5e14088ed0baa0a9adfba51ff0f5f4f505bf5 Sep 10 12:10:12.433488 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:12.433452 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde72c6f8_1f0d_4aaa_b0ec_ae75249388e2.slice/crio-71d6285b699d7e1ff7f86be35e05fcc53339077adf78e361031100f03fc8524c WatchSource:0}: Error finding container 71d6285b699d7e1ff7f86be35e05fcc53339077adf78e361031100f03fc8524c: Status 404 returned error can't find the container with id 71d6285b699d7e1ff7f86be35e05fcc53339077adf78e361031100f03fc8524c Sep 10 12:10:12.900312 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:12.900281 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-686b5bf69d-pmhrm" event={"ID":"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2","Type":"ContainerStarted","Data":"71d6285b699d7e1ff7f86be35e05fcc53339077adf78e361031100f03fc8524c"} Sep 10 12:10:12.901639 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:12.901597 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" event={"ID":"76e40a68-4dae-467c-818a-aff5f4267b6b","Type":"ContainerStarted","Data":"fdcdc2ac2b5b57e780ee100144c5e14088ed0baa0a9adfba51ff0f5f4f505bf5"} Sep 10 12:10:13.972325 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:13.972291 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:14.028859 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:14.028792 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:15.901219 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:15.901174 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:15.919426 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:15.919390 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-pnxm7" event={"ID":"7326ab48-db32-4ae6-8f6e-023548063048","Type":"ContainerStarted","Data":"22c200bb9e4fd9d0a9cffe5cc2d205468445267fc85c7b0672bf30952c59de10"} Sep 10 12:10:15.921968 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:15.921943 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-686b5bf69d-pmhrm" event={"ID":"de72c6f8-1f0d-4aaa-b0ec-ae75249388e2","Type":"ContainerStarted","Data":"74cfad3a5241cfa2bb57d3efab526395799abcde6cac2328a962789bd6f2b1f9"} Sep 10 12:10:15.923752 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:15.923723 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" event={"ID":"76e40a68-4dae-467c-818a-aff5f4267b6b","Type":"ContainerStarted","Data":"1bf2e3cfb6e1d006e0d1b59fab8fab3c5c03fad696675c1409ed9431257454ca"} Sep 10 12:10:15.925458 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:15.925428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8" event={"ID":"c497df69-3ad1-48a8-a7ba-efef6e02fee0","Type":"ContainerStarted","Data":"8620c99e96a54ba5e51e103702e7e9957e1319111ec212eff016ceafa4460ec7"} Sep 10 12:10:15.928140 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:15.928101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6fxj" event={"ID":"4419ae7d-bf51-4006-8c9f-dc0f3846de32","Type":"ContainerStarted","Data":"f0971b97d03f27f4e3f9c30e0a57bf5684726f640cb1f8e51264050c0e582af1"} Sep 10 12:10:15.930191 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:15.930169 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84" event={"ID":"34a07fb0-9069-4bb6-afb4-e0c5d85e71b6","Type":"ContainerStarted","Data":"31a6131e6b6e5bb4ce92eb21b00d19ba877e3a36c1b7ceb12f92ffbbba437d24"} Sep 10 12:10:15.930309 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:15.930214 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84" event={"ID":"34a07fb0-9069-4bb6-afb4-e0c5d85e71b6","Type":"ContainerStarted","Data":"641c97a15ceb9be696f638fbaa028f849a127afe708c2ab2d1d178e3cca204e3"} Sep 10 12:10:15.938055 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:15.938006 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-pnxm7" podStartSLOduration=3.727078124 podStartE2EDuration="8.937991243s" totalImagesPullingTime="5.210913119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:15.937424742 +0000 UTC m=+76.867726659" watchObservedRunningTime="2026-09-10 12:10:15.937991243 +0000 UTC m=+76.868293154" Sep 10 12:10:15.964488 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:15.964442 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-686b5bf69d-pmhrm" podStartSLOduration=36.964418185 podStartE2EDuration="36.964418185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:15.964256814 +0000 UTC m=+76.894558735" watchObservedRunningTime="2026-09-10 12:10:15.964418185 +0000 UTC m=+76.894720102" Sep 10 12:10:15.990548 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:15.990499 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-lbvc9" podStartSLOduration=33.939447636 podStartE2EDuration="36.990481122s" totalImagesPullingTime="3.051033486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:15.989594104 +0000 UTC m=+76.919896020" watchObservedRunningTime="2026-09-10 12:10:15.990481122 +0000 UTC m=+76.920783041" Sep 10 12:10:16.010450 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:16.010408 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d798b645d-xwhp8" podStartSLOduration=2.077004324 podStartE2EDuration="9.010394587s" totalImagesPullingTime="6.933390263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:16.010151401 +0000 UTC m=+76.940453320" watchObservedRunningTime="2026-09-10 12:10:16.010394587 +0000 UTC m=+76.940696502" Sep 10 12:10:16.018546 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:16.018522 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:10:16.021095 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:16.021053 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:10:16.037086 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:16.037039 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-m8q84" podStartSLOduration=5.885166727 podStartE2EDuration="9.037026027s" totalImagesPullingTime="3.1518593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:16.036768986 +0000 UTC m=+76.967070904" watchObservedRunningTime="2026-09-10 12:10:16.037026027 +0000 UTC m=+76.967327943" Sep 10 12:10:16.210009 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:16.209931 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:16.266873 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:16.266844 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:16.576902 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:16.576818 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:16.934829 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:16.934741 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:10:16.939868 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:16.939847 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-686b5bf69d-pmhrm" Sep 10 12:10:17.260486 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:17.260438 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:17.328630 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:17.328573 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:17.940526 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:17.940485 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6fxj" event={"ID":"4419ae7d-bf51-4006-8c9f-dc0f3846de32","Type":"ContainerStarted","Data":"7db30fea9a59fd9b0ca3f681161be60f4251c8d6650ebc44f77674cdef658a44"} Sep 10 12:10:17.965445 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:17.965402 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l6fxj" podStartSLOduration=5.929318991 podStartE2EDuration="10.965386878s" totalImagesPullingTime="5.036067887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:10:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:17.964174202 +0000 UTC m=+78.894476117" watchObservedRunningTime="2026-09-10 12:10:17.965386878 +0000 UTC m=+78.895688793" Sep 10 12:10:18.034751 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:18.034687 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:18.134368 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:18.134327 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:18.201487 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:18.201396 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:18.275950 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:18.275920 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:18.877550 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:18.877516 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fhp57" Sep 10 12:10:21.104640 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:21.104507 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:21.230812 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:21.230785 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:21.319696 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:21.319659 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:21.473908 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:21.473834 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:22.109796 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:22.109757 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:22.208744 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:22.208700 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:22.535647 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:22.535613 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:22.618729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:22.618693 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:24.995828 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:24.995783 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:27.523589 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.523552 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:27.641713 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.641671 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:27.741548 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.741490 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:27.819339 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.817819 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9xlc6"] Sep 10 12:10:27.832904 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.832871 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:27.846794 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.846406 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:27.850478 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.849984 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2ksmx\"" Sep 10 12:10:27.851783 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.851208 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 12:10:27.851783 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.851378 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 12:10:27.851783 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.851538 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 12:10:27.851783 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.851673 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 12:10:27.907616 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.907571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-tls\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:27.907766 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.907652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:27.907766 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.907680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jvr9\" (UniqueName: \"kubernetes.io/projected/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-kube-api-access-6jvr9\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:27.907766 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.907720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-metrics-client-ca\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:27.907766 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.907758 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-wtmp\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:27.907952 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.907775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-root\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:27.907952 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.907807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-textfile\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:27.907952 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.907831 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:27.907952 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.907857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-sys\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:27.935494 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:27.935463 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:28.010098 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.010005 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-textfile\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.010098 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.010047 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.010098 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.010074 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-sys\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.010392 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.010121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-tls\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.010392 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.010160 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.010392 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.010189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jvr9\" (UniqueName: \"kubernetes.io/projected/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-kube-api-access-6jvr9\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.010392 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.010226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-metrics-client-ca\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.010392 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.010262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-wtmp\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.010392 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.010285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-root\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.010392 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.010365 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-root\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.010738 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.010703 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-textfile\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.011198 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.011176 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.011295 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.011237 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-sys\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.011365 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:10:28.011318 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 12:10:28.011421 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:10:28.011372 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-tls podName:dbf31ccc-779a-4dd1-992a-3ed4aaf708e5 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:28.511353389 +0000 UTC m=+89.441655298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-tls") pod "node-exporter-9xlc6" (UID: "dbf31ccc-779a-4dd1-992a-3ed4aaf708e5") : secret "node-exporter-tls" not found Sep 10 12:10:28.012054 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.012035 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-wtmp\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.012383 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.012353 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-metrics-client-ca\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.019141 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.019091 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.022058 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.022017 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jvr9\" (UniqueName: \"kubernetes.io/projected/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-kube-api-access-6jvr9\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.036884 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.036821 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:28.128830 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.128710 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:28.234725 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.234666 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:28.343211 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.343163 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:28.430205 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.430114 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:28.514133 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.514098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-tls\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.516851 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.516826 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbf31ccc-779a-4dd1-992a-3ed4aaf708e5-node-exporter-tls\") pod \"node-exporter-9xlc6\" (UID: \"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5\") " pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.658125 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.658085 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:28.734241 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.734203 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:28.761204 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.761177 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9xlc6" Sep 10 12:10:28.791260 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:10:28.791232 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf31ccc_779a_4dd1_992a_3ed4aaf708e5.slice/crio-68cc77c03d012c50dc1d5ed3a7eb94c8c64f0db363c8df182f7da4fcc5210df9 WatchSource:0}: Error finding container 68cc77c03d012c50dc1d5ed3a7eb94c8c64f0db363c8df182f7da4fcc5210df9: Status 404 returned error can't find the container with id 68cc77c03d012c50dc1d5ed3a7eb94c8c64f0db363c8df182f7da4fcc5210df9 Sep 10 12:10:28.868569 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.868538 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:28.873117 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.873087 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:10:28.964981 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.964946 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:28.994317 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:28.994252 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9xlc6" event={"ID":"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5","Type":"ContainerStarted","Data":"68cc77c03d012c50dc1d5ed3a7eb94c8c64f0db363c8df182f7da4fcc5210df9"} Sep 10 12:10:29.827414 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:29.827372 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:30.002592 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:30.002556 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-pjhdr" event={"ID":"89b2e6d1-92aa-4496-af1c-ba5357ceb884","Type":"ContainerStarted","Data":"9ccc5cf84bfb121c4c0096eb035694c22a1becb191993217ca8d3735a10dc19b"} Sep 10 12:10:30.004722 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:30.004681 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-pjhdr" Sep 10 12:10:30.012294 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:30.012265 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c9c5d996-4lf9h"] Sep 10 12:10:30.015093 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:30.015053 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-pjhdr" Sep 10 12:10:30.043011 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:30.042959 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-pjhdr" podStartSLOduration=2.489580663 podStartE2EDuration="23.042940698s" totalImagesPullingTime="20.553360035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:30.041098652 +0000 UTC m=+90.971400569" watchObservedRunningTime="2026-09-10 12:10:30.042940698 +0000 UTC m=+90.973242615" Sep 10 12:10:30.187600 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:30.187563 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:30.309517 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:30.309481 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:30.696857 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:30.696825 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:30.798321 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:30.798264 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:31.009427 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:31.009388 2563 generic.go:356] "Generic (PLEG): container finished" podID="dbf31ccc-779a-4dd1-992a-3ed4aaf708e5" containerID="8ca1d169ceb2978a401f0809c28fa0671c5b95657e93d724f1c8c2f3d5c39e13" exitCode=0 Sep 10 12:10:31.009946 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:31.009500 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9xlc6" event={"ID":"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5","Type":"ContainerDied","Data":"8ca1d169ceb2978a401f0809c28fa0671c5b95657e93d724f1c8c2f3d5c39e13"} Sep 10 12:10:31.058830 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:31.058800 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:31.146856 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:31.146827 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:31.247632 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:31.245742 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:31.347334 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:31.347293 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:31.447557 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:31.447518 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:32.016949 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:32.016897 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9xlc6" event={"ID":"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5","Type":"ContainerStarted","Data":"4bf2c912d0d761b0bc29637f5bd53263c5f3a5dee95a3e9f7e38b10c1b6ce5ef"} Sep 10 12:10:32.017424 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:32.016975 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9xlc6" event={"ID":"dbf31ccc-779a-4dd1-992a-3ed4aaf708e5","Type":"ContainerStarted","Data":"410a77275e8d18b52621e049e84dd8ee9a12c6023ca0100d162fd57fc955d1bc"} Sep 10 12:10:32.047130 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:32.047080 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9xlc6" podStartSLOduration=3.6638890870000003 podStartE2EDuration="5.047063985s" totalImagesPullingTime="1.293535145s" totalInitContainerRuntime="89.639753ms" isStatefulPod=true podCreationTimestamp="2026-09-10 12:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:32.046190988 +0000 UTC m=+92.976492904" watchObservedRunningTime="2026-09-10 12:10:32.047063985 +0000 UTC m=+92.977365900" Sep 10 12:10:32.439921 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:32.439842 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:32.540996 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:32.540960 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:32.641315 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:32.641258 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:33.210538 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:33.210495 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:34.032200 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:34.032164 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:37.716871 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:37.716831 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:37.817580 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:37.817531 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:38.531354 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:38.531321 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:38.586500 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:38.586471 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:42.903965 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:42.903937 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wj2kf" Sep 10 12:10:45.596784 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:45.596745 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:46.125997 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:46.125963 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:46.177350 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:46.177320 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:48.230316 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:48.230284 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:48.295718 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:48.295693 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:51.819712 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:51.819668 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:51.915379 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:51.915350 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:55.037953 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.037905 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" podUID="aaf36803-32cb-4779-b066-bdb5d0d0a3f6" containerName="registry" containerID="cri-o://a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f" gracePeriod=30 Sep 10 12:10:55.319337 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.319282 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:10:55.319449 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.319438 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-trusted-ca\") pod \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " Sep 10 12:10:55.319487 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.319471 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-installation-pull-secrets\") pod \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " Sep 10 12:10:55.319523 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.319498 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-bound-sa-token\") pod \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " Sep 10 12:10:55.319555 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.319529 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv26l\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-kube-api-access-jv26l\") pod \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " Sep 10 12:10:55.319555 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.319543 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls\") pod \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " Sep 10 12:10:55.319732 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.319567 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-ca-trust-extracted\") pod \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " Sep 10 12:10:55.319732 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.319628 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-certificates\") pod \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " Sep 10 12:10:55.319732 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.319655 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-image-registry-private-configuration\") pod \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\" (UID: \"aaf36803-32cb-4779-b066-bdb5d0d0a3f6\") " Sep 10 12:10:55.320312 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.320004 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "aaf36803-32cb-4779-b066-bdb5d0d0a3f6" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:10:55.320312 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.320272 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "aaf36803-32cb-4779-b066-bdb5d0d0a3f6" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:10:55.322457 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.322396 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-kube-api-access-jv26l" (OuterVolumeSpecName: "kube-api-access-jv26l") pod "aaf36803-32cb-4779-b066-bdb5d0d0a3f6" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6"). InnerVolumeSpecName "kube-api-access-jv26l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:10:55.322562 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.322510 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "aaf36803-32cb-4779-b066-bdb5d0d0a3f6" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:10:55.322562 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.322530 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "aaf36803-32cb-4779-b066-bdb5d0d0a3f6" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:10:55.322705 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.322657 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "aaf36803-32cb-4779-b066-bdb5d0d0a3f6" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:10:55.322765 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.322702 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aaf36803-32cb-4779-b066-bdb5d0d0a3f6" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:10:55.331047 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.331017 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "aaf36803-32cb-4779-b066-bdb5d0d0a3f6" (UID: "aaf36803-32cb-4779-b066-bdb5d0d0a3f6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:10:55.420652 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.420623 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-ca-trust-extracted\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:10:55.420652 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.420647 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-certificates\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:10:55.420652 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.420658 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-image-registry-private-configuration\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:10:55.420840 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.420669 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-trusted-ca\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:10:55.420840 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.420677 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-installation-pull-secrets\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:10:55.420840 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.420685 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-bound-sa-token\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:10:55.420840 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.420693 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv26l\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-kube-api-access-jv26l\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:10:55.420840 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:55.420701 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaf36803-32cb-4779-b066-bdb5d0d0a3f6-registry-tls\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:10:56.103658 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:56.103624 2563 generic.go:356] "Generic (PLEG): container finished" podID="aaf36803-32cb-4779-b066-bdb5d0d0a3f6" containerID="a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f" exitCode=0 Sep 10 12:10:56.104051 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:56.103664 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" Sep 10 12:10:56.104051 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:56.103719 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" event={"ID":"aaf36803-32cb-4779-b066-bdb5d0d0a3f6","Type":"ContainerDied","Data":"a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f"} Sep 10 12:10:56.104051 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:56.103772 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9c5d996-4lf9h" event={"ID":"aaf36803-32cb-4779-b066-bdb5d0d0a3f6","Type":"ContainerDied","Data":"64281432ca4c60716c98d4d16c1becaa991b5dfa52a2fa65ff020f72e970cac3"} Sep 10 12:10:56.104051 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:56.103795 2563 scope.go:117] "RemoveContainer" containerID="a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f" Sep 10 12:10:56.122002 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:56.121985 2563 scope.go:117] "RemoveContainer" containerID="a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f" Sep 10 12:10:56.122299 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:10:56.122273 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f\": container with ID starting with a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f not found: ID does not exist" containerID="a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f" Sep 10 12:10:56.122352 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:56.122308 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f"} err="failed to get container status \"a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f\": rpc error: code = NotFound desc = could not find container \"a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f\": container with ID starting with a56a983a0f44a829bb194bb067c5e0aea6527cb579ed7ddb8889a6ec3d3d709f not found: ID does not exist" Sep 10 12:10:56.122394 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:56.122355 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c9c5d996-4lf9h"] Sep 10 12:10:56.127989 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:56.127962 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c9c5d996-4lf9h"] Sep 10 12:10:56.240496 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:56.240466 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:56.340905 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:56.340877 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:56.389596 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:56.389538 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:10:57.580149 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:10:57.580119 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaf36803-32cb-4779-b066-bdb5d0d0a3f6" path="/var/lib/kubelet/pods/aaf36803-32cb-4779-b066-bdb5d0d0a3f6/volumes" Sep 10 12:11:00.121693 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:00.121661 2563 generic.go:356] "Generic (PLEG): container finished" podID="d696086e-b822-4f80-8c5b-64c6166408b2" containerID="8a887ae6eea62cdeebe1f2af1d02660f630dec60eebc78c0a4cadc82b295254a" exitCode=0 Sep 10 12:11:00.122186 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:00.121733 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" event={"ID":"d696086e-b822-4f80-8c5b-64c6166408b2","Type":"ContainerDied","Data":"8a887ae6eea62cdeebe1f2af1d02660f630dec60eebc78c0a4cadc82b295254a"} Sep 10 12:11:00.122186 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:00.122110 2563 scope.go:117] "RemoveContainer" containerID="8a887ae6eea62cdeebe1f2af1d02660f630dec60eebc78c0a4cadc82b295254a" Sep 10 12:11:01.127396 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:01.127362 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nvjtt" event={"ID":"d696086e-b822-4f80-8c5b-64c6166408b2","Type":"ContainerStarted","Data":"2611053808a3808744a363a38a891602ce93db9bda63db7868cfdb6612399641"} Sep 10 12:11:03.238008 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:03.237974 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:03.294642 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:03.294573 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:27.381278 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:27.381242 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:27.439201 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:27.439176 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:43.845074 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:43.845039 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:43.940030 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:43.939984 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:50.201625 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:50.201571 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:50.275831 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:50.275803 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:55.892048 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:55.891954 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:11:55.941882 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:11:55.941850 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:01.137836 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:12:01.137796 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:01.197983 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:12:01.197956 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:01.253339 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:12:01.253310 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:03.262760 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:12:03.262722 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:03.360521 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:12:03.360486 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:59.427904 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:12:59.427869 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:12:59.521843 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:12:59.521813 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:00.100946 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.100911 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p"] Sep 10 12:13:00.101163 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.101152 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf36803-32cb-4779-b066-bdb5d0d0a3f6" containerName="registry" Sep 10 12:13:00.101208 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.101165 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf36803-32cb-4779-b066-bdb5d0d0a3f6" containerName="registry" Sep 10 12:13:00.101245 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.101214 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf36803-32cb-4779-b066-bdb5d0d0a3f6" containerName="registry" Sep 10 12:13:00.103042 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.103027 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:00.105864 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.105842 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:13:00.105864 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.105843 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jdqn8\"" Sep 10 12:13:00.107142 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.107119 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:13:00.113331 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.113312 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p"] Sep 10 12:13:00.170915 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.170890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p\" (UID: \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:00.171033 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.170928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrlgn\" (UniqueName: \"kubernetes.io/projected/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-kube-api-access-xrlgn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p\" (UID: \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:00.171033 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.170957 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p\" (UID: \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:00.271752 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.271725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p\" (UID: \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:00.271876 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.271767 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p\" (UID: \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:00.271932 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.271894 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrlgn\" (UniqueName: \"kubernetes.io/projected/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-kube-api-access-xrlgn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p\" (UID: \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:00.272065 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.272047 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p\" (UID: \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:00.272127 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.272108 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p\" (UID: \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:00.280705 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.280678 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrlgn\" (UniqueName: \"kubernetes.io/projected/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-kube-api-access-xrlgn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p\" (UID: \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:00.411808 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.411744 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:00.679104 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:00.678915 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p"] Sep 10 12:13:00.681003 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:13:00.680979 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dbbfbdd_50cb_4834_8fa9_d7ed12dd811c.slice/crio-4e17e3fdbac941dcfafc82ec6f07f5abc06bc3b6db03b7b8d3818f61eee5debc WatchSource:0}: Error finding container 4e17e3fdbac941dcfafc82ec6f07f5abc06bc3b6db03b7b8d3818f61eee5debc: Status 404 returned error can't find the container with id 4e17e3fdbac941dcfafc82ec6f07f5abc06bc3b6db03b7b8d3818f61eee5debc Sep 10 12:13:01.541681 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:01.541641 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" event={"ID":"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c","Type":"ContainerStarted","Data":"4e17e3fdbac941dcfafc82ec6f07f5abc06bc3b6db03b7b8d3818f61eee5debc"} Sep 10 12:13:07.566309 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:07.566275 2563 generic.go:356] "Generic (PLEG): container finished" podID="8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" containerID="0ac17c72d34964f7c6cfae2c42e532ab01262f131e38fb24d33e57c6d9421f81" exitCode=0 Sep 10 12:13:07.566827 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:07.566343 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" event={"ID":"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c","Type":"ContainerDied","Data":"0ac17c72d34964f7c6cfae2c42e532ab01262f131e38fb24d33e57c6d9421f81"} Sep 10 12:13:09.581928 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:09.581896 2563 generic.go:356] "Generic (PLEG): container finished" podID="8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" containerID="e04bb8a8db7dd26f1de600e9c7454f3ddfb19c86966462a29260a8ce96c3022c" exitCode=0 Sep 10 12:13:09.582816 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:09.582705 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" event={"ID":"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c","Type":"ContainerDied","Data":"e04bb8a8db7dd26f1de600e9c7454f3ddfb19c86966462a29260a8ce96c3022c"} Sep 10 12:13:17.615253 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:17.615215 2563 generic.go:356] "Generic (PLEG): container finished" podID="8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" containerID="abe28eefde86a372793931e1e54659dceec34413af68021a8956d4095b01ac6b" exitCode=0 Sep 10 12:13:17.615654 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:17.615279 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" event={"ID":"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c","Type":"ContainerDied","Data":"abe28eefde86a372793931e1e54659dceec34413af68021a8956d4095b01ac6b"} Sep 10 12:13:18.738568 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:18.738545 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:18.805202 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:18.805169 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-bundle\") pod \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\" (UID: \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\") " Sep 10 12:13:18.805357 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:18.805230 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-util\") pod \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\" (UID: \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\") " Sep 10 12:13:18.805357 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:18.805297 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrlgn\" (UniqueName: \"kubernetes.io/projected/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-kube-api-access-xrlgn\") pod \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\" (UID: \"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c\") " Sep 10 12:13:18.806042 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:18.806016 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-bundle" (OuterVolumeSpecName: "bundle") pod "8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" (UID: "8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:13:18.807546 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:18.807510 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-kube-api-access-xrlgn" (OuterVolumeSpecName: "kube-api-access-xrlgn") pod "8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" (UID: "8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c"). InnerVolumeSpecName "kube-api-access-xrlgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:13:18.809384 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:18.809365 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-util" (OuterVolumeSpecName: "util") pod "8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" (UID: "8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:13:18.906632 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:18.906533 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrlgn\" (UniqueName: \"kubernetes.io/projected/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-kube-api-access-xrlgn\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:13:18.906632 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:18.906557 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-bundle\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:13:18.906632 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:18.906567 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c-util\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:13:19.623861 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:19.623831 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" event={"ID":"8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c","Type":"ContainerDied","Data":"4e17e3fdbac941dcfafc82ec6f07f5abc06bc3b6db03b7b8d3818f61eee5debc"} Sep 10 12:13:19.624014 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:19.623878 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e17e3fdbac941dcfafc82ec6f07f5abc06bc3b6db03b7b8d3818f61eee5debc" Sep 10 12:13:19.624014 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:19.623842 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xtg2p" Sep 10 12:13:21.077970 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:21.077893 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:21.861012 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:21.860957 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:22.990272 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:22.990233 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h"] Sep 10 12:13:22.990668 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:22.990514 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" containerName="extract" Sep 10 12:13:22.990668 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:22.990525 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" containerName="extract" Sep 10 12:13:22.990668 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:22.990537 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" containerName="util" Sep 10 12:13:22.990668 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:22.990542 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" containerName="util" Sep 10 12:13:22.990668 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:22.990551 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" containerName="pull" Sep 10 12:13:22.990668 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:22.990559 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" containerName="pull" Sep 10 12:13:22.990668 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:22.990620 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dbbfbdd-50cb-4834-8fa9-d7ed12dd811c" containerName="extract" Sep 10 12:13:22.992305 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:22.992290 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h" Sep 10 12:13:22.994912 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:22.994889 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dhp9c\"" Sep 10 12:13:22.995081 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:22.995063 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:13:22.995510 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:22.995497 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 12:13:23.003727 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:23.003706 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h"] Sep 10 12:13:23.036337 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:23.036307 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jhl7\" (UniqueName: \"kubernetes.io/projected/22627b20-edb3-40d6-8d73-7f5f799c196f-kube-api-access-6jhl7\") pod \"cert-manager-operator-controller-manager-55c444bf86-cqw2h\" (UID: \"22627b20-edb3-40d6-8d73-7f5f799c196f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h" Sep 10 12:13:23.036458 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:23.036357 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22627b20-edb3-40d6-8d73-7f5f799c196f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cqw2h\" (UID: \"22627b20-edb3-40d6-8d73-7f5f799c196f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h" Sep 10 12:13:23.137221 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:23.137190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jhl7\" (UniqueName: \"kubernetes.io/projected/22627b20-edb3-40d6-8d73-7f5f799c196f-kube-api-access-6jhl7\") pod \"cert-manager-operator-controller-manager-55c444bf86-cqw2h\" (UID: \"22627b20-edb3-40d6-8d73-7f5f799c196f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h" Sep 10 12:13:23.137323 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:23.137239 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22627b20-edb3-40d6-8d73-7f5f799c196f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cqw2h\" (UID: \"22627b20-edb3-40d6-8d73-7f5f799c196f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h" Sep 10 12:13:23.137571 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:23.137557 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22627b20-edb3-40d6-8d73-7f5f799c196f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cqw2h\" (UID: \"22627b20-edb3-40d6-8d73-7f5f799c196f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h" Sep 10 12:13:23.146157 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:23.146129 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jhl7\" (UniqueName: \"kubernetes.io/projected/22627b20-edb3-40d6-8d73-7f5f799c196f-kube-api-access-6jhl7\") pod \"cert-manager-operator-controller-manager-55c444bf86-cqw2h\" (UID: \"22627b20-edb3-40d6-8d73-7f5f799c196f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h" Sep 10 12:13:23.301530 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:23.301427 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h" Sep 10 12:13:23.573954 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:23.573926 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h"] Sep 10 12:13:23.575113 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:13:23.575086 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22627b20_edb3_40d6_8d73_7f5f799c196f.slice/crio-d89f9810d9eda5841ca7ddc101bf974b5a74756ae99613cf7f526d32e05ff966 WatchSource:0}: Error finding container d89f9810d9eda5841ca7ddc101bf974b5a74756ae99613cf7f526d32e05ff966: Status 404 returned error can't find the container with id d89f9810d9eda5841ca7ddc101bf974b5a74756ae99613cf7f526d32e05ff966 Sep 10 12:13:23.640134 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:23.640107 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h" event={"ID":"22627b20-edb3-40d6-8d73-7f5f799c196f","Type":"ContainerStarted","Data":"d89f9810d9eda5841ca7ddc101bf974b5a74756ae99613cf7f526d32e05ff966"} Sep 10 12:13:24.724846 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:24.724798 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:24.825351 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:24.825320 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:25.649812 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:25.649726 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h" event={"ID":"22627b20-edb3-40d6-8d73-7f5f799c196f","Type":"ContainerStarted","Data":"949b696cc3fd94c3e3feb6284552aca66cf5e39e295fc5a63fe4ae5855e482ce"} Sep 10 12:13:25.677016 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:25.676960 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cqw2h" podStartSLOduration=2.012763774 podStartE2EDuration="3.676944404s" totalImagesPullingTime="1.66418063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:13:25.67690655 +0000 UTC m=+266.607208468" watchObservedRunningTime="2026-09-10 12:13:25.676944404 +0000 UTC m=+266.607246314" Sep 10 12:13:26.105763 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.105722 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:26.214418 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.214385 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:26.310980 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.310943 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vs22f"] Sep 10 12:13:26.312930 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.312916 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" Sep 10 12:13:26.316003 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.315986 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-x4jws\"" Sep 10 12:13:26.316104 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.315993 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 12:13:26.317419 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.317401 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 12:13:26.325549 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.325525 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vs22f"] Sep 10 12:13:26.363863 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.363800 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vs22f\" (UID: \"8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" Sep 10 12:13:26.363975 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.363864 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrj76\" (UniqueName: \"kubernetes.io/projected/8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46-kube-api-access-rrj76\") pod \"cert-manager-webhook-6486ffd997-vs22f\" (UID: \"8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" Sep 10 12:13:26.464425 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.464386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrj76\" (UniqueName: \"kubernetes.io/projected/8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46-kube-api-access-rrj76\") pod \"cert-manager-webhook-6486ffd997-vs22f\" (UID: \"8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" Sep 10 12:13:26.464581 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.464438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vs22f\" (UID: \"8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" Sep 10 12:13:26.473312 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.473288 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vs22f\" (UID: \"8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" Sep 10 12:13:26.473558 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.473537 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrj76\" (UniqueName: \"kubernetes.io/projected/8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46-kube-api-access-rrj76\") pod \"cert-manager-webhook-6486ffd997-vs22f\" (UID: \"8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" Sep 10 12:13:26.622035 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.621955 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" Sep 10 12:13:26.898193 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:26.898112 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vs22f"] Sep 10 12:13:26.901133 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:13:26.901104 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a67dcb7_3d09_4cd3_8ba4_2d2f6213aa46.slice/crio-b6c1497f0d73f9be198bb6230307cbd57e5a3a8d2317c23c89bfd50b51fed7c7 WatchSource:0}: Error finding container b6c1497f0d73f9be198bb6230307cbd57e5a3a8d2317c23c89bfd50b51fed7c7: Status 404 returned error can't find the container with id b6c1497f0d73f9be198bb6230307cbd57e5a3a8d2317c23c89bfd50b51fed7c7 Sep 10 12:13:27.658127 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:27.658091 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" event={"ID":"8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46","Type":"ContainerStarted","Data":"b6c1497f0d73f9be198bb6230307cbd57e5a3a8d2317c23c89bfd50b51fed7c7"} Sep 10 12:13:28.466920 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:28.466885 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:28.890078 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:28.890038 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:29.668159 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:29.668127 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" event={"ID":"8a67dcb7-3d09-4cd3-8ba4-2d2f6213aa46","Type":"ContainerStarted","Data":"c3befcc04d734687a4280816dee68f95871e68799de55ddcf2d1cffb6a2607c9"} Sep 10 12:13:29.668258 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:29.668186 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" Sep 10 12:13:29.686444 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:29.686375 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" podStartSLOduration=0.980403282 podStartE2EDuration="3.686359622s" totalImagesPullingTime="2.70595634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:13:29.685217056 +0000 UTC m=+270.615518971" watchObservedRunningTime="2026-09-10 12:13:29.686359622 +0000 UTC m=+270.616661539" Sep 10 12:13:31.483338 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:31.483301 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:31.547964 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:31.547937 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:33.860790 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:33.860756 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:33.922535 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:33.922505 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:35.674528 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:35.674503 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vs22f" Sep 10 12:13:35.678506 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:35.678485 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:37.530962 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:37.530927 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sbxfl"] Sep 10 12:13:37.533097 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:37.533081 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-sbxfl" Sep 10 12:13:37.535540 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:37.535517 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xndmw\"" Sep 10 12:13:37.543571 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:37.543551 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sbxfl"] Sep 10 12:13:37.645710 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:37.645683 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqz2l\" (UniqueName: \"kubernetes.io/projected/042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd-kube-api-access-wqz2l\") pod \"cert-manager-55b4d954d5-sbxfl\" (UID: \"042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd\") " pod="cert-manager/cert-manager-55b4d954d5-sbxfl" Sep 10 12:13:37.645853 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:37.645740 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd-bound-sa-token\") pod \"cert-manager-55b4d954d5-sbxfl\" (UID: \"042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd\") " pod="cert-manager/cert-manager-55b4d954d5-sbxfl" Sep 10 12:13:37.746135 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:37.746100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd-bound-sa-token\") pod \"cert-manager-55b4d954d5-sbxfl\" (UID: \"042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd\") " pod="cert-manager/cert-manager-55b4d954d5-sbxfl" Sep 10 12:13:37.746272 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:37.746142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqz2l\" (UniqueName: \"kubernetes.io/projected/042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd-kube-api-access-wqz2l\") pod \"cert-manager-55b4d954d5-sbxfl\" (UID: \"042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd\") " pod="cert-manager/cert-manager-55b4d954d5-sbxfl" Sep 10 12:13:37.755202 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:37.755175 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd-bound-sa-token\") pod \"cert-manager-55b4d954d5-sbxfl\" (UID: \"042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd\") " pod="cert-manager/cert-manager-55b4d954d5-sbxfl" Sep 10 12:13:37.755293 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:37.755248 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqz2l\" (UniqueName: \"kubernetes.io/projected/042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd-kube-api-access-wqz2l\") pod \"cert-manager-55b4d954d5-sbxfl\" (UID: \"042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd\") " pod="cert-manager/cert-manager-55b4d954d5-sbxfl" Sep 10 12:13:37.841833 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:37.841771 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-sbxfl" Sep 10 12:13:38.108333 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:38.108268 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sbxfl"] Sep 10 12:13:38.110440 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:13:38.110412 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod042c07c2_8fe6_4e0b_9ec2_dd116a0ad0bd.slice/crio-7350148f03e8e5e443359d5bac5ccd7a5949e4cfd88d202555e29bf53ba5c599 WatchSource:0}: Error finding container 7350148f03e8e5e443359d5bac5ccd7a5949e4cfd88d202555e29bf53ba5c599: Status 404 returned error can't find the container with id 7350148f03e8e5e443359d5bac5ccd7a5949e4cfd88d202555e29bf53ba5c599 Sep 10 12:13:38.705537 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:38.705505 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-sbxfl" event={"ID":"042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd","Type":"ContainerStarted","Data":"eff0dae2a3a4e75667521d5f2fa28ff73d1bd517984170b61b1c83a9ca041ae0"} Sep 10 12:13:38.705932 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:38.705553 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-sbxfl" event={"ID":"042c07c2-8fe6-4e0b-9ec2-dd116a0ad0bd","Type":"ContainerStarted","Data":"7350148f03e8e5e443359d5bac5ccd7a5949e4cfd88d202555e29bf53ba5c599"} Sep 10 12:13:38.727819 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:38.727774 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-sbxfl" podStartSLOduration=1.7277571950000001 podStartE2EDuration="1.727757195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:13:38.726391396 +0000 UTC m=+279.656693312" watchObservedRunningTime="2026-09-10 12:13:38.727757195 +0000 UTC m=+279.658059111" Sep 10 12:13:49.056424 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:49.056389 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:49.156253 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:49.156227 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:55.119993 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:55.119947 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:55.223134 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:55.223103 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:56.770422 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.770391 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql"] Sep 10 12:13:56.772668 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.772653 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:13:56.775328 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.775298 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:13:56.775444 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.775372 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:13:56.776822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.776789 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jdqn8\"" Sep 10 12:13:56.781476 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.781456 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql"] Sep 10 12:13:56.885800 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.885768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a8aaae6-56a7-4746-91eb-81aab161dcd7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql\" (UID: \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:13:56.885943 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.885821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a8aaae6-56a7-4746-91eb-81aab161dcd7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql\" (UID: \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:13:56.885943 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.885861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwb46\" (UniqueName: \"kubernetes.io/projected/9a8aaae6-56a7-4746-91eb-81aab161dcd7-kube-api-access-xwb46\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql\" (UID: \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:13:56.986641 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.986596 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a8aaae6-56a7-4746-91eb-81aab161dcd7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql\" (UID: \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:13:56.986785 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.986655 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a8aaae6-56a7-4746-91eb-81aab161dcd7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql\" (UID: \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:13:56.986785 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.986694 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwb46\" (UniqueName: \"kubernetes.io/projected/9a8aaae6-56a7-4746-91eb-81aab161dcd7-kube-api-access-xwb46\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql\" (UID: \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:13:56.987006 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.986987 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a8aaae6-56a7-4746-91eb-81aab161dcd7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql\" (UID: \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:13:56.987046 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.986997 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a8aaae6-56a7-4746-91eb-81aab161dcd7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql\" (UID: \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:13:56.995036 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:56.995006 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwb46\" (UniqueName: \"kubernetes.io/projected/9a8aaae6-56a7-4746-91eb-81aab161dcd7-kube-api-access-xwb46\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql\" (UID: \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:13:57.082233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:57.082142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:13:57.351473 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:57.351389 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql"] Sep 10 12:13:57.354893 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:13:57.354869 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8aaae6_56a7_4746_91eb_81aab161dcd7.slice/crio-21cbb27b4c18a0f7f266fc68d99b679c79d6031ad38accd77580c29bbe54d156 WatchSource:0}: Error finding container 21cbb27b4c18a0f7f266fc68d99b679c79d6031ad38accd77580c29bbe54d156: Status 404 returned error can't find the container with id 21cbb27b4c18a0f7f266fc68d99b679c79d6031ad38accd77580c29bbe54d156 Sep 10 12:13:57.455987 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:57.455958 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:13:57.782449 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:57.782414 2563 generic.go:356] "Generic (PLEG): container finished" podID="9a8aaae6-56a7-4746-91eb-81aab161dcd7" containerID="82b6669f8a89f76f8d93d959b72f435087cfad44227e6c2ae0b594d8f9a808b4" exitCode=0 Sep 10 12:13:57.782861 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:57.782470 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" event={"ID":"9a8aaae6-56a7-4746-91eb-81aab161dcd7","Type":"ContainerDied","Data":"82b6669f8a89f76f8d93d959b72f435087cfad44227e6c2ae0b594d8f9a808b4"} Sep 10 12:13:57.782861 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:57.782504 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" event={"ID":"9a8aaae6-56a7-4746-91eb-81aab161dcd7","Type":"ContainerStarted","Data":"21cbb27b4c18a0f7f266fc68d99b679c79d6031ad38accd77580c29bbe54d156"} Sep 10 12:13:58.788842 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:58.788810 2563 generic.go:356] "Generic (PLEG): container finished" podID="9a8aaae6-56a7-4746-91eb-81aab161dcd7" containerID="6a89f35ee10b42ed15f9d21db4fbc404def27fa57b8158a3e3df188b7240c945" exitCode=0 Sep 10 12:13:58.788842 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:58.788846 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" event={"ID":"9a8aaae6-56a7-4746-91eb-81aab161dcd7","Type":"ContainerDied","Data":"6a89f35ee10b42ed15f9d21db4fbc404def27fa57b8158a3e3df188b7240c945"} Sep 10 12:13:59.492425 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:59.492398 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-acl-logging/0.log" Sep 10 12:13:59.496368 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:59.496348 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-acl-logging/0.log" Sep 10 12:13:59.498585 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:59.498552 2563 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 12:13:59.794992 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:59.794914 2563 generic.go:356] "Generic (PLEG): container finished" podID="9a8aaae6-56a7-4746-91eb-81aab161dcd7" containerID="80d7fe5a8f694063df8c33d5b04e76b80f8acfe6e42b88ef14b426e08ff6ad4e" exitCode=0 Sep 10 12:13:59.794992 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:13:59.794968 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" event={"ID":"9a8aaae6-56a7-4746-91eb-81aab161dcd7","Type":"ContainerDied","Data":"80d7fe5a8f694063df8c33d5b04e76b80f8acfe6e42b88ef14b426e08ff6ad4e"} Sep 10 12:14:00.925467 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:00.925445 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:14:01.013639 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.013593 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwb46\" (UniqueName: \"kubernetes.io/projected/9a8aaae6-56a7-4746-91eb-81aab161dcd7-kube-api-access-xwb46\") pod \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\" (UID: \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\") " Sep 10 12:14:01.013788 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.013644 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a8aaae6-56a7-4746-91eb-81aab161dcd7-util\") pod \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\" (UID: \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\") " Sep 10 12:14:01.013788 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.013672 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a8aaae6-56a7-4746-91eb-81aab161dcd7-bundle\") pod \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\" (UID: \"9a8aaae6-56a7-4746-91eb-81aab161dcd7\") " Sep 10 12:14:01.014375 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.014354 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a8aaae6-56a7-4746-91eb-81aab161dcd7-bundle" (OuterVolumeSpecName: "bundle") pod "9a8aaae6-56a7-4746-91eb-81aab161dcd7" (UID: "9a8aaae6-56a7-4746-91eb-81aab161dcd7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:14:01.015930 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.015902 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a8aaae6-56a7-4746-91eb-81aab161dcd7-kube-api-access-xwb46" (OuterVolumeSpecName: "kube-api-access-xwb46") pod "9a8aaae6-56a7-4746-91eb-81aab161dcd7" (UID: "9a8aaae6-56a7-4746-91eb-81aab161dcd7"). InnerVolumeSpecName "kube-api-access-xwb46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:14:01.019751 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.019718 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a8aaae6-56a7-4746-91eb-81aab161dcd7-util" (OuterVolumeSpecName: "util") pod "9a8aaae6-56a7-4746-91eb-81aab161dcd7" (UID: "9a8aaae6-56a7-4746-91eb-81aab161dcd7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:14:01.115033 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.114947 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwb46\" (UniqueName: \"kubernetes.io/projected/9a8aaae6-56a7-4746-91eb-81aab161dcd7-kube-api-access-xwb46\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:14:01.115033 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.114987 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a8aaae6-56a7-4746-91eb-81aab161dcd7-util\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:14:01.115033 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.114996 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a8aaae6-56a7-4746-91eb-81aab161dcd7-bundle\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:14:01.660015 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.659980 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:01.727472 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.727444 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr"] Sep 10 12:14:01.727779 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.727766 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a8aaae6-56a7-4746-91eb-81aab161dcd7" containerName="util" Sep 10 12:14:01.727837 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.727781 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a8aaae6-56a7-4746-91eb-81aab161dcd7" containerName="util" Sep 10 12:14:01.727837 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.727791 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a8aaae6-56a7-4746-91eb-81aab161dcd7" containerName="extract" Sep 10 12:14:01.727837 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.727797 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a8aaae6-56a7-4746-91eb-81aab161dcd7" containerName="extract" Sep 10 12:14:01.727837 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.727816 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a8aaae6-56a7-4746-91eb-81aab161dcd7" containerName="pull" Sep 10 12:14:01.727837 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.727822 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a8aaae6-56a7-4746-91eb-81aab161dcd7" containerName="pull" Sep 10 12:14:01.727982 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.727870 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a8aaae6-56a7-4746-91eb-81aab161dcd7" containerName="extract" Sep 10 12:14:01.730060 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.730039 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:01.732685 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.732646 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 12:14:01.734003 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.733967 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 12:14:01.734003 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.733986 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:14:01.734206 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.734021 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-csnmf\"" Sep 10 12:14:01.734206 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.734035 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 12:14:01.734206 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.734117 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 12:14:01.748938 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.748917 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr"] Sep 10 12:14:01.754784 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.754764 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:01.804572 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.804551 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" Sep 10 12:14:01.804699 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.804545 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affkzql" event={"ID":"9a8aaae6-56a7-4746-91eb-81aab161dcd7","Type":"ContainerDied","Data":"21cbb27b4c18a0f7f266fc68d99b679c79d6031ad38accd77580c29bbe54d156"} Sep 10 12:14:01.804699 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.804670 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21cbb27b4c18a0f7f266fc68d99b679c79d6031ad38accd77580c29bbe54d156" Sep 10 12:14:01.821578 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.821557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4764d736-7f09-4013-848a-75e07ba8f28f-metrics-cert\") pod \"lws-controller-manager-86cfb8b7dd-44vvr\" (UID: \"4764d736-7f09-4013-848a-75e07ba8f28f\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:01.821684 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.821586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4764d736-7f09-4013-848a-75e07ba8f28f-manager-config\") pod \"lws-controller-manager-86cfb8b7dd-44vvr\" (UID: \"4764d736-7f09-4013-848a-75e07ba8f28f\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:01.821684 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.821660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5rqw\" (UniqueName: \"kubernetes.io/projected/4764d736-7f09-4013-848a-75e07ba8f28f-kube-api-access-w5rqw\") pod \"lws-controller-manager-86cfb8b7dd-44vvr\" (UID: \"4764d736-7f09-4013-848a-75e07ba8f28f\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:01.821684 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.821679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4764d736-7f09-4013-848a-75e07ba8f28f-cert\") pod \"lws-controller-manager-86cfb8b7dd-44vvr\" (UID: \"4764d736-7f09-4013-848a-75e07ba8f28f\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:01.922495 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.922431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5rqw\" (UniqueName: \"kubernetes.io/projected/4764d736-7f09-4013-848a-75e07ba8f28f-kube-api-access-w5rqw\") pod \"lws-controller-manager-86cfb8b7dd-44vvr\" (UID: \"4764d736-7f09-4013-848a-75e07ba8f28f\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:01.922495 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.922462 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4764d736-7f09-4013-848a-75e07ba8f28f-cert\") pod \"lws-controller-manager-86cfb8b7dd-44vvr\" (UID: \"4764d736-7f09-4013-848a-75e07ba8f28f\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:01.922495 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.922486 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4764d736-7f09-4013-848a-75e07ba8f28f-metrics-cert\") pod \"lws-controller-manager-86cfb8b7dd-44vvr\" (UID: \"4764d736-7f09-4013-848a-75e07ba8f28f\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:01.922771 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.922515 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4764d736-7f09-4013-848a-75e07ba8f28f-manager-config\") pod \"lws-controller-manager-86cfb8b7dd-44vvr\" (UID: \"4764d736-7f09-4013-848a-75e07ba8f28f\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:01.923273 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.923207 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4764d736-7f09-4013-848a-75e07ba8f28f-manager-config\") pod \"lws-controller-manager-86cfb8b7dd-44vvr\" (UID: \"4764d736-7f09-4013-848a-75e07ba8f28f\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:01.925014 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.924995 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4764d736-7f09-4013-848a-75e07ba8f28f-cert\") pod \"lws-controller-manager-86cfb8b7dd-44vvr\" (UID: \"4764d736-7f09-4013-848a-75e07ba8f28f\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:01.925127 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.925106 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4764d736-7f09-4013-848a-75e07ba8f28f-metrics-cert\") pod \"lws-controller-manager-86cfb8b7dd-44vvr\" (UID: \"4764d736-7f09-4013-848a-75e07ba8f28f\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:01.932435 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:01.932417 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5rqw\" (UniqueName: \"kubernetes.io/projected/4764d736-7f09-4013-848a-75e07ba8f28f-kube-api-access-w5rqw\") pod \"lws-controller-manager-86cfb8b7dd-44vvr\" (UID: \"4764d736-7f09-4013-848a-75e07ba8f28f\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:02.039814 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:02.039791 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:02.311136 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:02.311105 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr"] Sep 10 12:14:02.314340 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:14:02.314317 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4764d736_7f09_4013_848a_75e07ba8f28f.slice/crio-8ee4d75faa3d471b1420dadcc0b440f73f48a5fc0337caff644dacf8f2e081cd WatchSource:0}: Error finding container 8ee4d75faa3d471b1420dadcc0b440f73f48a5fc0337caff644dacf8f2e081cd: Status 404 returned error can't find the container with id 8ee4d75faa3d471b1420dadcc0b440f73f48a5fc0337caff644dacf8f2e081cd Sep 10 12:14:02.316414 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:02.316398 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:14:02.810327 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:02.810297 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" event={"ID":"4764d736-7f09-4013-848a-75e07ba8f28f","Type":"ContainerStarted","Data":"8ee4d75faa3d471b1420dadcc0b440f73f48a5fc0337caff644dacf8f2e081cd"} Sep 10 12:14:05.824872 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:05.824832 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" event={"ID":"4764d736-7f09-4013-848a-75e07ba8f28f","Type":"ContainerStarted","Data":"b502081eef9cbdb55d4cf0dce14f9e2106dfa5f40fce096219d06edbad0ed4ab"} Sep 10 12:14:05.825256 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:05.824917 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:05.841983 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:05.841916 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" podStartSLOduration=1.8435742419999999 podStartE2EDuration="4.841902721s" totalImagesPullingTime="2.998328479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:05.841175478 +0000 UTC m=+306.771477395" watchObservedRunningTime="2026-09-10 12:14:05.841902721 +0000 UTC m=+306.772204636" Sep 10 12:14:12.176214 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.176179 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr"] Sep 10 12:14:12.178444 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.178428 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:12.181388 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.181366 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 12:14:12.181502 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.181389 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jdqn8\"" Sep 10 12:14:12.181502 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.181369 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 12:14:12.188063 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.188044 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr"] Sep 10 12:14:12.299726 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.299698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg6d9\" (UniqueName: \"kubernetes.io/projected/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-kube-api-access-sg6d9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr\" (UID: \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:12.299868 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.299728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr\" (UID: \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:12.299868 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.299748 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr\" (UID: \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:12.401042 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.401008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg6d9\" (UniqueName: \"kubernetes.io/projected/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-kube-api-access-sg6d9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr\" (UID: \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:12.401222 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.401049 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr\" (UID: \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:12.401222 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.401077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr\" (UID: \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:12.401481 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.401460 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr\" (UID: \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:12.401553 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.401503 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr\" (UID: \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:12.417510 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.417487 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg6d9\" (UniqueName: \"kubernetes.io/projected/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-kube-api-access-sg6d9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr\" (UID: \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:12.487740 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.487709 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:12.568500 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.568449 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:12.763075 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.762847 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr"] Sep 10 12:14:12.765130 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:14:12.765092 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130e26a6_dbe6_48e1_a45e_80db8a1fe4b4.slice/crio-0b7dfb16a2dcfdf1a227d96874ac4299dcf06d7f6dd991b071c381cb1c37dd2b WatchSource:0}: Error finding container 0b7dfb16a2dcfdf1a227d96874ac4299dcf06d7f6dd991b071c381cb1c37dd2b: Status 404 returned error can't find the container with id 0b7dfb16a2dcfdf1a227d96874ac4299dcf06d7f6dd991b071c381cb1c37dd2b Sep 10 12:14:12.856362 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.856325 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" event={"ID":"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4","Type":"ContainerStarted","Data":"c1791598a2ad2da56089e609505fc358629b77a07cb11d811164c6b0c0ca8e7a"} Sep 10 12:14:12.856523 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:12.856375 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" event={"ID":"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4","Type":"ContainerStarted","Data":"0b7dfb16a2dcfdf1a227d96874ac4299dcf06d7f6dd991b071c381cb1c37dd2b"} Sep 10 12:14:13.543753 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.543719 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f"] Sep 10 12:14:13.546163 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.546140 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.549706 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.549684 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 12:14:13.549954 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.549942 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 12:14:13.550909 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.550894 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 12:14:13.555756 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.555740 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gwfj7\"" Sep 10 12:14:13.556345 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.556330 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 12:14:13.574073 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.574046 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f"] Sep 10 12:14:13.708321 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.708231 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsw9x\" (UniqueName: \"kubernetes.io/projected/0a97f2a0-a031-45c3-962c-2e8734dbcff6-kube-api-access-bsw9x\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.708321 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.708266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0a97f2a0-a031-45c3-962c-2e8734dbcff6-manifests\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.708321 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.708303 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a97f2a0-a031-45c3-962c-2e8734dbcff6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.708528 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.708387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0a97f2a0-a031-45c3-962c-2e8734dbcff6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.708528 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.708430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a97f2a0-a031-45c3-962c-2e8734dbcff6-tmp\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.809499 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.809459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0a97f2a0-a031-45c3-962c-2e8734dbcff6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.809499 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.809504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a97f2a0-a031-45c3-962c-2e8734dbcff6-tmp\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.809733 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.809535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsw9x\" (UniqueName: \"kubernetes.io/projected/0a97f2a0-a031-45c3-962c-2e8734dbcff6-kube-api-access-bsw9x\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.809733 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.809553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0a97f2a0-a031-45c3-962c-2e8734dbcff6-manifests\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.809733 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.809588 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a97f2a0-a031-45c3-962c-2e8734dbcff6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.810088 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.810054 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0a97f2a0-a031-45c3-962c-2e8734dbcff6-manifests\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.812097 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.812074 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a97f2a0-a031-45c3-962c-2e8734dbcff6-tmp\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.812196 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.812131 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0a97f2a0-a031-45c3-962c-2e8734dbcff6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.812196 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.812170 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a97f2a0-a031-45c3-962c-2e8734dbcff6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.818817 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.818784 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsw9x\" (UniqueName: \"kubernetes.io/projected/0a97f2a0-a031-45c3-962c-2e8734dbcff6-kube-api-access-bsw9x\") pod \"opendatahub-operator-controller-manager-5c75f74b49-kll7f\" (UID: \"0a97f2a0-a031-45c3-962c-2e8734dbcff6\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.855764 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.855738 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:13.862827 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.862801 2563 generic.go:356] "Generic (PLEG): container finished" podID="130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" containerID="c1791598a2ad2da56089e609505fc358629b77a07cb11d811164c6b0c0ca8e7a" exitCode=0 Sep 10 12:14:13.862913 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.862854 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" event={"ID":"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4","Type":"ContainerDied","Data":"c1791598a2ad2da56089e609505fc358629b77a07cb11d811164c6b0c0ca8e7a"} Sep 10 12:14:13.874701 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.874678 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:13.976396 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:13.976320 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:14.076291 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:14.076256 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:14.136348 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:14.136319 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f"] Sep 10 12:14:14.140530 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:14:14.140502 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a97f2a0_a031_45c3_962c_2e8734dbcff6.slice/crio-caed82e4b792d6057ee4313f0fe2e474f1e78f379d83f26118e9585e3cc70acc WatchSource:0}: Error finding container caed82e4b792d6057ee4313f0fe2e474f1e78f379d83f26118e9585e3cc70acc: Status 404 returned error can't find the container with id caed82e4b792d6057ee4313f0fe2e474f1e78f379d83f26118e9585e3cc70acc Sep 10 12:14:14.176061 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:14.176021 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:14.284443 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:14.284416 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:14.376183 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:14.376149 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:14.836588 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:14.836555 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:14.869420 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:14.869390 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" event={"ID":"0a97f2a0-a031-45c3-962c-2e8734dbcff6","Type":"ContainerStarted","Data":"caed82e4b792d6057ee4313f0fe2e474f1e78f379d83f26118e9585e3cc70acc"} Sep 10 12:14:14.871294 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:14.871267 2563 generic.go:356] "Generic (PLEG): container finished" podID="130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" containerID="540370bf3a206ee022b6f94ed2a79b7d63297a7af815bffdbd967662af137b52" exitCode=0 Sep 10 12:14:14.871400 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:14.871300 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" event={"ID":"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4","Type":"ContainerDied","Data":"540370bf3a206ee022b6f94ed2a79b7d63297a7af815bffdbd967662af137b52"} Sep 10 12:14:15.880508 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:15.880093 2563 generic.go:356] "Generic (PLEG): container finished" podID="130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" containerID="3cb7988610f5d6b11a013e1bda56dece86c77136f15860b1cc7d6e740ff2ce87" exitCode=0 Sep 10 12:14:15.880508 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:15.880145 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" event={"ID":"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4","Type":"ContainerDied","Data":"3cb7988610f5d6b11a013e1bda56dece86c77136f15860b1cc7d6e740ff2ce87"} Sep 10 12:14:16.832724 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:16.832680 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-44vvr" Sep 10 12:14:17.261293 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.261270 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:17.337406 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.337382 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg6d9\" (UniqueName: \"kubernetes.io/projected/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-kube-api-access-sg6d9\") pod \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\" (UID: \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\") " Sep 10 12:14:17.337503 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.337460 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-bundle\") pod \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\" (UID: \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\") " Sep 10 12:14:17.337566 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.337514 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-util\") pod \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\" (UID: \"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4\") " Sep 10 12:14:17.338294 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.338254 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-bundle" (OuterVolumeSpecName: "bundle") pod "130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" (UID: "130e26a6-dbe6-48e1-a45e-80db8a1fe4b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:14:17.339933 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.339910 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-kube-api-access-sg6d9" (OuterVolumeSpecName: "kube-api-access-sg6d9") pod "130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" (UID: "130e26a6-dbe6-48e1-a45e-80db8a1fe4b4"). InnerVolumeSpecName "kube-api-access-sg6d9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:14:17.343354 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.343304 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-util" (OuterVolumeSpecName: "util") pod "130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" (UID: "130e26a6-dbe6-48e1-a45e-80db8a1fe4b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:14:17.438435 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.438402 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-bundle\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:14:17.438435 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.438432 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-util\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:14:17.438630 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.438442 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg6d9\" (UniqueName: \"kubernetes.io/projected/130e26a6-dbe6-48e1-a45e-80db8a1fe4b4-kube-api-access-sg6d9\") on node \"ip-10-0-133-86.ec2.internal\" DevicePath \"\"" Sep 10 12:14:17.891720 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.891637 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" event={"ID":"130e26a6-dbe6-48e1-a45e-80db8a1fe4b4","Type":"ContainerDied","Data":"0b7dfb16a2dcfdf1a227d96874ac4299dcf06d7f6dd991b071c381cb1c37dd2b"} Sep 10 12:14:17.891720 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.891697 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b7dfb16a2dcfdf1a227d96874ac4299dcf06d7f6dd991b071c381cb1c37dd2b" Sep 10 12:14:17.891720 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.891648 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0nrfxr" Sep 10 12:14:17.894021 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:17.893990 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" event={"ID":"0a97f2a0-a031-45c3-962c-2e8734dbcff6","Type":"ContainerStarted","Data":"f8407b4a88124d71ad4ecc4a7888c8d5b55e48fa9871979ecdadb94faba2a0dd"} Sep 10 12:14:18.899536 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:18.899502 2563 generic.go:356] "Generic (PLEG): container finished" podID="0a97f2a0-a031-45c3-962c-2e8734dbcff6" containerID="f8407b4a88124d71ad4ecc4a7888c8d5b55e48fa9871979ecdadb94faba2a0dd" exitCode=0 Sep 10 12:14:18.900003 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:18.899596 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" event={"ID":"0a97f2a0-a031-45c3-962c-2e8734dbcff6","Type":"ContainerDied","Data":"f8407b4a88124d71ad4ecc4a7888c8d5b55e48fa9871979ecdadb94faba2a0dd"} Sep 10 12:14:20.910321 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:20.910280 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" event={"ID":"0a97f2a0-a031-45c3-962c-2e8734dbcff6","Type":"ContainerStarted","Data":"4ccbc7e65924d1fb8b0114d9bc5aa6f961388581b889c2fac897eccfe06d8417"} Sep 10 12:14:20.910765 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:20.910364 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:20.934616 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:20.934555 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" podStartSLOduration=2.336186476 podStartE2EDuration="7.934540326s" totalImagesPullingTime="4.56530875s" totalInitContainerRuntime="1.0330451s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:20.932141083 +0000 UTC m=+321.862442998" watchObservedRunningTime="2026-09-10 12:14:20.934540326 +0000 UTC m=+321.864842242" Sep 10 12:14:22.836971 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:22.836945 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:27.101669 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:27.101634 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:27.168872 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:27.168835 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:27.541737 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:27.541707 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:27.602391 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:27.602358 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:31.916692 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:31.916662 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-kll7f" Sep 10 12:14:33.386223 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:33.386180 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:33.483137 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:33.483105 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:44.024814 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:44.024779 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:44.333972 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:44.333881 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:44.487626 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:44.487583 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:44.563797 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:44.563769 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:44.765222 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:44.765190 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:45.171158 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:45.171081 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:45.374755 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:45.374723 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:45.460958 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:45.460893 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:45.532433 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:45.532405 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:46.453811 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:46.453750 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:49.871468 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:49.871430 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:51.307462 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.307364 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:51.407957 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.407904 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:51.911802 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.911766 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr"] Sep 10 12:14:51.912130 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.912112 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" containerName="pull" Sep 10 12:14:51.912272 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.912133 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" containerName="pull" Sep 10 12:14:51.912272 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.912164 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" containerName="util" Sep 10 12:14:51.912272 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.912173 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" containerName="util" Sep 10 12:14:51.912272 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.912193 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" containerName="extract" Sep 10 12:14:51.912272 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.912202 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" containerName="extract" Sep 10 12:14:51.912507 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.912274 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="130e26a6-dbe6-48e1-a45e-80db8a1fe4b4" containerName="extract" Sep 10 12:14:51.914309 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.914289 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:51.918272 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.918250 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 12:14:51.918388 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.918321 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vkvpz\"" Sep 10 12:14:51.957364 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.957338 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr"] Sep 10 12:14:51.980210 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.980185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:51.980302 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.980216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm4kk\" (UniqueName: \"kubernetes.io/projected/60b01cce-857d-4705-9173-613430f95141-kube-api-access-bm4kk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:51.980302 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.980245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b01cce-857d-4705-9173-613430f95141-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:51.980375 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.980354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:51.980413 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.980380 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b01cce-857d-4705-9173-613430f95141-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:51.980413 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.980406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:51.980483 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.980421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:51.980483 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.980439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b01cce-857d-4705-9173-613430f95141-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:51.980483 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.980462 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:51.981821 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:51.981767 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:52.081219 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.081189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.081219 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.081221 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b01cce-857d-4705-9173-613430f95141-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.081439 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.081246 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.081439 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.081369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.081439 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.081415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b01cce-857d-4705-9173-613430f95141-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.081645 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.081473 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.081645 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.081523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.081645 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.081559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm4kk\" (UniqueName: \"kubernetes.io/projected/60b01cce-857d-4705-9173-613430f95141-kube-api-access-bm4kk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.081645 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.081586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b01cce-857d-4705-9173-613430f95141-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.081850 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.081653 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.081850 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.081754 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.082018 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.081991 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.082100 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.082020 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.082453 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.082429 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b01cce-857d-4705-9173-613430f95141-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.083338 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.083316 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:52.084010 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.083993 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b01cce-857d-4705-9173-613430f95141-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.084208 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.084193 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b01cce-857d-4705-9173-613430f95141-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.091822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.091798 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm4kk\" (UniqueName: \"kubernetes.io/projected/60b01cce-857d-4705-9173-613430f95141-kube-api-access-bm4kk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.091822 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.091813 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b01cce-857d-4705-9173-613430f95141-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr\" (UID: \"60b01cce-857d-4705-9173-613430f95141\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.099771 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.099746 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn"] Sep 10 12:14:52.102225 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.102208 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.105042 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.105023 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 12:14:52.105251 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.105232 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 12:14:52.105346 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.105269 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n5wcw\"" Sep 10 12:14:52.105346 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.105240 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 12:14:52.118991 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.118971 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn"] Sep 10 12:14:52.182911 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.182837 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a19ca223-058e-4f9f-ac08-ea855b002a6f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.182911 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.182872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a19ca223-058e-4f9f-ac08-ea855b002a6f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.182911 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.182891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a19ca223-058e-4f9f-ac08-ea855b002a6f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.183107 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.182939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a19ca223-058e-4f9f-ac08-ea855b002a6f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.183107 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.182971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a19ca223-058e-4f9f-ac08-ea855b002a6f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.183107 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.182987 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5476\" (UniqueName: \"kubernetes.io/projected/a19ca223-058e-4f9f-ac08-ea855b002a6f-kube-api-access-h5476\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.183107 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.183056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a19ca223-058e-4f9f-ac08-ea855b002a6f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.187729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.187696 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:52.224729 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.224704 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:52.286720 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.283468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a19ca223-058e-4f9f-ac08-ea855b002a6f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.286720 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.283520 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a19ca223-058e-4f9f-ac08-ea855b002a6f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.286720 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.283554 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a19ca223-058e-4f9f-ac08-ea855b002a6f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.286720 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.283644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a19ca223-058e-4f9f-ac08-ea855b002a6f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.286720 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.283697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a19ca223-058e-4f9f-ac08-ea855b002a6f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.286720 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.283722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5476\" (UniqueName: \"kubernetes.io/projected/a19ca223-058e-4f9f-ac08-ea855b002a6f-kube-api-access-h5476\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.286720 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.283785 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a19ca223-058e-4f9f-ac08-ea855b002a6f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.298039 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.297805 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a19ca223-058e-4f9f-ac08-ea855b002a6f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.298392 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.298319 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a19ca223-058e-4f9f-ac08-ea855b002a6f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.298392 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.298348 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a19ca223-058e-4f9f-ac08-ea855b002a6f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.307267 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.307241 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a19ca223-058e-4f9f-ac08-ea855b002a6f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.308963 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.308935 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a19ca223-058e-4f9f-ac08-ea855b002a6f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.311544 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.311518 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5476\" (UniqueName: \"kubernetes.io/projected/a19ca223-058e-4f9f-ac08-ea855b002a6f-kube-api-access-h5476\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.312989 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.312959 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a19ca223-058e-4f9f-ac08-ea855b002a6f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rtnrn\" (UID: \"a19ca223-058e-4f9f-ac08-ea855b002a6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.412149 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.412109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:52.507310 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.507284 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr"] Sep 10 12:14:52.509282 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:14:52.509254 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60b01cce_857d_4705_9173_613430f95141.slice/crio-b0e92f14d26907e85ebe4d7c6587ef71fbf394d16cdb17635d0c0d6118bc1b07 WatchSource:0}: Error finding container b0e92f14d26907e85ebe4d7c6587ef71fbf394d16cdb17635d0c0d6118bc1b07: Status 404 returned error can't find the container with id b0e92f14d26907e85ebe4d7c6587ef71fbf394d16cdb17635d0c0d6118bc1b07 Sep 10 12:14:52.686366 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:52.686341 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn"] Sep 10 12:14:52.687581 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:14:52.687554 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19ca223_058e_4f9f_ac08_ea855b002a6f.slice/crio-da568afc8e5c68725b3192460d77a5e5a9ad7998184143e615158aa9c2210ece WatchSource:0}: Error finding container da568afc8e5c68725b3192460d77a5e5a9ad7998184143e615158aa9c2210ece: Status 404 returned error can't find the container with id da568afc8e5c68725b3192460d77a5e5a9ad7998184143e615158aa9c2210ece Sep 10 12:14:53.050461 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:53.050424 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" event={"ID":"60b01cce-857d-4705-9173-613430f95141","Type":"ContainerStarted","Data":"b0e92f14d26907e85ebe4d7c6587ef71fbf394d16cdb17635d0c0d6118bc1b07"} Sep 10 12:14:53.051667 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:53.051641 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" event={"ID":"a19ca223-058e-4f9f-ac08-ea855b002a6f","Type":"ContainerStarted","Data":"da568afc8e5c68725b3192460d77a5e5a9ad7998184143e615158aa9c2210ece"} Sep 10 12:14:54.541445 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:54.541398 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:54.644165 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:54.644129 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:54.818498 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:54.818405 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:54.938069 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:54.938033 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:55.102229 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:55.102145 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:14:56.070148 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:56.070112 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 10 12:14:56.070489 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:56.070185 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 10 12:14:56.073820 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:56.073796 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 10 12:14:56.073879 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:56.073849 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 10 12:14:56.073914 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:56.073894 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 10 12:14:57.080981 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:57.080939 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" event={"ID":"60b01cce-857d-4705-9173-613430f95141","Type":"ContainerStarted","Data":"44a399555a8f35c83177390ee7e2179185cd25c8d213e7108463f0102177217f"} Sep 10 12:14:57.082507 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:57.082482 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" event={"ID":"a19ca223-058e-4f9f-ac08-ea855b002a6f","Type":"ContainerStarted","Data":"7d4b7fd9412860e3afa79f03910eaa815e390ca44b07dbfb918bdc71bae4c609"} Sep 10 12:14:57.082706 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:57.082690 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:57.084321 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:57.084302 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" Sep 10 12:14:57.108497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:57.108418 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" podStartSLOduration=2.546162438 podStartE2EDuration="6.108401758s" totalImagesPullingTime="3.56223932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:57.107093011 +0000 UTC m=+358.037394928" watchObservedRunningTime="2026-09-10 12:14:57.108401758 +0000 UTC m=+358.038703676" Sep 10 12:14:57.132757 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:57.132709 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rtnrn" podStartSLOduration=1.752342927 podStartE2EDuration="5.132690314s" totalImagesPullingTime="3.380347387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:57.130811496 +0000 UTC m=+358.061113405" watchObservedRunningTime="2026-09-10 12:14:57.132690314 +0000 UTC m=+358.062992231" Sep 10 12:14:57.225013 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:57.224977 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:57.229198 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:57.229173 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:58.087398 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:58.087359 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:14:58.088324 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:14:58.088300 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr" Sep 10 12:15:26.393827 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:15:26.393792 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:26.449470 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:15:26.449440 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:37.143865 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:15:37.143827 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:37.245489 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:15:37.245460 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:37.344338 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:15:37.344306 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:45.491892 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:15:45.491862 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:15:45.561269 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:15:45.561233 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:06.314454 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:06.314422 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:11.763095 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:11.763049 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:14.365184 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:14.365140 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:14.748463 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:14.748429 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:15.142502 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:15.142434 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:16.190579 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:16.190543 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:18.002450 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:18.002417 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:18.103962 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:18.103929 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:18.560527 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:18.560500 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:20.416780 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:20.416751 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:20.550546 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:20.550509 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:20.845924 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:20.845893 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:22.987756 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:22.987717 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:24.163290 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:24.163259 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:24.265915 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:24.265889 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:27.293997 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:27.293966 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:27.503365 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:27.503333 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:28.966943 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:28.966901 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:29.067185 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:29.067151 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:29.360795 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:29.360767 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:29.462391 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:29.462359 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:29.560321 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:29.560293 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:29.626065 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:29.625990 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:35.768379 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:35.768320 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:35.871969 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:35.871939 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:40.590061 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:40.590030 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:40.697856 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:40.697832 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:43.054726 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:43.054683 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:43.155765 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:43.155731 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:47.636279 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:47.636249 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:47.735984 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:47.735948 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:47.798841 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:47.798791 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:54.694838 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:54.694803 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:54.822815 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:54.822784 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:59.487454 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:59.487425 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:16:59.585350 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:16:59.585322 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:00.949842 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:00.949812 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:01.186678 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:01.186646 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:01.289161 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:01.289130 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:02.081806 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:02.081771 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:02.189872 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:02.189834 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:05.971027 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:05.970991 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v"] Sep 10 12:17:05.973708 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:05.973690 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:05.976234 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:05.976215 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-w2kqd\"" Sep 10 12:17:05.985252 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:05.985225 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v"] Sep 10 12:17:05.986881 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:05.986857 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:06.046775 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.046742 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.046916 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.046780 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff825bce-69db-42f9-abcf-1dd28885b5cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.046916 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.046839 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.046916 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.046872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff825bce-69db-42f9-abcf-1dd28885b5cc-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.046916 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.046907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.047072 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.046928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff825bce-69db-42f9-abcf-1dd28885b5cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.047072 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.046980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j8c4\" (UniqueName: \"kubernetes.io/projected/ff825bce-69db-42f9-abcf-1dd28885b5cc-kube-api-access-6j8c4\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.047072 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.047012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.047072 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.047046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.079131 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.079104 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:06.147960 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.147933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.147960 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.147963 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff825bce-69db-42f9-abcf-1dd28885b5cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.148166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.147984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.148166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.148103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff825bce-69db-42f9-abcf-1dd28885b5cc-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.148166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.148152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.148323 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.148177 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff825bce-69db-42f9-abcf-1dd28885b5cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.148323 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.148214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j8c4\" (UniqueName: \"kubernetes.io/projected/ff825bce-69db-42f9-abcf-1dd28885b5cc-kube-api-access-6j8c4\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.148323 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.148248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.148323 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.148280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.148524 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.148358 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.148623 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.148577 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.148693 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.148652 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.148765 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.148740 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.149154 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.149130 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff825bce-69db-42f9-abcf-1dd28885b5cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.150562 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.150533 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff825bce-69db-42f9-abcf-1dd28885b5cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.150673 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.150600 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff825bce-69db-42f9-abcf-1dd28885b5cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.157292 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.157261 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff825bce-69db-42f9-abcf-1dd28885b5cc-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.157511 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.157493 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j8c4\" (UniqueName: \"kubernetes.io/projected/ff825bce-69db-42f9-abcf-1dd28885b5cc-kube-api-access-6j8c4\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fv45v\" (UID: \"ff825bce-69db-42f9-abcf-1dd28885b5cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.285419 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.285386 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:06.555916 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.555888 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v"] Sep 10 12:17:06.557683 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:17:06.557653 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff825bce_69db_42f9_abcf_1dd28885b5cc.slice/crio-138705736ce7997394595c9d287f01de977cf53110871a0dafd51940b37eea75 WatchSource:0}: Error finding container 138705736ce7997394595c9d287f01de977cf53110871a0dafd51940b37eea75: Status 404 returned error can't find the container with id 138705736ce7997394595c9d287f01de977cf53110871a0dafd51940b37eea75 Sep 10 12:17:06.560373 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.560343 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 10 12:17:06.560447 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.560407 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 10 12:17:06.560447 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.560434 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 10 12:17:06.661286 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.661251 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" event={"ID":"ff825bce-69db-42f9-abcf-1dd28885b5cc","Type":"ContainerStarted","Data":"c055ec3e30d0f2a08110c19a94e994c69fa620aa57bd78576b03452fc0debb06"} Sep 10 12:17:06.661435 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.661315 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" event={"ID":"ff825bce-69db-42f9-abcf-1dd28885b5cc","Type":"ContainerStarted","Data":"138705736ce7997394595c9d287f01de977cf53110871a0dafd51940b37eea75"} Sep 10 12:17:06.683391 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:06.683340 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" podStartSLOduration=1.683323615 podStartE2EDuration="1.683323615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:17:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:17:06.682211794 +0000 UTC m=+487.612513702" watchObservedRunningTime="2026-09-10 12:17:06.683323615 +0000 UTC m=+487.613625532" Sep 10 12:17:07.286536 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:07.286504 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:07.291514 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:07.291494 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:07.473814 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:07.473786 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:07.575238 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:07.575156 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:07.670679 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:07.670641 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:07.671505 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:07.671486 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:17:07.894511 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:07.894417 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:07.959233 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:07.959201 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:08.283881 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:08.283836 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:08.377559 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:08.377514 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:14.481535 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:14.481482 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:14.582710 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:14.582684 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:19.310308 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:19.310264 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:19.404984 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:19.404954 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:24.644624 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:24.644550 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:24.745323 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:24.745292 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:24.848845 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:24.848813 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:25.504492 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:25.504429 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:25.653355 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:25.653326 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:26.321256 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:26.321213 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:44.162631 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:44.162573 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:44.261750 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:44.261716 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:44.616742 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:44.616711 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:57.324515 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:57.324433 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:17:57.564066 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:17:57.564033 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:04.591074 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:04.591041 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:04.655787 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:04.655757 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:04.711313 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:04.711282 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:05.083148 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:05.083118 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:08.748488 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:08.748450 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:08.851773 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:08.851741 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:22.545293 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:22.545260 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:33.924791 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:33.924754 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:34.022622 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:34.022570 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:38.424345 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:38.424304 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:41.333578 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:41.333542 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:41.434753 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:41.434720 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:43.279485 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:43.279449 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:43.378009 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:43.377971 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:43.478287 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:43.478236 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:43.636085 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:43.635975 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:43.721166 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:43.721111 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:48.388517 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:48.388468 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:53.045008 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:53.044905 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fv45v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": read tcp 10.132.0.2:35966->10.132.0.29:15021: read: connection reset by peer" start-of-body= Sep 10 12:18:53.045008 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:53.044983 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" podUID="ff825bce-69db-42f9-abcf-1dd28885b5cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": read tcp 10.132.0.2:35966->10.132.0.29:15021: read: connection reset by peer" Sep 10 12:18:53.148201 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:53.148170 2563 generic.go:356] "Generic (PLEG): container finished" podID="ff825bce-69db-42f9-abcf-1dd28885b5cc" containerID="c055ec3e30d0f2a08110c19a94e994c69fa620aa57bd78576b03452fc0debb06" exitCode=0 Sep 10 12:18:53.148353 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:53.148241 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" event={"ID":"ff825bce-69db-42f9-abcf-1dd28885b5cc","Type":"ContainerDied","Data":"c055ec3e30d0f2a08110c19a94e994c69fa620aa57bd78576b03452fc0debb06"} Sep 10 12:18:53.148622 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:53.148594 2563 scope.go:117] "RemoveContainer" containerID="c055ec3e30d0f2a08110c19a94e994c69fa620aa57bd78576b03452fc0debb06" Sep 10 12:18:53.149594 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:53.149568 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 10 12:18:53.149672 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:53.149657 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 10 12:18:53.149709 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:53.149695 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 10 12:18:54.155279 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:54.155245 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" event={"ID":"ff825bce-69db-42f9-abcf-1dd28885b5cc","Type":"ContainerStarted","Data":"e834666167b460e92bbd60339931bb6cadfe6364df365d368369e95809dfe08b"} Sep 10 12:18:54.285650 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:54.285597 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:18:54.285893 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:54.285873 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fv45v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 10 12:18:54.285948 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:54.285929 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" podUID="ff825bce-69db-42f9-abcf-1dd28885b5cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 10 12:18:55.260839 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:55.260808 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:55.285967 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:55.285941 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fv45v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 10 12:18:55.286089 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:55.285996 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" podUID="ff825bce-69db-42f9-abcf-1dd28885b5cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 10 12:18:55.365925 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:55.365894 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:18:56.286165 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:56.286126 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fv45v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 10 12:18:56.286540 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:56.286195 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" podUID="ff825bce-69db-42f9-abcf-1dd28885b5cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 10 12:18:57.286701 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:57.286661 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fv45v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 10 12:18:57.287082 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:57.286726 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" podUID="ff825bce-69db-42f9-abcf-1dd28885b5cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 10 12:18:58.286072 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:58.286041 2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fv45v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Sep 10 12:18:58.286251 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:58.286107 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" podUID="ff825bce-69db-42f9-abcf-1dd28885b5cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Sep 10 12:18:59.289076 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:59.289046 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:18:59.289449 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:59.289411 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:18:59.290130 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:59.290111 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fv45v" Sep 10 12:18:59.525359 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:59.525324 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-acl-logging/0.log" Sep 10 12:18:59.527141 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:18:59.527121 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-acl-logging/0.log" Sep 10 12:19:05.085931 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.085890 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx"] Sep 10 12:19:05.088105 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.088083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.091185 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.091166 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 12:19:05.092299 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.092283 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 10 12:19:05.092413 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.092295 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 12:19:05.092413 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.092314 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j9nk5\"" Sep 10 12:19:05.101137 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.101113 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx"] Sep 10 12:19:05.123588 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.123564 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:19:05.189045 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.189012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1371354b-113f-48ea-a32f-f0944c7c00ec-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.189198 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.189073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1371354b-113f-48ea-a32f-f0944c7c00ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.189198 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.189114 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1371354b-113f-48ea-a32f-f0944c7c00ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.189198 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.189142 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1371354b-113f-48ea-a32f-f0944c7c00ec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.189361 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.189200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpqq5\" (UniqueName: \"kubernetes.io/projected/1371354b-113f-48ea-a32f-f0944c7c00ec-kube-api-access-zpqq5\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.189361 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.189270 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1371354b-113f-48ea-a32f-f0944c7c00ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.290379 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.290345 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1371354b-113f-48ea-a32f-f0944c7c00ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.290548 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.290384 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1371354b-113f-48ea-a32f-f0944c7c00ec-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.290548 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.290406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1371354b-113f-48ea-a32f-f0944c7c00ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.290700 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.290539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1371354b-113f-48ea-a32f-f0944c7c00ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.290700 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.290577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1371354b-113f-48ea-a32f-f0944c7c00ec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.290700 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.290655 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpqq5\" (UniqueName: \"kubernetes.io/projected/1371354b-113f-48ea-a32f-f0944c7c00ec-kube-api-access-zpqq5\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.290862 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.290836 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1371354b-113f-48ea-a32f-f0944c7c00ec-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.290910 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.290892 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1371354b-113f-48ea-a32f-f0944c7c00ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.291032 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.291010 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1371354b-113f-48ea-a32f-f0944c7c00ec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.292916 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.292894 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1371354b-113f-48ea-a32f-f0944c7c00ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.293302 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.293284 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1371354b-113f-48ea-a32f-f0944c7c00ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.301595 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.301572 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpqq5\" (UniqueName: \"kubernetes.io/projected/1371354b-113f-48ea-a32f-f0944c7c00ec-kube-api-access-zpqq5\") pod \"e2e-distinct-2-simulated-kserve-859856b874-5mlxx\" (UID: \"1371354b-113f-48ea-a32f-f0944c7c00ec\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.398581 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.398498 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:05.668628 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.668589 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx"] Sep 10 12:19:05.670243 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:19:05.670217 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1371354b_113f_48ea_a32f_f0944c7c00ec.slice/crio-452c424ea1ba493c8db0692182a5fd3af71d4708d37a882a379a2afc263fa52f WatchSource:0}: Error finding container 452c424ea1ba493c8db0692182a5fd3af71d4708d37a882a379a2afc263fa52f: Status 404 returned error can't find the container with id 452c424ea1ba493c8db0692182a5fd3af71d4708d37a882a379a2afc263fa52f Sep 10 12:19:05.671697 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:05.671681 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:19:06.212836 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:06.212794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" event={"ID":"1371354b-113f-48ea-a32f-f0944c7c00ec","Type":"ContainerStarted","Data":"452c424ea1ba493c8db0692182a5fd3af71d4708d37a882a379a2afc263fa52f"} Sep 10 12:19:07.218375 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:07.218286 2563 generic.go:356] "Generic (PLEG): container finished" podID="1371354b-113f-48ea-a32f-f0944c7c00ec" containerID="fc070bdd23316e4d7f04c4eea487b4f2d153e67f548592cc0562564bc1c53f8a" exitCode=0 Sep 10 12:19:07.218760 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:07.218372 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" event={"ID":"1371354b-113f-48ea-a32f-f0944c7c00ec","Type":"ContainerDied","Data":"fc070bdd23316e4d7f04c4eea487b4f2d153e67f548592cc0562564bc1c53f8a"} Sep 10 12:19:07.218760 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:07.218575 2563 scope.go:117] "RemoveContainer" containerID="fc070bdd23316e4d7f04c4eea487b4f2d153e67f548592cc0562564bc1c53f8a" Sep 10 12:19:08.224365 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:08.224327 2563 generic.go:356] "Generic (PLEG): container finished" podID="1371354b-113f-48ea-a32f-f0944c7c00ec" containerID="3ee8e64407042035967f9b78091222260ac6be20a3cddb5456d6e82f5c308c43" exitCode=0 Sep 10 12:19:08.224868 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:08.224411 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" event={"ID":"1371354b-113f-48ea-a32f-f0944c7c00ec","Type":"ContainerDied","Data":"3ee8e64407042035967f9b78091222260ac6be20a3cddb5456d6e82f5c308c43"} Sep 10 12:19:08.224868 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:08.224474 2563 scope.go:117] "RemoveContainer" containerID="fc070bdd23316e4d7f04c4eea487b4f2d153e67f548592cc0562564bc1c53f8a" Sep 10 12:19:08.224868 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:08.224698 2563 scope.go:117] "RemoveContainer" containerID="3ee8e64407042035967f9b78091222260ac6be20a3cddb5456d6e82f5c308c43" Sep 10 12:19:08.225004 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:19:08.224873 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:19:09.230503 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:09.230475 2563 scope.go:117] "RemoveContainer" containerID="3ee8e64407042035967f9b78091222260ac6be20a3cddb5456d6e82f5c308c43" Sep 10 12:19:09.230898 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:19:09.230657 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:19:15.308826 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:15.308790 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:19:15.398919 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:15.398883 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:15.399062 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:15.398957 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:15.399062 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:15.398977 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:15.399062 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:15.398989 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:15.399324 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:15.399313 2563 scope.go:117] "RemoveContainer" containerID="3ee8e64407042035967f9b78091222260ac6be20a3cddb5456d6e82f5c308c43" Sep 10 12:19:15.399494 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:19:15.399474 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:19:20.385595 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.385561 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw"] Sep 10 12:19:20.388417 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.388402 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.391032 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.391011 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 10 12:19:20.398422 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.398399 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw"] Sep 10 12:19:20.408994 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.408971 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:19:20.417224 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.417205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.417312 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.417247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.417312 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.417269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.417312 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.417302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s768l\" (UniqueName: \"kubernetes.io/projected/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-kube-api-access-s768l\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.417418 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.417319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.417418 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.417362 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.518270 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.518240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.518407 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.518281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.518407 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.518322 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s768l\" (UniqueName: \"kubernetes.io/projected/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-kube-api-access-s768l\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.518407 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.518348 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.518407 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.518375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.518656 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.518452 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.518744 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.518701 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.518744 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.518719 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.518855 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.518837 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.520679 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.520660 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.520990 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.520971 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.526459 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.526432 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s768l\" (UniqueName: \"kubernetes.io/projected/ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4-kube-api-access-s768l\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw\" (UID: \"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.698599 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.698496 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:20.966811 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:20.966788 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw"] Sep 10 12:19:20.968832 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:19:20.968807 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2b1fa9_1c33_49a7_a374_42e0cc1ecae4.slice/crio-e1331595b2f692a4a8c74ca74f7de90fa943697dc0ca6c9df64bac4b5cce2ba6 WatchSource:0}: Error finding container e1331595b2f692a4a8c74ca74f7de90fa943697dc0ca6c9df64bac4b5cce2ba6: Status 404 returned error can't find the container with id e1331595b2f692a4a8c74ca74f7de90fa943697dc0ca6c9df64bac4b5cce2ba6 Sep 10 12:19:21.286592 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:21.286555 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" event={"ID":"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4","Type":"ContainerStarted","Data":"ec52eb9283e07da217ad205c35066094b2c19a724023bf8ee7b750e9b5946134"} Sep 10 12:19:21.286762 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:21.286642 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" event={"ID":"ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4","Type":"ContainerStarted","Data":"e1331595b2f692a4a8c74ca74f7de90fa943697dc0ca6c9df64bac4b5cce2ba6"} Sep 10 12:19:21.304678 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:21.304633 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" podStartSLOduration=1.121921565 podStartE2EDuration="1.304595113s" totalImagesPullingTime="182.673548ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:19:21.3034393 +0000 UTC m=+622.233741213" watchObservedRunningTime="2026-09-10 12:19:21.304595113 +0000 UTC m=+622.234897029" Sep 10 12:19:28.240186 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:28.240153 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:19:29.577634 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:29.577590 2563 scope.go:117] "RemoveContainer" containerID="3ee8e64407042035967f9b78091222260ac6be20a3cddb5456d6e82f5c308c43" Sep 10 12:19:30.332317 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:30.332285 2563 generic.go:356] "Generic (PLEG): container finished" podID="1371354b-113f-48ea-a32f-f0944c7c00ec" containerID="e64b72f40d896ceee276d3fc28497e1380b974fd13b8fff119179e5dfce4d680" exitCode=0 Sep 10 12:19:30.332317 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:30.332337 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" event={"ID":"1371354b-113f-48ea-a32f-f0944c7c00ec","Type":"ContainerDied","Data":"e64b72f40d896ceee276d3fc28497e1380b974fd13b8fff119179e5dfce4d680"} Sep 10 12:19:30.332581 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:30.332386 2563 scope.go:117] "RemoveContainer" containerID="3ee8e64407042035967f9b78091222260ac6be20a3cddb5456d6e82f5c308c43" Sep 10 12:19:30.332782 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:30.332762 2563 scope.go:117] "RemoveContainer" containerID="e64b72f40d896ceee276d3fc28497e1380b974fd13b8fff119179e5dfce4d680" Sep 10 12:19:30.332994 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:19:30.332960 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:19:30.699678 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:30.699567 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:30.699678 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:30.699654 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:30.718865 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:30.718838 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:31.349777 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:31.349748 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw" Sep 10 12:19:35.399331 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:35.399293 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:35.399742 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:35.399350 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:35.399742 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:35.399367 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:35.399742 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:35.399381 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:19:35.399844 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:35.399765 2563 scope.go:117] "RemoveContainer" containerID="e64b72f40d896ceee276d3fc28497e1380b974fd13b8fff119179e5dfce4d680" Sep 10 12:19:35.399946 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:19:35.399929 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:19:41.501686 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:41.501652 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:19:43.580874 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.580846 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p"] Sep 10 12:19:43.586517 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.586498 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.589246 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.589224 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 10 12:19:43.590636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.590597 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p"] Sep 10 12:19:43.701376 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.701339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.701376 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.701374 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.701651 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.701397 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.701651 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.701472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.701651 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.701537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.701806 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.701708 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlmcp\" (UniqueName: \"kubernetes.io/projected/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-kube-api-access-xlmcp\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.786137 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.786099 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:19:43.802348 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.802316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmcp\" (UniqueName: \"kubernetes.io/projected/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-kube-api-access-xlmcp\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.802523 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.802355 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.802523 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.802374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.802523 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.802404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.802745 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.802580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.802745 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.802701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.802867 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.802852 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.803376 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.803078 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.803572 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.803539 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.808891 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.805541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.812248 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.812221 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.813023 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.813003 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlmcp\" (UniqueName: \"kubernetes.io/projected/40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd-kube-api-access-xlmcp\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p\" (UID: \"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:43.896941 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:43.896852 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:44.185249 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:44.185224 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p"] Sep 10 12:19:44.187482 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:19:44.187454 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40f1f61a_ab8f_4f8b_a4bf_58f0de0522fd.slice/crio-993d81ebf5382214c330988ff30ab6ad73bdf052631cf98a1c1fe523dbd8a2da WatchSource:0}: Error finding container 993d81ebf5382214c330988ff30ab6ad73bdf052631cf98a1c1fe523dbd8a2da: Status 404 returned error can't find the container with id 993d81ebf5382214c330988ff30ab6ad73bdf052631cf98a1c1fe523dbd8a2da Sep 10 12:19:44.404918 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:44.404896 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" event={"ID":"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd","Type":"ContainerStarted","Data":"993d81ebf5382214c330988ff30ab6ad73bdf052631cf98a1c1fe523dbd8a2da"} Sep 10 12:19:45.410420 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:45.410387 2563 generic.go:356] "Generic (PLEG): container finished" podID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" containerID="8cbfc143239d7e98a649ea079b4518acd4327ac09ad7ebec36eeff7479b99323" exitCode=0 Sep 10 12:19:45.410891 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:45.410478 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" event={"ID":"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd","Type":"ContainerDied","Data":"8cbfc143239d7e98a649ea079b4518acd4327ac09ad7ebec36eeff7479b99323"} Sep 10 12:19:45.410891 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:45.410747 2563 scope.go:117] "RemoveContainer" containerID="8cbfc143239d7e98a649ea079b4518acd4327ac09ad7ebec36eeff7479b99323" Sep 10 12:19:46.417082 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:46.417050 2563 generic.go:356] "Generic (PLEG): container finished" podID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" containerID="d8bf5c245be289ed371800b46777e946b15c48c9aa9be6cfa73e04884a60f775" exitCode=0 Sep 10 12:19:46.417556 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:46.417138 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" event={"ID":"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd","Type":"ContainerDied","Data":"d8bf5c245be289ed371800b46777e946b15c48c9aa9be6cfa73e04884a60f775"} Sep 10 12:19:46.417556 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:46.417200 2563 scope.go:117] "RemoveContainer" containerID="8cbfc143239d7e98a649ea079b4518acd4327ac09ad7ebec36eeff7479b99323" Sep 10 12:19:46.417556 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:46.417462 2563 scope.go:117] "RemoveContainer" containerID="d8bf5c245be289ed371800b46777e946b15c48c9aa9be6cfa73e04884a60f775" Sep 10 12:19:46.417758 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:19:46.417661 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:19:47.425295 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:47.425261 2563 scope.go:117] "RemoveContainer" containerID="d8bf5c245be289ed371800b46777e946b15c48c9aa9be6cfa73e04884a60f775" Sep 10 12:19:47.425865 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:19:47.425514 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:19:48.575431 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:48.575401 2563 scope.go:117] "RemoveContainer" containerID="e64b72f40d896ceee276d3fc28497e1380b974fd13b8fff119179e5dfce4d680" Sep 10 12:19:48.575911 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:19:48.575570 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:19:53.897404 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:53.897364 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:53.897837 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:53.897435 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:53.897837 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:53.897452 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:53.897837 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:53.897473 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:19:53.897949 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:53.897903 2563 scope.go:117] "RemoveContainer" containerID="d8bf5c245be289ed371800b46777e946b15c48c9aa9be6cfa73e04884a60f775" Sep 10 12:19:53.898085 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:19:53.898066 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:19:54.455811 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:19:54.455784 2563 scope.go:117] "RemoveContainer" containerID="d8bf5c245be289ed371800b46777e946b15c48c9aa9be6cfa73e04884a60f775" Sep 10 12:19:54.455981 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:19:54.455947 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:20:02.575503 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:02.575471 2563 scope.go:117] "RemoveContainer" containerID="e64b72f40d896ceee276d3fc28497e1380b974fd13b8fff119179e5dfce4d680" Sep 10 12:20:03.497491 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:03.497459 2563 generic.go:356] "Generic (PLEG): container finished" podID="1371354b-113f-48ea-a32f-f0944c7c00ec" containerID="faec2e4515504198a2e484881f4a0a6ce22bcbc4e152eef17d537d262d04bbf5" exitCode=0 Sep 10 12:20:03.497687 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:03.497530 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" event={"ID":"1371354b-113f-48ea-a32f-f0944c7c00ec","Type":"ContainerDied","Data":"faec2e4515504198a2e484881f4a0a6ce22bcbc4e152eef17d537d262d04bbf5"} Sep 10 12:20:03.497687 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:03.497589 2563 scope.go:117] "RemoveContainer" containerID="e64b72f40d896ceee276d3fc28497e1380b974fd13b8fff119179e5dfce4d680" Sep 10 12:20:03.497973 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:03.497949 2563 scope.go:117] "RemoveContainer" containerID="faec2e4515504198a2e484881f4a0a6ce22bcbc4e152eef17d537d262d04bbf5" Sep 10 12:20:03.498202 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:20:03.498175 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:20:04.605894 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:04.605862 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:20:05.399598 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:05.399564 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:20:05.399806 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:05.399636 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:20:05.399806 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:05.399653 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:20:05.399806 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:05.399666 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:20:05.399985 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:05.399974 2563 scope.go:117] "RemoveContainer" containerID="faec2e4515504198a2e484881f4a0a6ce22bcbc4e152eef17d537d262d04bbf5" Sep 10 12:20:05.400150 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:20:05.400132 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:20:08.575511 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:08.575477 2563 scope.go:117] "RemoveContainer" containerID="d8bf5c245be289ed371800b46777e946b15c48c9aa9be6cfa73e04884a60f775" Sep 10 12:20:09.530508 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:09.530475 2563 generic.go:356] "Generic (PLEG): container finished" podID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" containerID="699baf471e2bfec3708dba52acc707aef891da28adb9886a6f9c1e38a6b9c4d0" exitCode=0 Sep 10 12:20:09.530689 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:09.530513 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" event={"ID":"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd","Type":"ContainerDied","Data":"699baf471e2bfec3708dba52acc707aef891da28adb9886a6f9c1e38a6b9c4d0"} Sep 10 12:20:09.530689 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:09.530560 2563 scope.go:117] "RemoveContainer" containerID="d8bf5c245be289ed371800b46777e946b15c48c9aa9be6cfa73e04884a60f775" Sep 10 12:20:09.530971 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:09.530942 2563 scope.go:117] "RemoveContainer" containerID="699baf471e2bfec3708dba52acc707aef891da28adb9886a6f9c1e38a6b9c4d0" Sep 10 12:20:09.531174 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:20:09.531145 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:20:13.897702 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:13.897667 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:20:13.898082 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:13.897726 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:20:13.898082 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:13.897743 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:20:13.898082 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:13.897755 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:20:13.898178 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:13.898103 2563 scope.go:117] "RemoveContainer" containerID="699baf471e2bfec3708dba52acc707aef891da28adb9886a6f9c1e38a6b9c4d0" Sep 10 12:20:13.898302 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:20:13.898282 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:20:17.575432 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:17.575401 2563 scope.go:117] "RemoveContainer" containerID="faec2e4515504198a2e484881f4a0a6ce22bcbc4e152eef17d537d262d04bbf5" Sep 10 12:20:17.575851 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:20:17.575654 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:20:22.916868 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:22.916836 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:20:23.017421 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:23.017394 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:20:28.575839 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:28.575809 2563 scope.go:117] "RemoveContainer" containerID="699baf471e2bfec3708dba52acc707aef891da28adb9886a6f9c1e38a6b9c4d0" Sep 10 12:20:28.576212 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:20:28.575992 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:20:30.575816 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:30.575784 2563 scope.go:117] "RemoveContainer" containerID="faec2e4515504198a2e484881f4a0a6ce22bcbc4e152eef17d537d262d04bbf5" Sep 10 12:20:30.576185 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:20:30.575965 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:20:40.575823 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:40.575787 2563 scope.go:117] "RemoveContainer" containerID="699baf471e2bfec3708dba52acc707aef891da28adb9886a6f9c1e38a6b9c4d0" Sep 10 12:20:41.675023 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:41.674989 2563 generic.go:356] "Generic (PLEG): container finished" podID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" containerID="918069bd4018c57915416b33f361dfdbc4c58f1d8861d7859ac4a807d639adf0" exitCode=0 Sep 10 12:20:41.675402 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:41.675065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" event={"ID":"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd","Type":"ContainerDied","Data":"918069bd4018c57915416b33f361dfdbc4c58f1d8861d7859ac4a807d639adf0"} Sep 10 12:20:41.675402 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:41.675123 2563 scope.go:117] "RemoveContainer" containerID="699baf471e2bfec3708dba52acc707aef891da28adb9886a6f9c1e38a6b9c4d0" Sep 10 12:20:41.675511 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:41.675459 2563 scope.go:117] "RemoveContainer" containerID="918069bd4018c57915416b33f361dfdbc4c58f1d8861d7859ac4a807d639adf0" Sep 10 12:20:41.675685 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:20:41.675665 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:20:43.897538 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:43.897485 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:20:43.898043 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:43.897565 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:20:43.898043 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:43.897583 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:20:43.898043 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:43.897598 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:20:43.898043 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:43.897965 2563 scope.go:117] "RemoveContainer" containerID="918069bd4018c57915416b33f361dfdbc4c58f1d8861d7859ac4a807d639adf0" Sep 10 12:20:43.898218 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:20:43.898129 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:20:44.575804 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:44.575774 2563 scope.go:117] "RemoveContainer" containerID="faec2e4515504198a2e484881f4a0a6ce22bcbc4e152eef17d537d262d04bbf5" Sep 10 12:20:45.697738 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:45.697706 2563 generic.go:356] "Generic (PLEG): container finished" podID="1371354b-113f-48ea-a32f-f0944c7c00ec" containerID="a2f4a74ba9c989f3167efa3dd581757ec1068bbf820b007f2594b9d1b65b9bfb" exitCode=0 Sep 10 12:20:45.698159 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:45.697780 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" event={"ID":"1371354b-113f-48ea-a32f-f0944c7c00ec","Type":"ContainerDied","Data":"a2f4a74ba9c989f3167efa3dd581757ec1068bbf820b007f2594b9d1b65b9bfb"} Sep 10 12:20:45.698159 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:45.697836 2563 scope.go:117] "RemoveContainer" containerID="faec2e4515504198a2e484881f4a0a6ce22bcbc4e152eef17d537d262d04bbf5" Sep 10 12:20:45.698423 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:45.698173 2563 scope.go:117] "RemoveContainer" containerID="a2f4a74ba9c989f3167efa3dd581757ec1068bbf820b007f2594b9d1b65b9bfb" Sep 10 12:20:45.698423 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:20:45.698387 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:20:55.398963 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:55.398886 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:20:55.398963 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:55.398964 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:20:55.399418 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:55.398981 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:20:55.399418 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:55.398993 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:20:55.399418 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:55.399310 2563 scope.go:117] "RemoveContainer" containerID="a2f4a74ba9c989f3167efa3dd581757ec1068bbf820b007f2594b9d1b65b9bfb" Sep 10 12:20:55.399510 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:20:55.399461 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:20:55.575412 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:20:55.575378 2563 scope.go:117] "RemoveContainer" containerID="918069bd4018c57915416b33f361dfdbc4c58f1d8861d7859ac4a807d639adf0" Sep 10 12:20:55.575644 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:20:55.575595 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:21:06.575881 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:06.575851 2563 scope.go:117] "RemoveContainer" containerID="918069bd4018c57915416b33f361dfdbc4c58f1d8861d7859ac4a807d639adf0" Sep 10 12:21:06.576245 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:21:06.576022 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:21:07.580684 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:07.580654 2563 scope.go:117] "RemoveContainer" containerID="a2f4a74ba9c989f3167efa3dd581757ec1068bbf820b007f2594b9d1b65b9bfb" Sep 10 12:21:07.581132 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:21:07.580888 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:21:19.577821 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:19.577788 2563 scope.go:117] "RemoveContainer" containerID="a2f4a74ba9c989f3167efa3dd581757ec1068bbf820b007f2594b9d1b65b9bfb" Sep 10 12:21:19.577821 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:19.577817 2563 scope.go:117] "RemoveContainer" containerID="918069bd4018c57915416b33f361dfdbc4c58f1d8861d7859ac4a807d639adf0" Sep 10 12:21:19.578263 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:21:19.577960 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:21:19.578263 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:21:19.577980 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:21:31.575489 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:31.575459 2563 scope.go:117] "RemoveContainer" containerID="918069bd4018c57915416b33f361dfdbc4c58f1d8861d7859ac4a807d639adf0" Sep 10 12:21:31.911780 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:31.911753 2563 generic.go:356] "Generic (PLEG): container finished" podID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" containerID="0d9b4375b7703e710d170280b1ed99b766f663f70f7aa3b8783ac7c1aa16f38e" exitCode=0 Sep 10 12:21:31.911900 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:31.911825 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" event={"ID":"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd","Type":"ContainerDied","Data":"0d9b4375b7703e710d170280b1ed99b766f663f70f7aa3b8783ac7c1aa16f38e"} Sep 10 12:21:31.911900 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:31.911895 2563 scope.go:117] "RemoveContainer" containerID="918069bd4018c57915416b33f361dfdbc4c58f1d8861d7859ac4a807d639adf0" Sep 10 12:21:31.912317 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:31.912283 2563 scope.go:117] "RemoveContainer" containerID="0d9b4375b7703e710d170280b1ed99b766f663f70f7aa3b8783ac7c1aa16f38e" Sep 10 12:21:31.912505 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:21:31.912484 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:21:33.575834 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:33.575804 2563 scope.go:117] "RemoveContainer" containerID="a2f4a74ba9c989f3167efa3dd581757ec1068bbf820b007f2594b9d1b65b9bfb" Sep 10 12:21:33.576226 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:21:33.575983 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:21:33.897671 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:33.897574 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:21:33.897671 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:33.897643 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:21:33.897671 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:33.897659 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:21:33.897671 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:33.897670 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:21:33.897975 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:33.897964 2563 scope.go:117] "RemoveContainer" containerID="0d9b4375b7703e710d170280b1ed99b766f663f70f7aa3b8783ac7c1aa16f38e" Sep 10 12:21:33.898142 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:21:33.898126 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:21:47.575875 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:47.575844 2563 scope.go:117] "RemoveContainer" containerID="a2f4a74ba9c989f3167efa3dd581757ec1068bbf820b007f2594b9d1b65b9bfb" Sep 10 12:21:47.576268 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:21:47.576024 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:21:48.576063 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:48.576032 2563 scope.go:117] "RemoveContainer" containerID="0d9b4375b7703e710d170280b1ed99b766f663f70f7aa3b8783ac7c1aa16f38e" Sep 10 12:21:48.576445 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:21:48.576198 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:21:58.575688 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:21:58.575660 2563 scope.go:117] "RemoveContainer" containerID="a2f4a74ba9c989f3167efa3dd581757ec1068bbf820b007f2594b9d1b65b9bfb" Sep 10 12:21:58.576051 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:21:58.575826 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:22:00.575629 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:00.575578 2563 scope.go:117] "RemoveContainer" containerID="0d9b4375b7703e710d170280b1ed99b766f663f70f7aa3b8783ac7c1aa16f38e" Sep 10 12:22:00.575998 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:22:00.575756 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:22:09.578168 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:09.578131 2563 scope.go:117] "RemoveContainer" containerID="a2f4a74ba9c989f3167efa3dd581757ec1068bbf820b007f2594b9d1b65b9bfb" Sep 10 12:22:10.095660 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:10.095554 2563 generic.go:356] "Generic (PLEG): container finished" podID="1371354b-113f-48ea-a32f-f0944c7c00ec" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" exitCode=0 Sep 10 12:22:10.095660 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:10.095628 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" event={"ID":"1371354b-113f-48ea-a32f-f0944c7c00ec","Type":"ContainerDied","Data":"9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac"} Sep 10 12:22:10.095880 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:10.095711 2563 scope.go:117] "RemoveContainer" containerID="a2f4a74ba9c989f3167efa3dd581757ec1068bbf820b007f2594b9d1b65b9bfb" Sep 10 12:22:10.096124 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:10.096109 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:22:10.096338 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:22:10.096319 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:22:14.575098 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:14.575069 2563 scope.go:117] "RemoveContainer" containerID="0d9b4375b7703e710d170280b1ed99b766f663f70f7aa3b8783ac7c1aa16f38e" Sep 10 12:22:14.575477 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:22:14.575240 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:22:15.399220 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:15.399185 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:22:15.399404 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:15.399250 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:22:15.399404 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:15.399275 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:22:15.399404 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:15.399294 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" Sep 10 12:22:15.399586 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:15.399568 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:22:15.399784 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:22:15.399765 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:22:25.576322 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:25.576253 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:22:25.576702 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:22:25.576399 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:22:28.575096 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:28.575067 2563 scope.go:117] "RemoveContainer" containerID="0d9b4375b7703e710d170280b1ed99b766f663f70f7aa3b8783ac7c1aa16f38e" Sep 10 12:22:28.575464 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:22:28.575256 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:22:37.575388 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:37.575353 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:22:37.575806 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:22:37.575524 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:22:41.575217 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:41.575187 2563 scope.go:117] "RemoveContainer" containerID="0d9b4375b7703e710d170280b1ed99b766f663f70f7aa3b8783ac7c1aa16f38e" Sep 10 12:22:41.575667 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:22:41.575364 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:22:48.575575 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:48.575536 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:22:48.576073 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:22:48.575785 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:22:52.576388 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:52.576353 2563 scope.go:117] "RemoveContainer" containerID="0d9b4375b7703e710d170280b1ed99b766f663f70f7aa3b8783ac7c1aa16f38e" Sep 10 12:22:53.293150 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:53.293118 2563 generic.go:356] "Generic (PLEG): container finished" podID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" containerID="fb11182dcfc232879d4a24fa2aaadb060be0a4a724ebec975cc0dfeb0afab9df" exitCode=0 Sep 10 12:22:53.293319 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:53.293195 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" event={"ID":"40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd","Type":"ContainerDied","Data":"fb11182dcfc232879d4a24fa2aaadb060be0a4a724ebec975cc0dfeb0afab9df"} Sep 10 12:22:53.293319 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:53.293257 2563 scope.go:117] "RemoveContainer" containerID="0d9b4375b7703e710d170280b1ed99b766f663f70f7aa3b8783ac7c1aa16f38e" Sep 10 12:22:53.293642 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:53.293596 2563 scope.go:117] "RemoveContainer" containerID="fb11182dcfc232879d4a24fa2aaadb060be0a4a724ebec975cc0dfeb0afab9df" Sep 10 12:22:53.293828 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:22:53.293809 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:22:53.897845 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:53.897813 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:22:53.898241 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:53.897871 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:22:53.898241 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:53.897887 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:22:53.898241 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:53.897900 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" Sep 10 12:22:54.299554 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:22:54.299531 2563 scope.go:117] "RemoveContainer" containerID="fb11182dcfc232879d4a24fa2aaadb060be0a4a724ebec975cc0dfeb0afab9df" Sep 10 12:22:54.299738 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:22:54.299722 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:23:02.576143 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:02.576114 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:23:02.576578 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:23:02.576297 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:23:04.575988 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:04.575952 2563 scope.go:117] "RemoveContainer" containerID="fb11182dcfc232879d4a24fa2aaadb060be0a4a724ebec975cc0dfeb0afab9df" Sep 10 12:23:04.576443 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:23:04.576174 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:23:13.576145 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:13.576113 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:23:13.576647 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:23:13.576288 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:23:17.575998 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:17.575958 2563 scope.go:117] "RemoveContainer" containerID="fb11182dcfc232879d4a24fa2aaadb060be0a4a724ebec975cc0dfeb0afab9df" Sep 10 12:23:17.576396 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:23:17.576202 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:23:25.581131 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:25.581103 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:23:25.581486 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:23:25.581281 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:23:32.575775 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:32.575746 2563 scope.go:117] "RemoveContainer" containerID="fb11182dcfc232879d4a24fa2aaadb060be0a4a724ebec975cc0dfeb0afab9df" Sep 10 12:23:32.576152 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:23:32.575978 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:23:37.575497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:37.575459 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:23:37.575964 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:23:37.575660 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:23:46.576113 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:46.576081 2563 scope.go:117] "RemoveContainer" containerID="fb11182dcfc232879d4a24fa2aaadb060be0a4a724ebec975cc0dfeb0afab9df" Sep 10 12:23:46.576555 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:23:46.576274 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:23:49.577881 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:49.577842 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:23:49.578264 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:23:49.578082 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:23:57.575742 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:57.575708 2563 scope.go:117] "RemoveContainer" containerID="fb11182dcfc232879d4a24fa2aaadb060be0a4a724ebec975cc0dfeb0afab9df" Sep 10 12:23:57.578082 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:23:57.575947 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:23:58.668453 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:58.668419 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd/main/5.log" Sep 10 12:23:58.797157 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:58.797131 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd/main/5.log" Sep 10 12:23:59.227699 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:59.227659 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:59.560836 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:59.560809 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-acl-logging/0.log" Sep 10 12:23:59.561291 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:23:59.561274 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-acl-logging/0.log" Sep 10 12:24:00.575870 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:00.575840 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:24:00.576246 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:24:00.576010 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:24:05.694119 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:05.694089 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75f74b49-kll7f_0a97f2a0-a031-45c3-962c-2e8734dbcff6/copy-manifests/0.log" Sep 10 12:24:05.701495 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:05.701457 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75f74b49-kll7f_0a97f2a0-a031-45c3-962c-2e8734dbcff6/manager/0.log" Sep 10 12:24:06.515519 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:06.515483 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:07.979769 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:07.979734 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr_60b01cce-857d-4705-9173-613430f95141/istio-proxy/0.log" Sep 10 12:24:08.092711 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:08.092673 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rtnrn_a19ca223-058e-4f9f-ac08-ea855b002a6f/discovery/0.log" Sep 10 12:24:08.415483 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:08.415449 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fv45v_ff825bce-69db-42f9-abcf-1dd28885b5cc/istio-proxy/1.log" Sep 10 12:24:08.752191 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:08.752166 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-686b5bf69d-pmhrm_de72c6f8-1f0d-4aaa-b0ec-ae75249388e2/router/0.log" Sep 10 12:24:09.102131 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:09.102057 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-5mlxx_1371354b-113f-48ea-a32f-f0944c7c00ec/main/5.log" Sep 10 12:24:09.320035 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:09.320014 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-sxzlw_ee2b1fa9-1c33-49a7-a374-42e0cc1ecae4/main/0.log" Sep 10 12:24:09.625662 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:09.625631 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd/main/5.log" Sep 10 12:24:11.575122 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:11.575091 2563 scope.go:117] "RemoveContainer" containerID="fb11182dcfc232879d4a24fa2aaadb060be0a4a724ebec975cc0dfeb0afab9df" Sep 10 12:24:11.575652 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:24:11.575261 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:24:13.575599 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:13.575564 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:24:13.576002 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:24:13.575796 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:24:15.273560 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:15.273524 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:15.376649 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:15.376588 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:18.517000 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:18.516964 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s7gp4_d04bf30c-edfd-45d9-85bd-b3da3ef3d1eb/global-pull-secret-syncer/0.log" Sep 10 12:24:18.621975 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:18.621946 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" Sep 10 12:24:18.733648 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:18.733572 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-86.ec2.internal_b02c4f22155d7d9f12bc6266564b08c5/haproxy/0.log" Sep 10 12:24:24.604102 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:24.604067 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-lbvc9_76e40a68-4dae-467c-818a-aff5f4267b6b/cluster-monitoring-operator/0.log" Sep 10 12:24:24.813357 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:24.813324 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9xlc6_dbf31ccc-779a-4dd1-992a-3ed4aaf708e5/node-exporter/0.log" Sep 10 12:24:24.837850 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:24.837828 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9xlc6_dbf31ccc-779a-4dd1-992a-3ed4aaf708e5/kube-rbac-proxy/0.log" Sep 10 12:24:24.864765 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:24.864714 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9xlc6_dbf31ccc-779a-4dd1-992a-3ed4aaf708e5/init-textfile/0.log" Sep 10 12:24:25.576210 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:25.576176 2563 scope.go:117] "RemoveContainer" containerID="fb11182dcfc232879d4a24fa2aaadb060be0a4a724ebec975cc0dfeb0afab9df" Sep 10 12:24:25.576402 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:24:25.576334 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:24:26.412382 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:26.412302 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:27.531496 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:27.531461 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-pnxm7_7326ab48-db32-4ae6-8f6e-023548063048/networking-console-plugin/0.log" Sep 10 12:24:27.575304 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:27.575281 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:24:27.575467 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:24:27.575448 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:24:28.002424 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:28.002392 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zjnn_1b13cb2b-db12-4f3a-ba9f-04739617dff7/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:28.713380 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:28.713346 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-pjhdr_89b2e6d1-92aa-4496-af1c-ba5357ceb884/download-server/0.log" Sep 10 12:24:29.298845 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.298807 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf"] Sep 10 12:24:29.301987 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.301973 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.305215 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.305196 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lhj2m\"/\"default-dockercfg-tzk24\"" Sep 10 12:24:29.305326 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.305241 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lhj2m\"/\"openshift-service-ca.crt\"" Sep 10 12:24:29.306447 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.306427 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lhj2m\"/\"kube-root-ca.crt\"" Sep 10 12:24:29.311788 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.311768 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf"] Sep 10 12:24:29.368497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.368470 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/743c1770-a1db-46d7-a972-c52eacc5c5cd-proc\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.368497 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.368496 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/743c1770-a1db-46d7-a972-c52eacc5c5cd-podres\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.368679 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.368531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xq69\" (UniqueName: \"kubernetes.io/projected/743c1770-a1db-46d7-a972-c52eacc5c5cd-kube-api-access-5xq69\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.368679 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.368599 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/743c1770-a1db-46d7-a972-c52eacc5c5cd-lib-modules\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.368679 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.368655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/743c1770-a1db-46d7-a972-c52eacc5c5cd-sys\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.469388 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.469341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xq69\" (UniqueName: \"kubernetes.io/projected/743c1770-a1db-46d7-a972-c52eacc5c5cd-kube-api-access-5xq69\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.469514 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.469427 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/743c1770-a1db-46d7-a972-c52eacc5c5cd-lib-modules\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.469514 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.469471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/743c1770-a1db-46d7-a972-c52eacc5c5cd-sys\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.469582 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.469515 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/743c1770-a1db-46d7-a972-c52eacc5c5cd-proc\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.469582 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.469535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/743c1770-a1db-46d7-a972-c52eacc5c5cd-podres\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.469689 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.469595 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/743c1770-a1db-46d7-a972-c52eacc5c5cd-lib-modules\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.469689 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.469644 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/743c1770-a1db-46d7-a972-c52eacc5c5cd-sys\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.469689 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.469644 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/743c1770-a1db-46d7-a972-c52eacc5c5cd-proc\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.469689 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.469683 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/743c1770-a1db-46d7-a972-c52eacc5c5cd-podres\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.475663 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.475640 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-l72wf_4eae3f77-21e5-4515-9502-c42a046e80b4/volume-data-source-validator/0.log" Sep 10 12:24:29.477968 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.477949 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xq69\" (UniqueName: \"kubernetes.io/projected/743c1770-a1db-46d7-a972-c52eacc5c5cd-kube-api-access-5xq69\") pod \"perf-node-gather-daemonset-f69lf\" (UID: \"743c1770-a1db-46d7-a972-c52eacc5c5cd\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.612907 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.612838 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:29.882319 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:29.882298 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf"] Sep 10 12:24:29.884482 ip-10-0-133-86 kubenswrapper[2563]: W0910 12:24:29.884459 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod743c1770_a1db_46d7_a972_c52eacc5c5cd.slice/crio-2e444e62b3e23f41863635d851876f5ba04518b51fb4914c76fb2994c0f5b79f WatchSource:0}: Error finding container 2e444e62b3e23f41863635d851876f5ba04518b51fb4914c76fb2994c0f5b79f: Status 404 returned error can't find the container with id 2e444e62b3e23f41863635d851876f5ba04518b51fb4914c76fb2994c0f5b79f Sep 10 12:24:30.560069 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:30.560025 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fhp57_3b7326e5-af04-42de-bfcd-b04612763113/dns/0.log" Sep 10 12:24:30.583393 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:30.583370 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fhp57_3b7326e5-af04-42de-bfcd-b04612763113/kube-rbac-proxy/0.log" Sep 10 12:24:30.677847 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:30.677821 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fhqgx_332fde89-b3a7-47d8-a0ae-ed81cd1d3a09/dns-node-resolver/0.log" Sep 10 12:24:30.748796 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:30.748766 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" event={"ID":"743c1770-a1db-46d7-a972-c52eacc5c5cd","Type":"ContainerStarted","Data":"bcb56133aa4b8ef099c312524542a13c5fa6ee8d32b1dfec3ff40621be96562f"} Sep 10 12:24:30.748939 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:30.748816 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" event={"ID":"743c1770-a1db-46d7-a972-c52eacc5c5cd","Type":"ContainerStarted","Data":"2e444e62b3e23f41863635d851876f5ba04518b51fb4914c76fb2994c0f5b79f"} Sep 10 12:24:30.748939 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:30.748881 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:30.766714 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:30.766673 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" podStartSLOduration=1.766659208 podStartE2EDuration="1.766659208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:24:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:24:30.764867367 +0000 UTC m=+931.695169285" watchObservedRunningTime="2026-09-10 12:24:30.766659208 +0000 UTC m=+931.696961124" Sep 10 12:24:31.242178 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:31.242153 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-95pgz_29703f37-ff31-4fd2-8357-2978267cf4dc/node-ca/0.log" Sep 10 12:24:32.234807 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:32.234773 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr_60b01cce-857d-4705-9173-613430f95141/istio-proxy/0.log" Sep 10 12:24:32.297824 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:32.297795 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rtnrn_a19ca223-058e-4f9f-ac08-ea855b002a6f/discovery/0.log" Sep 10 12:24:32.371260 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:32.371235 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fv45v_ff825bce-69db-42f9-abcf-1dd28885b5cc/istio-proxy/1.log" Sep 10 12:24:32.372235 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:32.372213 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fv45v_ff825bce-69db-42f9-abcf-1dd28885b5cc/istio-proxy/0.log" Sep 10 12:24:32.442426 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:32.442395 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-686b5bf69d-pmhrm_de72c6f8-1f0d-4aaa-b0ec-ae75249388e2/router/0.log" Sep 10 12:24:33.067666 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:33.067635 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jp47d_f06abec5-e894-4483-b88a-3c28655e00fe/serve-healthcheck-canary/0.log" Sep 10 12:24:33.771662 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:33.771631 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6fxj_4419ae7d-bf51-4006-8c9f-dc0f3846de32/kube-rbac-proxy/0.log" Sep 10 12:24:33.805890 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:33.805863 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6fxj_4419ae7d-bf51-4006-8c9f-dc0f3846de32/exporter/0.log" Sep 10 12:24:33.841100 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:33.841073 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6fxj_4419ae7d-bf51-4006-8c9f-dc0f3846de32/extractor/0.log" Sep 10 12:24:36.188263 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:36.188238 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75f74b49-kll7f_0a97f2a0-a031-45c3-962c-2e8734dbcff6/manager/0.log" Sep 10 12:24:36.207572 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:36.207552 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75f74b49-kll7f_0a97f2a0-a031-45c3-962c-2e8734dbcff6/copy-manifests/0.log" Sep 10 12:24:36.763636 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:36.763596 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-f69lf" Sep 10 12:24:37.503031 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:37.502998 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86cfb8b7dd-44vvr_4764d736-7f09-4013-848a-75e07ba8f28f/manager/0.log" Sep 10 12:24:37.576105 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:37.576074 2563 scope.go:117] "RemoveContainer" containerID="fb11182dcfc232879d4a24fa2aaadb060be0a4a724ebec975cc0dfeb0afab9df" Sep 10 12:24:37.576297 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:24:37.576245 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p_llm(40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-krg4p" podUID="40f1f61a-ab8f-4f8b-a4bf-58f0de0522fd" Sep 10 12:24:39.326523 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:39.326458 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr_60b01cce-857d-4705-9173-613430f95141/istio-proxy/0.log" Sep 10 12:24:39.387119 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:39.387072 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rtnrn_a19ca223-058e-4f9f-ac08-ea855b002a6f/discovery/0.log" Sep 10 12:24:39.478545 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:39.478520 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fv45v_ff825bce-69db-42f9-abcf-1dd28885b5cc/istio-proxy/1.log" Sep 10 12:24:39.479082 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:39.479065 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fv45v_ff825bce-69db-42f9-abcf-1dd28885b5cc/istio-proxy/0.log" Sep 10 12:24:39.527325 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:39.527299 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-686b5bf69d-pmhrm_de72c6f8-1f0d-4aaa-b0ec-ae75249388e2/router/0.log" Sep 10 12:24:39.577401 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:39.577341 2563 scope.go:117] "RemoveContainer" containerID="9e36b50c6941ef6d306f36e2ec18d375c97651a51057184722c5798f2fd769ac" Sep 10 12:24:39.577522 ip-10-0-133-86 kubenswrapper[2563]: E0910 12:24:39.577505 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-5mlxx_llm(1371354b-113f-48ea-a32f-f0944c7c00ec)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-5mlxx" podUID="1371354b-113f-48ea-a32f-f0944c7c00ec" Sep 10 12:24:40.709891 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:40.709863 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-g5zzr_60b01cce-857d-4705-9173-613430f95141/istio-proxy/0.log" Sep 10 12:24:40.768440 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:40.768410 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rtnrn_a19ca223-058e-4f9f-ac08-ea855b002a6f/discovery/0.log" Sep 10 12:24:40.825441 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:40.825369 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fv45v_ff825bce-69db-42f9-abcf-1dd28885b5cc/istio-proxy/1.log" Sep 10 12:24:40.827314 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:40.827284 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fv45v_ff825bce-69db-42f9-abcf-1dd28885b5cc/istio-proxy/0.log" Sep 10 12:24:40.896225 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:40.896201 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-686b5bf69d-pmhrm_de72c6f8-1f0d-4aaa-b0ec-ae75249388e2/router/0.log" Sep 10 12:24:43.344783 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:43.344751 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-m8q84_34a07fb0-9069-4bb6-afb4-e0c5d85e71b6/migrator/0.log" Sep 10 12:24:43.367091 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:43.367068 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-m8q84_34a07fb0-9069-4bb6-afb4-e0c5d85e71b6/graceful-termination/0.log" Sep 10 12:24:44.890325 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:44.890296 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z2dk_48d6e21d-93d7-4316-a6e4-d3cf1a87979d/kube-multus-additional-cni-plugins/0.log" Sep 10 12:24:44.913359 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:44.913332 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z2dk_48d6e21d-93d7-4316-a6e4-d3cf1a87979d/egress-router-binary-copy/0.log" Sep 10 12:24:44.939972 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:44.939950 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z2dk_48d6e21d-93d7-4316-a6e4-d3cf1a87979d/cni-plugins/0.log" Sep 10 12:24:44.960356 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:44.960337 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z2dk_48d6e21d-93d7-4316-a6e4-d3cf1a87979d/bond-cni-plugin/0.log" Sep 10 12:24:44.980812 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:44.980788 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z2dk_48d6e21d-93d7-4316-a6e4-d3cf1a87979d/routeoverride-cni/0.log" Sep 10 12:24:45.005827 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:45.005805 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z2dk_48d6e21d-93d7-4316-a6e4-d3cf1a87979d/whereabouts-cni-bincopy/0.log" Sep 10 12:24:45.038113 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:45.038093 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z2dk_48d6e21d-93d7-4316-a6e4-d3cf1a87979d/whereabouts-cni/0.log" Sep 10 12:24:45.495834 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:45.495801 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v2k8h_cb177a6e-8da1-4dd5-8932-89846403bc31/kube-multus/0.log" Sep 10 12:24:45.620661 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:45.620557 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hmnrj_d0707d93-ef7a-4969-9d05-9ec91e8f7e4b/network-metrics-daemon/0.log" Sep 10 12:24:45.641573 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:45.641548 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hmnrj_d0707d93-ef7a-4969-9d05-9ec91e8f7e4b/kube-rbac-proxy/0.log" Sep 10 12:24:46.505586 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:46.505546 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-controller/0.log" Sep 10 12:24:46.523031 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:46.522978 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-acl-logging/1.log" Sep 10 12:24:46.523284 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:46.523170 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovn-acl-logging/0.log" Sep 10 12:24:46.545152 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:46.545127 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/kube-rbac-proxy-node/0.log" Sep 10 12:24:46.570310 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:46.570284 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 12:24:46.588957 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:46.588931 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/northd/0.log" Sep 10 12:24:46.614988 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:46.614965 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/nbdb/0.log" Sep 10 12:24:46.635765 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:46.635743 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/sbdb/0.log" Sep 10 12:24:46.690048 ip-10-0-133-86 kubenswrapper[2563]: I0910 12:24:46.690017 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dzmb_7d8f2f44-03ac-4f00-82d2-49234f75482c/ovnkube-controller/0.log"