Jul 07 23:11:20.665794 ip-10-0-130-40 systemd[1]: Starting Kubernetes Kubelet... Jul 07 23:11:21.054468 ip-10-0-130-40 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 23:11:21.054468 ip-10-0-130-40 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 23:11:21.054468 ip-10-0-130-40 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 23:11:21.054468 ip-10-0-130-40 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 23:11:21.054468 ip-10-0-130-40 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 23:11:21.055387 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.055302 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 23:11:21.059023 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059008 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 23:11:21.059023 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059023 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059027 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059031 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059034 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059038 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059040 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059043 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059046 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059048 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059051 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059053 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059055 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059058 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059060 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059063 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059065 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059068 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059070 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059078 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 23:11:21.059087 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059082 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059091 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059094 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059097 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059100 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059103 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059105 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059108 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059110 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059113 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059116 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059118 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059121 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059123 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059125 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059128 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059130 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059133 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059135 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059138 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 23:11:21.059552 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059141 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059143 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059146 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059148 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059150 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059153 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059155 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059157 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059160 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059162 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059164 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059168 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059171 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059175 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059178 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059181 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059184 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059186 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059189 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 23:11:21.060028 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059191 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059194 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059196 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059199 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059201 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059203 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059207 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059209 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059211 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059214 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059216 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059219 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059223 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059227 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059229 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059232 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059234 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059236 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059239 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059241 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 23:11:21.060534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059244 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059246 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059248 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059251 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059253 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059255 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059258 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059262 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059265 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059268 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059270 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059273 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059275 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059278 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059280 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059282 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059285 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059287 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059290 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.059292 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060002 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 23:11:21.061026 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060009 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060012 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060014 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060017 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060020 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060023 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060026 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060029 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060032 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060034 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060037 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060039 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060042 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060044 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060047 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060049 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060054 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060058 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060062 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060065 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 23:11:21.061534 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060068 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060071 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060074 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060076 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060079 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060082 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060084 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060087 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060089 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060091 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060094 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060096 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060098 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060102 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060106 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060108 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060111 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060114 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060117 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 23:11:21.062037 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060119 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060121 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060124 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060126 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060128 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060131 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060133 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060135 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060138 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060140 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060143 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060146 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060148 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060151 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060153 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060156 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060158 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060160 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060163 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060165 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 23:11:21.062494 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060167 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060169 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060172 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060174 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060176 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060179 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060182 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060184 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060189 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060192 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060195 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060199 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060201 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060204 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060207 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060210 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060212 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060215 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060218 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 23:11:21.062993 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060221 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060223 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060226 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060229 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060232 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060234 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060237 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060239 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060242 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060244 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060247 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060249 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060253 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060255 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060258 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060260 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060263 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060265 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060268 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060270 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 23:11:21.063447 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060662 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060667 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060670 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060672 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060675 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060678 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060681 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060683 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060686 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060688 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060691 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060693 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060696 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060698 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060700 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060707 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060711 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060714 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060717 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 23:11:21.063950 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060720 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060722 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060725 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060727 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060730 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060733 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060735 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060738 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060740 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060743 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060747 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060750 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060754 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060756 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060759 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060762 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060765 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060768 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060771 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060774 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 23:11:21.064423 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060777 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060779 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060782 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060784 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060787 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060789 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060791 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060794 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060798 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060801 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060803 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060806 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060808 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060811 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060814 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060816 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060819 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060821 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060824 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 23:11:21.064920 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060826 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060828 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060832 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060834 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060836 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060839 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060841 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060843 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060846 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060848 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060851 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060853 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060856 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060858 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060861 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060865 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060869 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060871 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060874 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 23:11:21.065416 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060876 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060879 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060882 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060885 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060887 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060890 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060892 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060895 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060897 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060900 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060902 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060904 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060907 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060909 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060912 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060914 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060916 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060918 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060921 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060923 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 23:11:21.066000 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060925 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.060927 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061000 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061007 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061014 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061021 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061028 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061033 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061040 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061045 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061048 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061051 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061055 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061058 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061061 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061064 2576 flags.go:64] FLAG: --cgroup-root="" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061067 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061070 2576 flags.go:64] FLAG: --client-ca-file="" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061072 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061075 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061080 2576 flags.go:64] FLAG: --cluster-domain="" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061083 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061086 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061089 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 23:11:21.066481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061092 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061095 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061098 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061101 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061104 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061107 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061110 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061113 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061116 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061119 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061123 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061126 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061128 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061131 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061134 2576 flags.go:64] FLAG: --enable-server="true" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061138 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061142 2576 flags.go:64] FLAG: --event-burst="100" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061145 2576 flags.go:64] FLAG: --event-qps="50" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061148 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061151 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061153 2576 flags.go:64] FLAG: --eviction-hard="" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061157 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061174 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061178 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061182 2576 flags.go:64] FLAG: --eviction-soft="" Jul 07 23:11:21.067075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061185 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061188 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061191 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061193 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061196 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061199 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061202 2576 flags.go:64] FLAG: --feature-gates="" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061205 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061208 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061211 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061214 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061217 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061220 2576 flags.go:64] FLAG: --help="false" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061222 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061225 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061228 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061230 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061234 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061237 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061240 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061242 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061245 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061250 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 23:11:21.067693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061253 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061256 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061258 2576 flags.go:64] FLAG: --kube-reserved="" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061261 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061264 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061266 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061269 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061272 2576 flags.go:64] FLAG: --lock-file="" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061275 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061278 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061280 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061286 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061288 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061291 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061294 2576 flags.go:64] FLAG: --logging-format="text" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061296 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061300 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061303 2576 flags.go:64] FLAG: --manifest-url="" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061305 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061310 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061312 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061316 2576 flags.go:64] FLAG: --max-pods="110" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061319 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061322 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061324 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 23:11:21.068269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061327 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061330 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061332 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061335 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061342 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061345 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061349 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061352 2576 flags.go:64] FLAG: --pod-cidr="" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061355 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061361 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061364 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061367 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061369 2576 flags.go:64] FLAG: --port="10250" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061372 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061375 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b6e4261b83fcc7d7" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061378 2576 flags.go:64] FLAG: --qos-reserved="" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061381 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061384 2576 flags.go:64] FLAG: --register-node="true" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061387 2576 flags.go:64] FLAG: --register-with-taints="" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061390 2576 flags.go:64] FLAG: --registry-burst="10" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061393 2576 flags.go:64] FLAG: --registry-qps="5" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061395 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061398 2576 flags.go:64] FLAG: --reserved-memory="" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061401 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061404 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 23:11:21.068928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061407 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061410 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061412 2576 flags.go:64] FLAG: --runonce="false" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061415 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061418 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061421 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061423 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061426 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061433 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061437 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061439 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061442 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061445 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061448 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061454 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061457 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061461 2576 flags.go:64] FLAG: --system-cgroups="" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061463 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061468 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061471 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061478 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061482 2576 flags.go:64] FLAG: --tls-min-version="" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061485 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061488 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061491 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 23:11:21.069542 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061493 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061496 2576 flags.go:64] FLAG: --v="2" Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061500 2576 flags.go:64] FLAG: --version="false" Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061504 2576 flags.go:64] FLAG: --vmodule="" Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061507 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.061510 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061667 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061672 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061675 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061678 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061681 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061684 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061686 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061689 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061691 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061694 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061696 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061699 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061701 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061703 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061706 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 23:11:21.070153 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061709 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061712 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061715 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061718 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061720 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061723 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061727 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061729 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061732 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061735 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061738 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061740 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061743 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061745 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061747 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061750 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061753 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061755 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061757 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 23:11:21.070691 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061760 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061762 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061765 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061767 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061769 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061772 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061774 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061777 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061779 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061782 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061785 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061787 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061789 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061793 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061797 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061801 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061804 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061809 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061812 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061816 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 23:11:21.071150 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061818 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061822 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061824 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061827 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061829 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061832 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061834 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061836 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061839 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061841 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061844 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061846 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061849 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061851 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061853 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061856 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061858 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061861 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061864 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061866 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 23:11:21.071657 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061868 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061871 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061873 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061875 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061878 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061882 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061884 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061887 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061890 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061892 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061895 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061899 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061901 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061904 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061906 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061909 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061911 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061913 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061917 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061920 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 23:11:21.072135 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061924 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061926 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061929 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061931 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.061934 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.062681 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.069211 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.069227 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.069241 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.069251 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069315 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069320 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069323 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069326 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069330 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 23:11:21.072658 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069333 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069335 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069338 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069341 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069343 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069346 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069348 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069351 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069354 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069356 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069359 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069361 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069363 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069366 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069368 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069371 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069373 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069375 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069378 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 23:11:21.073031 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069380 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069383 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069385 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069387 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069390 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069394 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069397 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069400 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069402 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069404 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069407 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069409 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069411 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069414 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069416 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069420 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069422 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069425 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069429 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069433 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 23:11:21.073500 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069435 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069439 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069443 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069447 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069449 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069452 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069455 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069458 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069460 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069463 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069466 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069468 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069470 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069473 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069475 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069478 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069480 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069483 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069486 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 23:11:21.073991 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069489 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069491 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069494 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069496 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069499 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069501 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069503 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069506 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069508 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069511 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069513 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069529 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069531 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069534 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069536 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069539 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069543 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069546 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069549 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069552 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 23:11:21.074499 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069555 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069558 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069561 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069564 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069566 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069569 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069571 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069574 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069576 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069579 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069581 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069584 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069587 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069590 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069592 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 23:11:21.075007 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069594 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.069599 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069719 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069725 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069728 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069730 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069733 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069735 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069738 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069742 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069746 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069749 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069751 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069754 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 23:11:21.075364 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069757 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069759 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069762 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069764 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069766 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069769 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069771 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069774 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069776 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069779 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069781 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069783 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069786 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069788 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069791 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069793 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069796 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069798 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069801 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069803 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 23:11:21.075741 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069806 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069808 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069810 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069813 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069815 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069817 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069820 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069822 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069825 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069827 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069829 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069832 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069834 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069836 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069839 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069841 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069843 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069846 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069848 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069851 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 23:11:21.076307 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069853 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069855 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069858 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069860 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069863 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069865 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069867 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069870 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069873 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069875 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069878 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069880 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069882 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069885 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069887 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069889 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069892 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069894 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069896 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069899 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 23:11:21.076848 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069901 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069903 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069906 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069908 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069911 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069914 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069917 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069920 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069922 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069925 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069927 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069929 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069932 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069934 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069936 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069939 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069941 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069945 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069948 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 23:11:21.077485 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069951 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069954 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069957 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069960 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069962 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069965 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069967 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:21.069969 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.069974 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.070066 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.072116 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.073388 2576 server.go:1019] "Starting client certificate rotation" Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.073492 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 23:11:21.078059 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.073542 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 23:11:21.078463 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.077624 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 23:11:21.081331 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.081310 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 23:11:21.093053 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.093032 2576 log.go:25] "Validated CRI v1 runtime API" Jul 07 23:11:21.095054 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.095041 2576 log.go:25] "Validated CRI v1 image API" Jul 07 23:11:21.096498 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.096475 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 23:11:21.098770 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.098752 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8c1d2626-0ade-40be-9024-99d873284557:/dev/nvme0n1p3 de4a4f39-9cd7-40ed-a806-ddd636dd4ccd:/dev/nvme0n1p4] Jul 07 23:11:21.098846 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.098770 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 23:11:21.104726 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.104611 2576 manager.go:216] Machine: {Timestamp:2026-07-07 23:11:21.102403816 +0000 UTC m=+0.323838156 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098023 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec239965b604641a57b4991ad8ae8992 SystemUUID:ec239965-b604-641a-57b4-991ad8ae8992 BootID:eb7e06e7-1c80-43fd-be81-1a3f9a6973e9 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:48:bd:40:dc:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:48:bd:40:dc:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:49:ad:26:fd:c4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 23:11:21.104726 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.104719 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 23:11:21.104862 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.104795 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 23:11:21.105181 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.105166 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 23:11:21.108023 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.107996 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 23:11:21.108193 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.108028 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-40.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 23:11:21.109427 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.109415 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 23:11:21.109489 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.109434 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 23:11:21.109489 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.109445 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 23:11:21.110156 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.110145 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 23:11:21.111414 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.111402 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 23:11:21.115238 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.115224 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 07 23:11:21.115369 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.115358 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 23:11:21.115434 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.115396 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 07 23:11:21.115434 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.115409 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 23:11:21.115434 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.115424 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 23:11:21.115577 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.115439 2576 kubelet.go:398] "Adding apiserver pod source" Jul 07 23:11:21.115577 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.115451 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 23:11:21.115850 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.115836 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 23:11:21.115912 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.115860 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 23:11:21.118136 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.118110 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 23:11:21.120776 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.120757 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 23:11:21.120861 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.120803 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 23:11:21.121952 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.121932 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 23:11:21.122022 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.121959 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 23:11:21.122022 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.121969 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 23:11:21.122022 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.121977 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 23:11:21.122022 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.121996 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 23:11:21.122022 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.122005 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 23:11:21.122022 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.122017 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 23:11:21.122022 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.122025 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 23:11:21.122289 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.122041 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 23:11:21.122289 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.122049 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 23:11:21.122289 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.122061 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 23:11:21.122289 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.122070 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 23:11:21.123330 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.123312 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 23:11:21.123634 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.123620 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 23:11:21.124366 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.124342 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 23:11:21.124366 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.124347 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-40.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 23:11:21.126232 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.126216 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9trnq" Jul 07 23:11:21.127034 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.127020 2576 server.go:1268] "Started kubelet" Jul 07 23:11:21.127099 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.127077 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 23:11:21.127215 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.127183 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 23:11:21.127271 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.127232 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 23:11:21.127416 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.127398 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-40.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 23:11:21.128004 ip-10-0-130-40 systemd[1]: Started Kubernetes Kubelet. Jul 07 23:11:21.128415 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.128349 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 23:11:21.129279 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.129266 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 07 23:11:21.132019 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.131994 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 23:11:21.133674 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.133659 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 23:11:21.133746 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.133670 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 23:11:21.133746 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.133707 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9trnq" Jul 07 23:11:21.133852 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.133757 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:21.134179 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.134159 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 23:11:21.134271 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.134206 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 23:11:21.134271 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.134219 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 23:11:21.134379 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.134309 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 07 23:11:21.134379 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.134318 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 07 23:11:21.134449 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.134428 2576 factory.go:55] Registering systemd factory Jul 07 23:11:21.134449 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.134441 2576 factory.go:223] Registration of the systemd container factory successfully Jul 07 23:11:21.134749 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.134733 2576 factory.go:153] Registering CRI-O factory Jul 07 23:11:21.134749 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.134750 2576 factory.go:223] Registration of the crio container factory successfully Jul 07 23:11:21.134883 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.134800 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 23:11:21.134883 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.134827 2576 factory.go:103] Registering Raw factory Jul 07 23:11:21.134883 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.134843 2576 manager.go:1196] Started watching for new ooms in manager Jul 07 23:11:21.135323 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.134306 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-40.ec2.internal.18c024c5099a70b1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-40.ec2.internal,UID:ip-10-0-130-40.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-40.ec2.internal,},FirstTimestamp:2026-07-07 23:11:21.126990001 +0000 UTC m=+0.348424412,LastTimestamp:2026-07-07 23:11:21.126990001 +0000 UTC m=+0.348424412,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-40.ec2.internal,}" Jul 07 23:11:21.135421 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.135351 2576 manager.go:349] Starting recovery of all containers Jul 07 23:11:21.136784 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.136684 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-40.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 23:11:21.136784 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.136785 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 23:11:21.146606 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.146433 2576 manager.go:354] Recovery completed Jul 07 23:11:21.152393 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.152381 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:11:21.154189 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.154173 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:11:21.154267 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.154207 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:11:21.154267 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.154220 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:11:21.154760 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.154746 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:11:21.154830 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.154750 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 23:11:21.154830 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.154784 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 23:11:21.154830 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.154803 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 07 23:11:21.155290 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.155275 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:11:21.155341 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.155306 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:11:21.155341 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.155327 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:11:21.156891 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.156878 2576 policy_none.go:49] "None policy: Start" Jul 07 23:11:21.156946 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.156897 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 23:11:21.156946 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.156911 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 23:11:21.158842 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.158828 2576 policy_none.go:47] "Start" Jul 07 23:11:21.203628 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.203615 2576 manager.go:337] "Starting Device Plugin manager" Jul 07 23:11:21.203690 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.203646 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 23:11:21.203690 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.203656 2576 server.go:87] "Starting device plugin registration server" Jul 07 23:11:21.203893 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.203877 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 23:11:21.204003 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.203900 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 23:11:21.204003 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.203983 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 23:11:21.204166 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.204067 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 23:11:21.204166 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.204077 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 23:11:21.204531 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.204496 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 23:11:21.204596 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.204563 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:21.299080 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.299038 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 23:11:21.301215 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.300342 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 23:11:21.301215 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.300390 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 23:11:21.301215 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.300421 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 23:11:21.301215 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.300460 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 23:11:21.302995 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.302974 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 23:11:21.304365 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.304351 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:11:21.305110 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.305062 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:11:21.305110 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.305091 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:11:21.305110 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.305100 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:11:21.305286 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.305122 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.310959 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.310945 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.311016 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.310966 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-40.ec2.internal\": node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:21.323486 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.323468 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:21.400902 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.400856 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal"] Jul 07 23:11:21.401030 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.400948 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:11:21.401832 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.401815 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:11:21.401923 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.401848 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:11:21.401923 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.401860 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:11:21.404184 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.404169 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:11:21.404290 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.404277 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.404333 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.404303 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:11:21.404885 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.404870 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:11:21.404966 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.404902 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:11:21.404966 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.404875 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:11:21.404966 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.404916 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:11:21.404966 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.404944 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:11:21.404966 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.404956 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:11:21.407066 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.407051 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.407146 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.407080 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 23:11:21.409630 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.409607 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientMemory" Jul 07 23:11:21.409630 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.409629 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 23:11:21.409754 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.409637 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeHasSufficientPID" Jul 07 23:11:21.422066 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.422047 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-40.ec2.internal\" not found" node="ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.423613 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.423600 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:21.427208 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.427194 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-40.ec2.internal\" not found" node="ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.524231 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.524207 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:21.535548 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.535509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0090339d23883e7cfb9dc4bf51bde46d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal\" (UID: \"0090339d23883e7cfb9dc4bf51bde46d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.535632 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.535553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0090339d23883e7cfb9dc4bf51bde46d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal\" (UID: \"0090339d23883e7cfb9dc4bf51bde46d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.535632 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.535572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/702fecf07f3eb2502132a6413ffba9f0-config\") pod \"kube-apiserver-proxy-ip-10-0-130-40.ec2.internal\" (UID: \"702fecf07f3eb2502132a6413ffba9f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.624975 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.624898 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:21.636239 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.636215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0090339d23883e7cfb9dc4bf51bde46d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal\" (UID: \"0090339d23883e7cfb9dc4bf51bde46d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.636300 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.636243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0090339d23883e7cfb9dc4bf51bde46d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal\" (UID: \"0090339d23883e7cfb9dc4bf51bde46d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.636300 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.636260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/702fecf07f3eb2502132a6413ffba9f0-config\") pod \"kube-apiserver-proxy-ip-10-0-130-40.ec2.internal\" (UID: \"702fecf07f3eb2502132a6413ffba9f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.636363 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.636301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/702fecf07f3eb2502132a6413ffba9f0-config\") pod \"kube-apiserver-proxy-ip-10-0-130-40.ec2.internal\" (UID: \"702fecf07f3eb2502132a6413ffba9f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.636363 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.636324 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0090339d23883e7cfb9dc4bf51bde46d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal\" (UID: \"0090339d23883e7cfb9dc4bf51bde46d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.636363 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.636301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0090339d23883e7cfb9dc4bf51bde46d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal\" (UID: \"0090339d23883e7cfb9dc4bf51bde46d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.724428 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.724383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.725483 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.725462 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:21.730346 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.730331 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" Jul 07 23:11:21.825791 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.825756 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:21.926291 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:21.926216 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:21.937731 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:21.937707 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 23:11:22.027284 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:22.027253 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:22.073476 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.073454 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 23:11:22.074058 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.073619 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 23:11:22.074058 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.073633 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 23:11:22.127857 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:22.127822 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:22.138771 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.138741 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 23:06:21 +0000 UTC" deadline="2027-12-10 03:08:56.191954707 +0000 UTC" Jul 07 23:11:22.138847 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.138770 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12483h57m34.053188044s" Jul 07 23:11:22.228975 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:22.228935 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:22.329332 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:22.329298 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:22.329779 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:22.329755 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0090339d23883e7cfb9dc4bf51bde46d.slice/crio-355bb7d98e8adadcaf5db3eaac99c8cadd05a6e02d9aa82c4639d3e731f2e739 WatchSource:0}: Error finding container 355bb7d98e8adadcaf5db3eaac99c8cadd05a6e02d9aa82c4639d3e731f2e739: Status 404 returned error can't find the container with id 355bb7d98e8adadcaf5db3eaac99c8cadd05a6e02d9aa82c4639d3e731f2e739 Jul 07 23:11:22.334465 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.334445 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 23:11:22.340295 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:22.340274 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod702fecf07f3eb2502132a6413ffba9f0.slice/crio-5ed911e636396cccae1611bdff3a1546cdc68c086cbf88c0ee252680a9ba1321 WatchSource:0}: Error finding container 5ed911e636396cccae1611bdff3a1546cdc68c086cbf88c0ee252680a9ba1321: Status 404 returned error can't find the container with id 5ed911e636396cccae1611bdff3a1546cdc68c086cbf88c0ee252680a9ba1321 Jul 07 23:11:22.431125 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:22.431079 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:22.533772 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:22.533671 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:22.596814 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.596785 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 23:11:22.633898 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:22.633857 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-40.ec2.internal\" not found" Jul 07 23:11:22.636179 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.636160 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 23:11:22.734768 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.734728 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" Jul 07 23:11:22.748251 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.748224 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 23:11:22.749566 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.749542 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" Jul 07 23:11:22.759156 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.759131 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 23:11:22.960266 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:22.960188 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 23:11:23.116435 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.116396 2576 apiserver.go:52] "Watching apiserver" Jul 07 23:11:23.131249 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.131219 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 23:11:23.132683 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.132659 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal","openshift-multus/multus-additional-cni-plugins-tvk6j","kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal","openshift-dns/node-resolver-5zw6t","openshift-multus/multus-n9tht","openshift-multus/network-metrics-daemon-q9d2t","openshift-network-diagnostics/network-check-target-65tk4","openshift-network-operator/iptables-alerter-m7dtr","openshift-ovn-kubernetes/ovnkube-node-7f2fb","kube-system/global-pull-secret-syncer-dxqh9","kube-system/konnectivity-agent-s2dzv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5","openshift-cluster-node-tuning-operator/tuned-zrfmd","openshift-image-registry/node-ca-4nkdt"] Jul 07 23:11:23.134636 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.134612 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 23:11:23.135326 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.135298 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:23.135439 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.135381 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:23.137730 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.137706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.140097 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.140075 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4nkdt" Jul 07 23:11:23.140659 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.140637 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 23:11:23.140980 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.140953 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 23:11:23.140980 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.140964 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zxjlb\"" Jul 07 23:11:23.142309 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.142291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5zw6t" Jul 07 23:11:23.143652 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.143153 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 23:11:23.143652 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.143186 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 23:11:23.143652 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.143424 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 23:11:23.143652 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.143477 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nnsqb\"" Jul 07 23:11:23.144100 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.144065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkwpx\" (UniqueName: \"kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx\") pod \"network-check-target-65tk4\" (UID: \"ac6868f6-fc8f-47c0-b103-7b366bb3844e\") " pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:23.145631 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.144996 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.145961 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.145938 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 23:11:23.146057 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.146041 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 23:11:23.146515 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.146247 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nrsrg\"" Jul 07 23:11:23.147873 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.147856 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:23.147980 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.147925 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:23.148514 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.148492 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 23:11:23.148624 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.148501 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 23:11:23.148697 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.148630 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 23:11:23.148791 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.148771 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 23:11:23.148847 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.148501 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cvsvm\"" Jul 07 23:11:23.149747 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.149728 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 23:11:23.150567 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.150516 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.153123 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.153104 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m7dtr" Jul 07 23:11:23.153666 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.153648 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 23:11:23.154465 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.154444 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 23:11:23.154780 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.154759 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 23:11:23.154972 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.154954 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c4b8m\"" Jul 07 23:11:23.154972 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.154961 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 23:11:23.155108 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.155038 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 23:11:23.155108 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.155038 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 23:11:23.155661 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.155643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.157779 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.157747 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 23:11:23.157870 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.157848 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 23:11:23.157933 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.157848 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 23:11:23.158026 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.158006 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-srpxq\"" Jul 07 23:11:23.158426 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.158406 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:23.158504 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.158477 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:23.158654 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.158634 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2kx9s\"" Jul 07 23:11:23.158725 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.158685 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 23:11:23.158725 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.158693 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 23:11:23.160974 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.160957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s2dzv" Jul 07 23:11:23.163559 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.163538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.163839 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.163820 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kxj2z\"" Jul 07 23:11:23.163839 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.163834 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 23:11:23.164134 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.164109 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 23:11:23.166745 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.166699 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 23:11:23.166745 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.166741 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 23:11:23.167396 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.167373 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 23:11:23.167602 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.167577 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xblpv\"" Jul 07 23:11:23.174970 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.174940 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j59fl" Jul 07 23:11:23.183064 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.183043 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j59fl" Jul 07 23:11:23.235250 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.235222 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 23:11:23.244271 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c54f1e0-13db-419a-842f-bc32ca77bea3-konnectivity-ca\") pod \"konnectivity-agent-s2dzv\" (UID: \"7c54f1e0-13db-419a-842f-bc32ca77bea3\") " pod="kube-system/konnectivity-agent-s2dzv" Jul 07 23:11:23.244384 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwpx\" (UniqueName: \"kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx\") pod \"network-check-target-65tk4\" (UID: \"ac6868f6-fc8f-47c0-b103-7b366bb3844e\") " pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:23.244384 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-cnibin\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.244513 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-var-lib-cni-bin\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.244513 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-etc-kubernetes\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.244513 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9583ff81-a722-44f2-8cce-11ad80ef4ca5-system-cni-dir\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.244513 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244493 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9tkn\" (UniqueName: \"kubernetes.io/projected/9583ff81-a722-44f2-8cce-11ad80ef4ca5-kube-api-access-x9tkn\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.244796 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-socket-dir\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.244796 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-var-lib-cni-multus\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.244796 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-node-log\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.244796 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-ovnkube-config\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.244796 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-ovnkube-script-lib\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.244796 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9583ff81-a722-44f2-8cce-11ad80ef4ca5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.244796 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-var-lib-kubelet\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.244796 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c54f1e0-13db-419a-842f-bc32ca77bea3-agent-certs\") pod \"konnectivity-agent-s2dzv\" (UID: \"7c54f1e0-13db-419a-842f-bc32ca77bea3\") " pod="kube-system/konnectivity-agent-s2dzv" Jul 07 23:11:23.244796 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-device-dir\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.244796 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-run-netns\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-run-netns\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-run-ovn\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-cni-netd\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0f28df4-16eb-4de1-ac26-a54f20a2f998-kubelet-config\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244933 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-etc-selinux\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b24fbe48-6f49-4103-b35a-846f722f2eca-host\") pod \"node-ca-4nkdt\" (UID: \"b24fbe48-6f49-4103-b35a-846f722f2eca\") " pod="openshift-image-registry/node-ca-4nkdt" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.244979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-os-release\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245007 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-multus-socket-dir-parent\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-run-k8s-cni-cncf-io\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb69z\" (UniqueName: \"kubernetes.io/projected/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-kube-api-access-tb69z\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-kubernetes\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-sys\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245187 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptkqr\" (UniqueName: \"kubernetes.io/projected/b24fbe48-6f49-4103-b35a-846f722f2eca-kube-api-access-ptkqr\") pod \"node-ca-4nkdt\" (UID: \"b24fbe48-6f49-4103-b35a-846f722f2eca\") " pod="openshift-image-registry/node-ca-4nkdt" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:23.245275 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0eec0bca-02bf-498a-a3bc-764a0a72ba71-iptables-alerter-script\") pod \"iptables-alerter-m7dtr\" (UID: \"0eec0bca-02bf-498a-a3bc-764a0a72ba71\") " pod="openshift-network-operator/iptables-alerter-m7dtr" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c48caac-7c6e-4842-b39f-49a10d508285-tmp\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjl2q\" (UniqueName: \"kubernetes.io/projected/3c48caac-7c6e-4842-b39f-49a10d508285-kube-api-access-cjl2q\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9583ff81-a722-44f2-8cce-11ad80ef4ca5-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fbb464bf-fb7f-4337-9e4d-60369b88912a-hosts-file\") pod \"node-resolver-5zw6t\" (UID: \"fbb464bf-fb7f-4337-9e4d-60369b88912a\") " pod="openshift-dns/node-resolver-5zw6t" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adbd9ef4-de60-4f88-9401-af3e65c1ba58-cni-binary-copy\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245420 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-hostroot\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-ovn-node-metrics-cert\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245499 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjbhc\" (UniqueName: \"kubernetes.io/projected/ed39aa44-68a5-4fa5-bf95-19f1b7084503-kube-api-access-sjbhc\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b24fbe48-6f49-4103-b35a-846f722f2eca-serviceca\") pod \"node-ca-4nkdt\" (UID: \"b24fbe48-6f49-4103-b35a-846f722f2eca\") " pod="openshift-image-registry/node-ca-4nkdt" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-var-lib-openvswitch\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-registration-dir\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-sys-fs\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-var-lib-kubelet\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-etc-openvswitch\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.245911 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-multus-cni-dir\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/adbd9ef4-de60-4f88-9401-af3e65c1ba58-multus-daemon-config\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9583ff81-a722-44f2-8cce-11ad80ef4ca5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-systemd\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh7td\" (UniqueName: \"kubernetes.io/projected/e0e9befa-834d-41aa-9c87-b573c269b87f-kube-api-access-bh7td\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-slash\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-sysctl-conf\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-run\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lltp\" (UniqueName: \"kubernetes.io/projected/fbb464bf-fb7f-4337-9e4d-60369b88912a-kube-api-access-2lltp\") pod \"node-resolver-5zw6t\" (UID: \"fbb464bf-fb7f-4337-9e4d-60369b88912a\") " pod="openshift-dns/node-resolver-5zw6t" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245935 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-multus-conf-dir\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-run-multus-certs\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.245980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6md8w\" (UniqueName: \"kubernetes.io/projected/adbd9ef4-de60-4f88-9401-af3e65c1ba58-kube-api-access-6md8w\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-log-socket\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9583ff81-a722-44f2-8cce-11ad80ef4ca5-cnibin\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-cni-bin\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.246517 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9583ff81-a722-44f2-8cce-11ad80ef4ca5-os-release\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbb464bf-fb7f-4337-9e4d-60369b88912a-tmp-dir\") pod \"node-resolver-5zw6t\" (UID: \"fbb464bf-fb7f-4337-9e4d-60369b88912a\") " pod="openshift-dns/node-resolver-5zw6t" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-systemd-units\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-run-openvswitch\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-env-overrides\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcl4j\" (UniqueName: \"kubernetes.io/projected/0eec0bca-02bf-498a-a3bc-764a0a72ba71-kube-api-access-tcl4j\") pod \"iptables-alerter-m7dtr\" (UID: \"0eec0bca-02bf-498a-a3bc-764a0a72ba71\") " pod="openshift-network-operator/iptables-alerter-m7dtr" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-sysconfig\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-sysctl-d\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-system-cni-dir\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0eec0bca-02bf-498a-a3bc-764a0a72ba71-host-slash\") pod \"iptables-alerter-m7dtr\" (UID: \"0eec0bca-02bf-498a-a3bc-764a0a72ba71\") " pod="openshift-network-operator/iptables-alerter-m7dtr" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-host\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c48caac-7c6e-4842-b39f-49a10d508285-etc-tuned\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-kubelet\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-run-systemd\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9583ff81-a722-44f2-8cce-11ad80ef4ca5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.247106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-modprobe-d\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.247679 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-lib-modules\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.247679 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.246428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0f28df4-16eb-4de1-ac26-a54f20a2f998-dbus\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:23.251071 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.251048 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:11:23.251159 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.251077 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:11:23.251159 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.251091 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vkwpx for pod openshift-network-diagnostics/network-check-target-65tk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:23.251245 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.251162 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx podName:ac6868f6-fc8f-47c0-b103-7b366bb3844e nodeName:}" failed. No retries permitted until 2026-07-07 23:11:23.751139173 +0000 UTC m=+2.972573505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vkwpx" (UniqueName: "kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx") pod "network-check-target-65tk4" (UID: "ac6868f6-fc8f-47c0-b103-7b366bb3844e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:23.307262 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.307207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" event={"ID":"702fecf07f3eb2502132a6413ffba9f0","Type":"ContainerStarted","Data":"5ed911e636396cccae1611bdff3a1546cdc68c086cbf88c0ee252680a9ba1321"} Jul 07 23:11:23.309477 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.309442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" event={"ID":"0090339d23883e7cfb9dc4bf51bde46d","Type":"ContainerStarted","Data":"355bb7d98e8adadcaf5db3eaac99c8cadd05a6e02d9aa82c4639d3e731f2e739"} Jul 07 23:11:23.346758 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.346726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjbhc\" (UniqueName: \"kubernetes.io/projected/ed39aa44-68a5-4fa5-bf95-19f1b7084503-kube-api-access-sjbhc\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.346758 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.346761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b24fbe48-6f49-4103-b35a-846f722f2eca-serviceca\") pod \"node-ca-4nkdt\" (UID: \"b24fbe48-6f49-4103-b35a-846f722f2eca\") " pod="openshift-image-registry/node-ca-4nkdt" Jul 07 23:11:23.346994 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.346780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-var-lib-openvswitch\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.346994 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.346795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-registration-dir\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.346994 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.346816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-sys-fs\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.346994 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.346892 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-sys-fs\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.346994 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.346920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-registration-dir\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.346994 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.346928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-var-lib-openvswitch\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.347243 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-var-lib-kubelet\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.347243 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-etc-openvswitch\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.347243 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.347243 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-multus-cni-dir\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.347243 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/adbd9ef4-de60-4f88-9401-af3e65c1ba58-multus-daemon-config\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.347243 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347168 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-etc-openvswitch\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.347243 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9583ff81-a722-44f2-8cce-11ad80ef4ca5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.347243 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-var-lib-kubelet\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.347243 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-systemd\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh7td\" (UniqueName: \"kubernetes.io/projected/e0e9befa-834d-41aa-9c87-b573c269b87f-kube-api-access-bh7td\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-slash\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347288 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b24fbe48-6f49-4103-b35a-846f722f2eca-serviceca\") pod \"node-ca-4nkdt\" (UID: \"b24fbe48-6f49-4103-b35a-846f722f2eca\") " pod="openshift-image-registry/node-ca-4nkdt" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-sysctl-conf\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-run\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lltp\" (UniqueName: \"kubernetes.io/projected/fbb464bf-fb7f-4337-9e4d-60369b88912a-kube-api-access-2lltp\") pod \"node-resolver-5zw6t\" (UID: \"fbb464bf-fb7f-4337-9e4d-60369b88912a\") " pod="openshift-dns/node-resolver-5zw6t" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347368 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-systemd\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-multus-conf-dir\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-run-multus-certs\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6md8w\" (UniqueName: \"kubernetes.io/projected/adbd9ef4-de60-4f88-9401-af3e65c1ba58-kube-api-access-6md8w\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-log-socket\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9583ff81-a722-44f2-8cce-11ad80ef4ca5-cnibin\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-cni-bin\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9583ff81-a722-44f2-8cce-11ad80ef4ca5-os-release\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347684 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-slash\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/adbd9ef4-de60-4f88-9401-af3e65c1ba58-multus-daemon-config\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9583ff81-a722-44f2-8cce-11ad80ef4ca5-cnibin\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.347877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-log-socket\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347894 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-sysctl-conf\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347915 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-run\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.347958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-multus-cni-dir\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348095 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-run-multus-certs\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348094 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-multus-conf-dir\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-cni-bin\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbb464bf-fb7f-4337-9e4d-60369b88912a-tmp-dir\") pod \"node-resolver-5zw6t\" (UID: \"fbb464bf-fb7f-4337-9e4d-60369b88912a\") " pod="openshift-dns/node-resolver-5zw6t" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9583ff81-a722-44f2-8cce-11ad80ef4ca5-os-release\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-systemd-units\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348236 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9583ff81-a722-44f2-8cce-11ad80ef4ca5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-run-openvswitch\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-systemd-units\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-env-overrides\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-run-openvswitch\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl4j\" (UniqueName: \"kubernetes.io/projected/0eec0bca-02bf-498a-a3bc-764a0a72ba71-kube-api-access-tcl4j\") pod \"iptables-alerter-m7dtr\" (UID: \"0eec0bca-02bf-498a-a3bc-764a0a72ba71\") " pod="openshift-network-operator/iptables-alerter-m7dtr" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-sysconfig\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.348826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-sysctl-d\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-system-cni-dir\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0eec0bca-02bf-498a-a3bc-764a0a72ba71-host-slash\") pod \"iptables-alerter-m7dtr\" (UID: \"0eec0bca-02bf-498a-a3bc-764a0a72ba71\") " pod="openshift-network-operator/iptables-alerter-m7dtr" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-host\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-sysconfig\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c48caac-7c6e-4842-b39f-49a10d508285-etc-tuned\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348594 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-system-cni-dir\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-kubelet\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-kubelet\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-run-systemd\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9583ff81-a722-44f2-8cce-11ad80ef4ca5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-modprobe-d\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-lib-modules\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0f28df4-16eb-4de1-ac26-a54f20a2f998-dbus\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c54f1e0-13db-419a-842f-bc32ca77bea3-konnectivity-ca\") pod \"konnectivity-agent-s2dzv\" (UID: \"7c54f1e0-13db-419a-842f-bc32ca77bea3\") " pod="kube-system/konnectivity-agent-s2dzv" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348797 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348507 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbb464bf-fb7f-4337-9e4d-60369b88912a-tmp-dir\") pod \"node-resolver-5zw6t\" (UID: \"fbb464bf-fb7f-4337-9e4d-60369b88912a\") " pod="openshift-dns/node-resolver-5zw6t" Jul 07 23:11:23.349797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348909 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9583ff81-a722-44f2-8cce-11ad80ef4ca5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348930 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-cnibin\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348970 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-modprobe-d\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348978 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-cnibin\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-sysctl-d\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-var-lib-cni-bin\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-etc-kubernetes\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9583ff81-a722-44f2-8cce-11ad80ef4ca5-system-cni-dir\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-lib-modules\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0eec0bca-02bf-498a-a3bc-764a0a72ba71-host-slash\") pod \"iptables-alerter-m7dtr\" (UID: \"0eec0bca-02bf-498a-a3bc-764a0a72ba71\") " pod="openshift-network-operator/iptables-alerter-m7dtr" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9tkn\" (UniqueName: \"kubernetes.io/projected/9583ff81-a722-44f2-8cce-11ad80ef4ca5-kube-api-access-x9tkn\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349116 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-etc-kubernetes\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349118 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-host\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-socket-dir\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349158 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-var-lib-cni-bin\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-var-lib-cni-multus\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0f28df4-16eb-4de1-ac26-a54f20a2f998-dbus\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:23.350775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349187 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9583ff81-a722-44f2-8cce-11ad80ef4ca5-system-cni-dir\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349043 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-run-systemd\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-var-lib-cni-multus\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.348789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-env-overrides\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-node-log\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349279 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-socket-dir\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-ovnkube-config\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-ovnkube-script-lib\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-node-log\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9583ff81-a722-44f2-8cce-11ad80ef4ca5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-var-lib-kubelet\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c54f1e0-13db-419a-842f-bc32ca77bea3-agent-certs\") pod \"konnectivity-agent-s2dzv\" (UID: \"7c54f1e0-13db-419a-842f-bc32ca77bea3\") " pod="kube-system/konnectivity-agent-s2dzv" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349532 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-var-lib-kubelet\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349582 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-device-dir\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-device-dir\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-run-netns\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-run-netns\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.351805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-run-ovn\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-cni-netd\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-run-netns\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0f28df4-16eb-4de1-ac26-a54f20a2f998-kubelet-config\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349857 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-run-ovn\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-cni-netd\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-etc-selinux\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349892 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c54f1e0-13db-419a-842f-bc32ca77bea3-konnectivity-ca\") pod \"konnectivity-agent-s2dzv\" (UID: \"7c54f1e0-13db-419a-842f-bc32ca77bea3\") " pod="kube-system/konnectivity-agent-s2dzv" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b24fbe48-6f49-4103-b35a-846f722f2eca-host\") pod \"node-ca-4nkdt\" (UID: \"b24fbe48-6f49-4103-b35a-846f722f2eca\") " pod="openshift-image-registry/node-ca-4nkdt" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349916 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-run-netns\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349827 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0f28df4-16eb-4de1-ac26-a54f20a2f998-kubelet-config\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-os-release\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed39aa44-68a5-4fa5-bf95-19f1b7084503-etc-selinux\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349962 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-ovnkube-config\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-multus-socket-dir-parent\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-os-release\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.350000 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:23.352719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-multus-socket-dir-parent\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349972 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b24fbe48-6f49-4103-b35a-846f722f2eca-host\") pod \"node-ca-4nkdt\" (UID: \"b24fbe48-6f49-4103-b35a-846f722f2eca\") " pod="openshift-image-registry/node-ca-4nkdt" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-run-k8s-cni-cncf-io\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.350084 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret podName:a0f28df4-16eb-4de1-ac26-a54f20a2f998 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:23.85006405 +0000 UTC m=+3.071498397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret") pod "global-pull-secret-syncer-dxqh9" (UID: "a0f28df4-16eb-4de1-ac26-a54f20a2f998") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.349996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-host-run-k8s-cni-cncf-io\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb69z\" (UniqueName: \"kubernetes.io/projected/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-kube-api-access-tb69z\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-kubernetes\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-sys\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350253 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-etc-kubernetes\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350275 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-ovnkube-script-lib\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptkqr\" (UniqueName: \"kubernetes.io/projected/b24fbe48-6f49-4103-b35a-846f722f2eca-kube-api-access-ptkqr\") pod \"node-ca-4nkdt\" (UID: \"b24fbe48-6f49-4103-b35a-846f722f2eca\") " pod="openshift-image-registry/node-ca-4nkdt" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0eec0bca-02bf-498a-a3bc-764a0a72ba71-iptables-alerter-script\") pod \"iptables-alerter-m7dtr\" (UID: \"0eec0bca-02bf-498a-a3bc-764a0a72ba71\") " pod="openshift-network-operator/iptables-alerter-m7dtr" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c48caac-7c6e-4842-b39f-49a10d508285-tmp\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjl2q\" (UniqueName: \"kubernetes.io/projected/3c48caac-7c6e-4842-b39f-49a10d508285-kube-api-access-cjl2q\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c48caac-7c6e-4842-b39f-49a10d508285-sys\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9583ff81-a722-44f2-8cce-11ad80ef4ca5-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.353616 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.350439 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fbb464bf-fb7f-4337-9e4d-60369b88912a-hosts-file\") pod \"node-resolver-5zw6t\" (UID: \"fbb464bf-fb7f-4337-9e4d-60369b88912a\") " pod="openshift-dns/node-resolver-5zw6t" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350457 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9583ff81-a722-44f2-8cce-11ad80ef4ca5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.350504 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs podName:e0e9befa-834d-41aa-9c87-b573c269b87f nodeName:}" failed. No retries permitted until 2026-07-07 23:11:23.850483452 +0000 UTC m=+3.071917779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs") pod "network-metrics-daemon-q9d2t" (UID: "e0e9befa-834d-41aa-9c87-b573c269b87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adbd9ef4-de60-4f88-9401-af3e65c1ba58-cni-binary-copy\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-hostroot\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-ovn-node-metrics-cert\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/adbd9ef4-de60-4f88-9401-af3e65c1ba58-hostroot\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350875 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fbb464bf-fb7f-4337-9e4d-60369b88912a-hosts-file\") pod \"node-resolver-5zw6t\" (UID: \"fbb464bf-fb7f-4337-9e4d-60369b88912a\") " pod="openshift-dns/node-resolver-5zw6t" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.350920 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.351021 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0eec0bca-02bf-498a-a3bc-764a0a72ba71-iptables-alerter-script\") pod \"iptables-alerter-m7dtr\" (UID: \"0eec0bca-02bf-498a-a3bc-764a0a72ba71\") " pod="openshift-network-operator/iptables-alerter-m7dtr" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.351109 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adbd9ef4-de60-4f88-9401-af3e65c1ba58-cni-binary-copy\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.351758 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9583ff81-a722-44f2-8cce-11ad80ef4ca5-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.354261 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c48caac-7c6e-4842-b39f-49a10d508285-tmp\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.354453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.354357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-ovn-node-metrics-cert\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.355521 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.354672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c54f1e0-13db-419a-842f-bc32ca77bea3-agent-certs\") pod \"konnectivity-agent-s2dzv\" (UID: \"7c54f1e0-13db-419a-842f-bc32ca77bea3\") " pod="kube-system/konnectivity-agent-s2dzv" Jul 07 23:11:23.355521 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.354852 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c48caac-7c6e-4842-b39f-49a10d508285-etc-tuned\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.356414 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.356389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6md8w\" (UniqueName: \"kubernetes.io/projected/adbd9ef4-de60-4f88-9401-af3e65c1ba58-kube-api-access-6md8w\") pod \"multus-n9tht\" (UID: \"adbd9ef4-de60-4f88-9401-af3e65c1ba58\") " pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.356685 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.356669 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjbhc\" (UniqueName: \"kubernetes.io/projected/ed39aa44-68a5-4fa5-bf95-19f1b7084503-kube-api-access-sjbhc\") pod \"aws-ebs-csi-driver-node-8j7g5\" (UID: \"ed39aa44-68a5-4fa5-bf95-19f1b7084503\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.357157 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.357130 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh7td\" (UniqueName: \"kubernetes.io/projected/e0e9befa-834d-41aa-9c87-b573c269b87f-kube-api-access-bh7td\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:23.362514 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.362483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lltp\" (UniqueName: \"kubernetes.io/projected/fbb464bf-fb7f-4337-9e4d-60369b88912a-kube-api-access-2lltp\") pod \"node-resolver-5zw6t\" (UID: \"fbb464bf-fb7f-4337-9e4d-60369b88912a\") " pod="openshift-dns/node-resolver-5zw6t" Jul 07 23:11:23.362970 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.362944 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcl4j\" (UniqueName: \"kubernetes.io/projected/0eec0bca-02bf-498a-a3bc-764a0a72ba71-kube-api-access-tcl4j\") pod \"iptables-alerter-m7dtr\" (UID: \"0eec0bca-02bf-498a-a3bc-764a0a72ba71\") " pod="openshift-network-operator/iptables-alerter-m7dtr" Jul 07 23:11:23.363112 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.363088 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptkqr\" (UniqueName: \"kubernetes.io/projected/b24fbe48-6f49-4103-b35a-846f722f2eca-kube-api-access-ptkqr\") pod \"node-ca-4nkdt\" (UID: \"b24fbe48-6f49-4103-b35a-846f722f2eca\") " pod="openshift-image-registry/node-ca-4nkdt" Jul 07 23:11:23.363276 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.363254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9tkn\" (UniqueName: \"kubernetes.io/projected/9583ff81-a722-44f2-8cce-11ad80ef4ca5-kube-api-access-x9tkn\") pod \"multus-additional-cni-plugins-tvk6j\" (UID: \"9583ff81-a722-44f2-8cce-11ad80ef4ca5\") " pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.364227 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.364207 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjl2q\" (UniqueName: \"kubernetes.io/projected/3c48caac-7c6e-4842-b39f-49a10d508285-kube-api-access-cjl2q\") pod \"tuned-zrfmd\" (UID: \"3c48caac-7c6e-4842-b39f-49a10d508285\") " pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.364296 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.364234 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb69z\" (UniqueName: \"kubernetes.io/projected/7bf265b5-1ef8-45c0-9c2e-44429614e8f4-kube-api-access-tb69z\") pod \"ovnkube-node-7f2fb\" (UID: \"7bf265b5-1ef8-45c0-9c2e-44429614e8f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.450416 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.450388 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" Jul 07 23:11:23.461370 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.461346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4nkdt" Jul 07 23:11:23.478253 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.478189 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5zw6t" Jul 07 23:11:23.485141 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.485113 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n9tht" Jul 07 23:11:23.493998 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.493974 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:23.501945 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.501926 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m7dtr" Jul 07 23:11:23.509697 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.509678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tvk6j" Jul 07 23:11:23.518537 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.518493 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s2dzv" Jul 07 23:11:23.526362 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.526344 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" Jul 07 23:11:23.754127 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.754049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwpx\" (UniqueName: \"kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx\") pod \"network-check-target-65tk4\" (UID: \"ac6868f6-fc8f-47c0-b103-7b366bb3844e\") " pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:23.754264 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.754207 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:11:23.754264 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.754231 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:11:23.754264 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.754246 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vkwpx for pod openshift-network-diagnostics/network-check-target-65tk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:23.754412 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.754312 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx podName:ac6868f6-fc8f-47c0-b103-7b366bb3844e nodeName:}" failed. No retries permitted until 2026-07-07 23:11:24.754292881 +0000 UTC m=+3.975727231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkwpx" (UniqueName: "kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx") pod "network-check-target-65tk4" (UID: "ac6868f6-fc8f-47c0-b103-7b366bb3844e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:23.855343 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.855308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:23.855343 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:23.855357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:23.855642 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.855471 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:23.855642 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.855471 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:23.855642 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.855540 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs podName:e0e9befa-834d-41aa-9c87-b573c269b87f nodeName:}" failed. No retries permitted until 2026-07-07 23:11:24.855519456 +0000 UTC m=+4.076953785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs") pod "network-metrics-daemon-q9d2t" (UID: "e0e9befa-834d-41aa-9c87-b573c269b87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:23.855642 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:23.855580 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret podName:a0f28df4-16eb-4de1-ac26-a54f20a2f998 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:24.85554889 +0000 UTC m=+4.076983220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret") pod "global-pull-secret-syncer-dxqh9" (UID: "a0f28df4-16eb-4de1-ac26-a54f20a2f998") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:24.186218 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:24.186178 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 23:06:23 +0000 UTC" deadline="2028-01-06 14:17:30.340656471 +0000 UTC" Jul 07 23:11:24.186218 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:24.186209 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13143h6m6.154451086s" Jul 07 23:11:24.436801 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:24.436002 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9583ff81_a722_44f2_8cce_11ad80ef4ca5.slice/crio-e237bff5afa18421789abece186ec90df3fa3447757030f6dbec150111685a8d WatchSource:0}: Error finding container e237bff5afa18421789abece186ec90df3fa3447757030f6dbec150111685a8d: Status 404 returned error can't find the container with id e237bff5afa18421789abece186ec90df3fa3447757030f6dbec150111685a8d Jul 07 23:11:24.445320 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:24.445291 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c54f1e0_13db_419a_842f_bc32ca77bea3.slice/crio-0f57cdba8ef0632bc9154b7b0cec8b0e53d579b711a1e8b7bc39edb94f48c0a6 WatchSource:0}: Error finding container 0f57cdba8ef0632bc9154b7b0cec8b0e53d579b711a1e8b7bc39edb94f48c0a6: Status 404 returned error can't find the container with id 0f57cdba8ef0632bc9154b7b0cec8b0e53d579b711a1e8b7bc39edb94f48c0a6 Jul 07 23:11:24.469228 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:24.469199 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded39aa44_68a5_4fa5_bf95_19f1b7084503.slice/crio-2534e6b1657183456533e8e48ea47cfdb1c742ec3d6d20f99cfca63408bc2031 WatchSource:0}: Error finding container 2534e6b1657183456533e8e48ea47cfdb1c742ec3d6d20f99cfca63408bc2031: Status 404 returned error can't find the container with id 2534e6b1657183456533e8e48ea47cfdb1c742ec3d6d20f99cfca63408bc2031 Jul 07 23:11:24.470142 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:24.470112 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadbd9ef4_de60_4f88_9401_af3e65c1ba58.slice/crio-c7b926d41d33da28f0e064877fad5f2a11d4da0fb45959f5c32fc79680b12bb7 WatchSource:0}: Error finding container c7b926d41d33da28f0e064877fad5f2a11d4da0fb45959f5c32fc79680b12bb7: Status 404 returned error can't find the container with id c7b926d41d33da28f0e064877fad5f2a11d4da0fb45959f5c32fc79680b12bb7 Jul 07 23:11:24.471051 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:24.470973 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eec0bca_02bf_498a_a3bc_764a0a72ba71.slice/crio-0524a699b31edcc512f1c76efd9c5a6183b5e1bd75633b543b3213b38efea3be WatchSource:0}: Error finding container 0524a699b31edcc512f1c76efd9c5a6183b5e1bd75633b543b3213b38efea3be: Status 404 returned error can't find the container with id 0524a699b31edcc512f1c76efd9c5a6183b5e1bd75633b543b3213b38efea3be Jul 07 23:11:24.473171 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:24.473146 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb464bf_fb7f_4337_9e4d_60369b88912a.slice/crio-65dc8e102c2856df564b556a1dfb5ce57ebf32fbeab4a8cbc57b68c926feef66 WatchSource:0}: Error finding container 65dc8e102c2856df564b556a1dfb5ce57ebf32fbeab4a8cbc57b68c926feef66: Status 404 returned error can't find the container with id 65dc8e102c2856df564b556a1dfb5ce57ebf32fbeab4a8cbc57b68c926feef66 Jul 07 23:11:24.474528 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:24.474426 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24fbe48_6f49_4103_b35a_846f722f2eca.slice/crio-2280ae36003e4fe5bb34cd02a24d46903b5a457efa3613443e80dda2aa66215d WatchSource:0}: Error finding container 2280ae36003e4fe5bb34cd02a24d46903b5a457efa3613443e80dda2aa66215d: Status 404 returned error can't find the container with id 2280ae36003e4fe5bb34cd02a24d46903b5a457efa3613443e80dda2aa66215d Jul 07 23:11:24.475628 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:24.475604 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c48caac_7c6e_4842_b39f_49a10d508285.slice/crio-487e24b3c38bc12fdd21aa0b5b2a73f4f9faddf6d4846682617d0948e3c87fc6 WatchSource:0}: Error finding container 487e24b3c38bc12fdd21aa0b5b2a73f4f9faddf6d4846682617d0948e3c87fc6: Status 404 returned error can't find the container with id 487e24b3c38bc12fdd21aa0b5b2a73f4f9faddf6d4846682617d0948e3c87fc6 Jul 07 23:11:24.718457 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:24.718215 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 23:11:24.765014 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:24.764984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwpx\" (UniqueName: \"kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx\") pod \"network-check-target-65tk4\" (UID: \"ac6868f6-fc8f-47c0-b103-7b366bb3844e\") " pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:24.765153 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:24.765134 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:11:24.765213 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:24.765161 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:11:24.765213 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:24.765174 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vkwpx for pod openshift-network-diagnostics/network-check-target-65tk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:24.765312 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:24.765243 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx podName:ac6868f6-fc8f-47c0-b103-7b366bb3844e nodeName:}" failed. No retries permitted until 2026-07-07 23:11:26.765222969 +0000 UTC m=+5.986657303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkwpx" (UniqueName: "kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx") pod "network-check-target-65tk4" (UID: "ac6868f6-fc8f-47c0-b103-7b366bb3844e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:24.865413 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:24.865372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:24.865620 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:24.865432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:24.865689 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:24.865621 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:24.865788 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:24.865775 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs podName:e0e9befa-834d-41aa-9c87-b573c269b87f nodeName:}" failed. No retries permitted until 2026-07-07 23:11:26.865749886 +0000 UTC m=+6.087184231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs") pod "network-metrics-daemon-q9d2t" (UID: "e0e9befa-834d-41aa-9c87-b573c269b87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:24.866261 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:24.866240 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:24.866356 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:24.866305 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret podName:a0f28df4-16eb-4de1-ac26-a54f20a2f998 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:26.866287498 +0000 UTC m=+6.087721829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret") pod "global-pull-secret-syncer-dxqh9" (UID: "a0f28df4-16eb-4de1-ac26-a54f20a2f998") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:25.187427 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.187301 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 23:06:23 +0000 UTC" deadline="2028-03-04 20:31:54.130766844 +0000 UTC" Jul 07 23:11:25.187427 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.187371 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14541h20m28.943400913s" Jul 07 23:11:25.301715 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.301685 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:25.301886 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:25.301827 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:25.302240 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.302224 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:25.302365 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:25.302328 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:25.302425 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.302386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:25.302477 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:25.302451 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:25.321107 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.321070 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" event={"ID":"702fecf07f3eb2502132a6413ffba9f0","Type":"ContainerStarted","Data":"e454b7fc005ee572b0d31c537cf8e3a3bd729ab7bd5bcc930e223aa2d0d45452"} Jul 07 23:11:25.332463 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.332428 2576 generic.go:356] "Generic (PLEG): container finished" podID="0090339d23883e7cfb9dc4bf51bde46d" containerID="bf708fed639257c5d8db6b88dd38354262889ef8eb3f16a7b9729457c71ac10e" exitCode=0 Jul 07 23:11:25.332651 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.332519 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" event={"ID":"0090339d23883e7cfb9dc4bf51bde46d","Type":"ContainerDied","Data":"bf708fed639257c5d8db6b88dd38354262889ef8eb3f16a7b9729457c71ac10e"} Jul 07 23:11:25.337189 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.336465 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-40.ec2.internal" podStartSLOduration=2.336447172 podStartE2EDuration="2.336447172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:25.335817663 +0000 UTC m=+4.557252019" watchObservedRunningTime="2026-07-07 23:11:25.336447172 +0000 UTC m=+4.557881529" Jul 07 23:11:25.340459 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.340434 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" event={"ID":"3c48caac-7c6e-4842-b39f-49a10d508285","Type":"ContainerStarted","Data":"487e24b3c38bc12fdd21aa0b5b2a73f4f9faddf6d4846682617d0948e3c87fc6"} Jul 07 23:11:25.361093 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.360963 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m7dtr" event={"ID":"0eec0bca-02bf-498a-a3bc-764a0a72ba71","Type":"ContainerStarted","Data":"0524a699b31edcc512f1c76efd9c5a6183b5e1bd75633b543b3213b38efea3be"} Jul 07 23:11:25.371665 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.370076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n9tht" event={"ID":"adbd9ef4-de60-4f88-9401-af3e65c1ba58","Type":"ContainerStarted","Data":"c7b926d41d33da28f0e064877fad5f2a11d4da0fb45959f5c32fc79680b12bb7"} Jul 07 23:11:25.372936 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.372907 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" event={"ID":"7bf265b5-1ef8-45c0-9c2e-44429614e8f4","Type":"ContainerStarted","Data":"bd80b4427070a49124d2b43dcacd63146bbdce000afe5a82435cd2705a24fdc5"} Jul 07 23:11:25.379221 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.379189 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s2dzv" event={"ID":"7c54f1e0-13db-419a-842f-bc32ca77bea3","Type":"ContainerStarted","Data":"0f57cdba8ef0632bc9154b7b0cec8b0e53d579b711a1e8b7bc39edb94f48c0a6"} Jul 07 23:11:25.382701 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.382675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4nkdt" event={"ID":"b24fbe48-6f49-4103-b35a-846f722f2eca","Type":"ContainerStarted","Data":"2280ae36003e4fe5bb34cd02a24d46903b5a457efa3613443e80dda2aa66215d"} Jul 07 23:11:25.386432 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.386403 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5zw6t" event={"ID":"fbb464bf-fb7f-4337-9e4d-60369b88912a","Type":"ContainerStarted","Data":"65dc8e102c2856df564b556a1dfb5ce57ebf32fbeab4a8cbc57b68c926feef66"} Jul 07 23:11:25.393090 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.393062 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" event={"ID":"ed39aa44-68a5-4fa5-bf95-19f1b7084503","Type":"ContainerStarted","Data":"2534e6b1657183456533e8e48ea47cfdb1c742ec3d6d20f99cfca63408bc2031"} Jul 07 23:11:25.400096 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:25.400067 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvk6j" event={"ID":"9583ff81-a722-44f2-8cce-11ad80ef4ca5","Type":"ContainerStarted","Data":"e237bff5afa18421789abece186ec90df3fa3447757030f6dbec150111685a8d"} Jul 07 23:11:26.423419 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:26.421730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" event={"ID":"0090339d23883e7cfb9dc4bf51bde46d","Type":"ContainerStarted","Data":"acc0a49c1bc36c3372c07d09ff90bc8a4ff93e2334b703e5cd0ebd6caa33ee55"} Jul 07 23:11:26.440732 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:26.440646 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-40.ec2.internal" podStartSLOduration=3.4406240869999998 podStartE2EDuration="3.440624087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:26.440246879 +0000 UTC m=+5.661681233" watchObservedRunningTime="2026-07-07 23:11:26.440624087 +0000 UTC m=+5.662058441" Jul 07 23:11:26.782818 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:26.782730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwpx\" (UniqueName: \"kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx\") pod \"network-check-target-65tk4\" (UID: \"ac6868f6-fc8f-47c0-b103-7b366bb3844e\") " pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:26.783003 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:26.782969 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:11:26.783003 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:26.782992 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:11:26.783112 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:26.783020 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vkwpx for pod openshift-network-diagnostics/network-check-target-65tk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:26.783112 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:26.783085 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx podName:ac6868f6-fc8f-47c0-b103-7b366bb3844e nodeName:}" failed. No retries permitted until 2026-07-07 23:11:30.783063876 +0000 UTC m=+10.004498206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkwpx" (UniqueName: "kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx") pod "network-check-target-65tk4" (UID: "ac6868f6-fc8f-47c0-b103-7b366bb3844e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:26.883449 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:26.883250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:26.883449 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:26.883303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:26.883786 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:26.883459 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:26.883786 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:26.883522 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs podName:e0e9befa-834d-41aa-9c87-b573c269b87f nodeName:}" failed. No retries permitted until 2026-07-07 23:11:30.883503522 +0000 UTC m=+10.104937854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs") pod "network-metrics-daemon-q9d2t" (UID: "e0e9befa-834d-41aa-9c87-b573c269b87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:26.883786 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:26.883673 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:26.883786 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:26.883752 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret podName:a0f28df4-16eb-4de1-ac26-a54f20a2f998 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:30.883732639 +0000 UTC m=+10.105166983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret") pod "global-pull-secret-syncer-dxqh9" (UID: "a0f28df4-16eb-4de1-ac26-a54f20a2f998") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:27.301778 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:27.301742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:27.301974 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:27.301904 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:27.302351 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:27.302330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:27.302456 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:27.302434 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:27.304186 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:27.304162 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:27.304285 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:27.304265 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:29.301726 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:29.301694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:29.302234 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:29.301838 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:29.302306 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:29.302250 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:29.302385 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:29.302359 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:29.302456 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:29.302435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:29.302581 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:29.302556 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:30.817360 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:30.817313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwpx\" (UniqueName: \"kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx\") pod \"network-check-target-65tk4\" (UID: \"ac6868f6-fc8f-47c0-b103-7b366bb3844e\") " pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:30.817879 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:30.817494 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:11:30.817879 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:30.817517 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:11:30.817879 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:30.817531 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vkwpx for pod openshift-network-diagnostics/network-check-target-65tk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:30.817879 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:30.817607 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx podName:ac6868f6-fc8f-47c0-b103-7b366bb3844e nodeName:}" failed. No retries permitted until 2026-07-07 23:11:38.817587314 +0000 UTC m=+18.039021649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkwpx" (UniqueName: "kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx") pod "network-check-target-65tk4" (UID: "ac6868f6-fc8f-47c0-b103-7b366bb3844e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:30.917696 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:30.917652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:30.917871 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:30.917708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:30.917937 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:30.917883 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:30.917990 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:30.917943 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs podName:e0e9befa-834d-41aa-9c87-b573c269b87f nodeName:}" failed. No retries permitted until 2026-07-07 23:11:38.917923484 +0000 UTC m=+18.139357830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs") pod "network-metrics-daemon-q9d2t" (UID: "e0e9befa-834d-41aa-9c87-b573c269b87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:30.918341 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:30.918324 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:30.918405 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:30.918380 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret podName:a0f28df4-16eb-4de1-ac26-a54f20a2f998 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:38.918365557 +0000 UTC m=+18.139799888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret") pod "global-pull-secret-syncer-dxqh9" (UID: "a0f28df4-16eb-4de1-ac26-a54f20a2f998") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:31.303753 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:31.302815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:31.303753 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:31.302957 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:31.303753 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:31.303378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:31.303753 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:31.303484 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:31.303753 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:31.303587 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:31.303753 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:31.303669 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:33.301631 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:33.301597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:33.302056 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:33.301732 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:33.302140 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:33.302116 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:33.302256 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:33.302225 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:33.302326 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:33.302299 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:33.302422 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:33.302406 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:35.302034 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:35.301558 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:35.302034 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:35.301607 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:35.302034 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:35.301581 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:35.302034 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:35.301698 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:35.302034 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:35.301809 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:35.302034 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:35.301893 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:37.300935 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:37.300899 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:37.301393 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:37.300899 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:37.301393 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:37.301022 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:37.301393 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:37.301113 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:37.301393 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:37.300899 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:37.301393 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:37.301235 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:38.881447 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:38.881413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwpx\" (UniqueName: \"kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx\") pod \"network-check-target-65tk4\" (UID: \"ac6868f6-fc8f-47c0-b103-7b366bb3844e\") " pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:38.881985 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:38.881644 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:11:38.881985 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:38.881672 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:11:38.881985 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:38.881712 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vkwpx for pod openshift-network-diagnostics/network-check-target-65tk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:38.881985 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:38.881785 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx podName:ac6868f6-fc8f-47c0-b103-7b366bb3844e nodeName:}" failed. No retries permitted until 2026-07-07 23:11:54.881763545 +0000 UTC m=+34.103197886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkwpx" (UniqueName: "kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx") pod "network-check-target-65tk4" (UID: "ac6868f6-fc8f-47c0-b103-7b366bb3844e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:38.982196 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:38.982162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:38.982392 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:38.982206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:38.982392 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:38.982356 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:38.982392 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:38.982366 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:38.982557 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:38.982445 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs podName:e0e9befa-834d-41aa-9c87-b573c269b87f nodeName:}" failed. No retries permitted until 2026-07-07 23:11:54.982420378 +0000 UTC m=+34.203854725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs") pod "network-metrics-daemon-q9d2t" (UID: "e0e9befa-834d-41aa-9c87-b573c269b87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:38.982557 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:38.982466 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret podName:a0f28df4-16eb-4de1-ac26-a54f20a2f998 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:54.982455693 +0000 UTC m=+34.203890027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret") pod "global-pull-secret-syncer-dxqh9" (UID: "a0f28df4-16eb-4de1-ac26-a54f20a2f998") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:39.301422 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:39.301340 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:39.301599 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:39.301467 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:39.301929 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:39.301909 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:39.302035 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:39.302011 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:39.302115 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:39.302101 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:39.302242 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:39.302216 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:41.302679 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:41.302643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:41.303144 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:41.302763 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:41.303206 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:41.303157 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:41.303277 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:41.303255 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:41.303425 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:41.303399 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:41.303581 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:41.303500 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:43.301394 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:43.301358 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:43.302003 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:43.301358 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:43.302003 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:43.301490 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:43.302003 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:43.301596 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:43.302003 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:43.301358 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:43.302003 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:43.301689 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:44.466435 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.466058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" event={"ID":"3c48caac-7c6e-4842-b39f-49a10d508285","Type":"ContainerStarted","Data":"d34e7ee8464971f3196e59b6c6f4923e7d53a28977aca8cdd35d16e70cd06f25"} Jul 07 23:11:44.467663 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.467640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n9tht" event={"ID":"adbd9ef4-de60-4f88-9401-af3e65c1ba58","Type":"ContainerStarted","Data":"c5bf4681e37839341a9d3f49d8ca7ccee1e369ed6d4e4963d4948d865e02c7b7"} Jul 07 23:11:44.473264 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.473242 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" event={"ID":"7bf265b5-1ef8-45c0-9c2e-44429614e8f4","Type":"ContainerStarted","Data":"46379df31fd85c2c135541d8328f429d25f32171ceb22b2d121439e7bb37900c"} Jul 07 23:11:44.473341 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.473326 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" event={"ID":"7bf265b5-1ef8-45c0-9c2e-44429614e8f4","Type":"ContainerStarted","Data":"74b14138ee2bd80d79ae401805c8348cc1838dc00ee102f336241c245c7cb0d1"} Jul 07 23:11:44.473403 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.473372 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" event={"ID":"7bf265b5-1ef8-45c0-9c2e-44429614e8f4","Type":"ContainerStarted","Data":"325e344f71a9b812cb58b6d1a562f6910b234a09bf925afcdde4e374e2d3c98a"} Jul 07 23:11:44.473457 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.473409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" event={"ID":"7bf265b5-1ef8-45c0-9c2e-44429614e8f4","Type":"ContainerStarted","Data":"374a45138d94653ebc970da2fe94223551b461a43578966a00956dde60c810e4"} Jul 07 23:11:44.474812 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.474786 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s2dzv" event={"ID":"7c54f1e0-13db-419a-842f-bc32ca77bea3","Type":"ContainerStarted","Data":"d685f30f05ab7d3d56d00a8054e56ebbe32cbdd7ffd68b021bee6f707bf61975"} Jul 07 23:11:44.476060 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.476029 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4nkdt" event={"ID":"b24fbe48-6f49-4103-b35a-846f722f2eca","Type":"ContainerStarted","Data":"0c8be9eceb165b2fedf2242a854ba9f94e4362a89416851c02d549bb69287f55"} Jul 07 23:11:44.477347 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.477313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5zw6t" event={"ID":"fbb464bf-fb7f-4337-9e4d-60369b88912a","Type":"ContainerStarted","Data":"0f50ea41a7319f73aeffbee486cc193e6bb81cdc304359341d07fe349079e8e4"} Jul 07 23:11:44.478699 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.478680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" event={"ID":"ed39aa44-68a5-4fa5-bf95-19f1b7084503","Type":"ContainerStarted","Data":"d6958c192710e3ad7447c3b94fe5b0f04c60a9639cc45b39e29b523b26e64eac"} Jul 07 23:11:44.479971 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.479950 2576 generic.go:356] "Generic (PLEG): container finished" podID="9583ff81-a722-44f2-8cce-11ad80ef4ca5" containerID="5f48c076c36e9aace19a6636b459ebc7ee8e33c9fd8c51c2d5028eadc86e7293" exitCode=0 Jul 07 23:11:44.480042 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.479988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvk6j" event={"ID":"9583ff81-a722-44f2-8cce-11ad80ef4ca5","Type":"ContainerDied","Data":"5f48c076c36e9aace19a6636b459ebc7ee8e33c9fd8c51c2d5028eadc86e7293"} Jul 07 23:11:44.486254 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.486220 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zrfmd" podStartSLOduration=3.033258829 podStartE2EDuration="22.486205671s" totalImagesPullingTime="19.452946842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:44.485512412 +0000 UTC m=+23.706946760" watchObservedRunningTime="2026-07-07 23:11:44.486205671 +0000 UTC m=+23.707640019" Jul 07 23:11:44.503370 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.503330 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n9tht" podStartSLOduration=2.994018586 podStartE2EDuration="22.503320867s" totalImagesPullingTime="19.509302281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:44.50292016 +0000 UTC m=+23.724354510" watchObservedRunningTime="2026-07-07 23:11:44.503320867 +0000 UTC m=+23.724755216" Jul 07 23:11:44.546945 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.546898 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s2dzv" podStartSLOduration=3.087165126 podStartE2EDuration="22.546884174s" totalImagesPullingTime="19.459719048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:44.546778248 +0000 UTC m=+23.768212609" watchObservedRunningTime="2026-07-07 23:11:44.546884174 +0000 UTC m=+23.768318522" Jul 07 23:11:44.562687 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:44.562653 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4nkdt" podStartSLOduration=3.10737534 podStartE2EDuration="22.562642212s" totalImagesPullingTime="19.455266872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:44.56222701 +0000 UTC m=+23.783661356" watchObservedRunningTime="2026-07-07 23:11:44.562642212 +0000 UTC m=+23.784076561" Jul 07 23:11:45.300975 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:45.300903 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:45.301136 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:45.300907 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:45.301136 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:45.301039 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:45.301136 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:45.300907 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:45.301136 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:45.301104 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:45.301280 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:45.301169 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:45.486495 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:45.486465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" event={"ID":"7bf265b5-1ef8-45c0-9c2e-44429614e8f4","Type":"ContainerStarted","Data":"3dc424e396c10c5938daea0932caa30749d6a6ebf8958aab571ce07fd2be34b3"} Jul 07 23:11:45.486924 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:45.486563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" event={"ID":"7bf265b5-1ef8-45c0-9c2e-44429614e8f4","Type":"ContainerStarted","Data":"9b7b980ffb62b470b610d3543ed6db8c347a7d2dc415a8f5758b144fff26d793"} Jul 07 23:11:45.487969 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:45.487898 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m7dtr" event={"ID":"0eec0bca-02bf-498a-a3bc-764a0a72ba71","Type":"ContainerStarted","Data":"1db29ced60177ba14ad876eac36e8c5893ae32e13296ea63c7d4b1f3b4bd9ce2"} Jul 07 23:11:45.503790 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:45.503745 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5zw6t" podStartSLOduration=4.056436879 podStartE2EDuration="23.503730627s" totalImagesPullingTime="19.447293748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:44.577271744 +0000 UTC m=+23.798706093" watchObservedRunningTime="2026-07-07 23:11:45.503730627 +0000 UTC m=+24.725164976" Jul 07 23:11:45.504043 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:45.504022 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m7dtr" podStartSLOduration=4.039398157 podStartE2EDuration="23.504013733s" totalImagesPullingTime="19.464615576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:45.503719795 +0000 UTC m=+24.725154147" watchObservedRunningTime="2026-07-07 23:11:45.504013733 +0000 UTC m=+24.725448081" Jul 07 23:11:45.534163 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:45.534137 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 23:11:46.216169 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:46.216071 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T23:11:45.534156483Z","UUID":"0f562a75-7d7e-4ccb-a204-5a8f540dcbe7","Handler":null,"Name":"","Endpoint":""} Jul 07 23:11:46.217605 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:46.217572 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 23:11:46.217742 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:46.217621 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 23:11:46.350254 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:46.350222 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s2dzv" Jul 07 23:11:46.351599 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:46.351573 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s2dzv" Jul 07 23:11:46.491720 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:46.491683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" event={"ID":"ed39aa44-68a5-4fa5-bf95-19f1b7084503","Type":"ContainerStarted","Data":"daf10b69ebb19cd908bad404d0b811cb02eb348684adcd6732ab7406c72dd66d"} Jul 07 23:11:47.301568 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:47.301509 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:47.301725 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:47.301509 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:47.301725 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:47.301653 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:47.301725 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:47.301660 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:47.301725 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:47.301720 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:47.301871 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:47.301802 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:47.496587 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:47.496550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" event={"ID":"ed39aa44-68a5-4fa5-bf95-19f1b7084503","Type":"ContainerStarted","Data":"bcfe5cb3fc6b047573697337b7c0c3332ec759bf25e2929ceb5e4ca1cbb9d3c2"} Jul 07 23:11:47.500634 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:47.500608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" event={"ID":"7bf265b5-1ef8-45c0-9c2e-44429614e8f4","Type":"ContainerStarted","Data":"7a97a547c50d8de849621a22aa7b3123125848b9fbef7e66c07e086bf4cbb384"} Jul 07 23:11:47.500748 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:47.500662 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 23:11:47.516003 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:47.515958 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j7g5" podStartSLOduration=3.709918722 podStartE2EDuration="25.515946095s" totalImagesPullingTime="21.806027373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:47.515607522 +0000 UTC m=+26.737041871" watchObservedRunningTime="2026-07-07 23:11:47.515946095 +0000 UTC m=+26.737380444" Jul 07 23:11:49.301939 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:49.301726 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:49.302374 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:49.301736 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:49.302374 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:49.302065 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:49.302374 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:49.301778 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:49.302374 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:49.302144 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:49.302374 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:49.302193 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:50.511375 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:50.511339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" event={"ID":"7bf265b5-1ef8-45c0-9c2e-44429614e8f4","Type":"ContainerStarted","Data":"c64efad6956673b86ac2ebe8ebbdf19c09166a18848cd353d19e61df29dcc5bb"} Jul 07 23:11:50.512240 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:50.511585 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:50.513584 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:50.513338 2576 generic.go:356] "Generic (PLEG): container finished" podID="9583ff81-a722-44f2-8cce-11ad80ef4ca5" containerID="54e957603b4fe2985329583922a56265a12c88422adf77471caf300af45e0eae" exitCode=0 Jul 07 23:11:50.513685 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:50.513424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvk6j" event={"ID":"9583ff81-a722-44f2-8cce-11ad80ef4ca5","Type":"ContainerDied","Data":"54e957603b4fe2985329583922a56265a12c88422adf77471caf300af45e0eae"} Jul 07 23:11:50.527858 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:50.527834 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:50.543078 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:50.543027 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" podStartSLOduration=8.99903703 podStartE2EDuration="28.5430101s" totalImagesPullingTime="19.54397307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:11:50.542976934 +0000 UTC m=+29.764411284" watchObservedRunningTime="2026-07-07 23:11:50.5430101 +0000 UTC m=+29.764444450" Jul 07 23:11:51.304641 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:51.304050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:51.304641 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:51.304144 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:51.304641 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:51.304435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:51.304641 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:51.304498 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:51.304641 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:51.304565 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:51.304641 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:51.304617 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:51.515803 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:51.515775 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:51.516234 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:51.515839 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:51.531872 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:51.531846 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:11:52.058375 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:52.058345 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-65tk4"] Jul 07 23:11:52.058574 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:52.058431 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:52.058574 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:52.058504 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:52.061834 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:52.061809 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dxqh9"] Jul 07 23:11:52.061958 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:52.061899 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:52.062021 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:52.062001 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:52.062365 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:52.062341 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q9d2t"] Jul 07 23:11:52.062441 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:52.062417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:52.062532 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:52.062493 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:52.519086 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:52.519056 2576 generic.go:356] "Generic (PLEG): container finished" podID="9583ff81-a722-44f2-8cce-11ad80ef4ca5" containerID="f1e4ac855136da1bc33c17f8e8ab17ffb492250236f20367709d5839d1a4f01a" exitCode=0 Jul 07 23:11:52.519495 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:52.519137 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvk6j" event={"ID":"9583ff81-a722-44f2-8cce-11ad80ef4ca5","Type":"ContainerDied","Data":"f1e4ac855136da1bc33c17f8e8ab17ffb492250236f20367709d5839d1a4f01a"} Jul 07 23:11:52.607818 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:52.607786 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s2dzv" Jul 07 23:11:52.607983 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:52.607948 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 23:11:52.608407 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:52.608388 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s2dzv" Jul 07 23:11:53.302073 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:53.302046 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:53.302073 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:53.302064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:53.302272 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:53.302181 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:53.302881 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:53.302650 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:54.301415 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:54.301199 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:54.301804 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:54.301447 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:54.528090 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:54.528064 2576 generic.go:356] "Generic (PLEG): container finished" podID="9583ff81-a722-44f2-8cce-11ad80ef4ca5" containerID="720bb896157ecc7da821e664e9f6a7633de4355dab0255b69886a2ad3f61a31e" exitCode=0 Jul 07 23:11:54.528254 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:54.528108 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvk6j" event={"ID":"9583ff81-a722-44f2-8cce-11ad80ef4ca5","Type":"ContainerDied","Data":"720bb896157ecc7da821e664e9f6a7633de4355dab0255b69886a2ad3f61a31e"} Jul 07 23:11:54.896742 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:54.896711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwpx\" (UniqueName: \"kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx\") pod \"network-check-target-65tk4\" (UID: \"ac6868f6-fc8f-47c0-b103-7b366bb3844e\") " pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:54.896932 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:54.896857 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 23:11:54.896932 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:54.896880 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 23:11:54.896932 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:54.896894 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vkwpx for pod openshift-network-diagnostics/network-check-target-65tk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:54.897088 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:54.896960 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx podName:ac6868f6-fc8f-47c0-b103-7b366bb3844e nodeName:}" failed. No retries permitted until 2026-07-07 23:12:26.896940318 +0000 UTC m=+66.118374652 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkwpx" (UniqueName: "kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx") pod "network-check-target-65tk4" (UID: "ac6868f6-fc8f-47c0-b103-7b366bb3844e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 23:11:54.996999 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:54.996973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:54.997141 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:54.997007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:54.997141 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:54.997131 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:54.997207 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:54.997138 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:54.997207 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:54.997196 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs podName:e0e9befa-834d-41aa-9c87-b573c269b87f nodeName:}" failed. No retries permitted until 2026-07-07 23:12:26.997178779 +0000 UTC m=+66.218613119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs") pod "network-metrics-daemon-q9d2t" (UID: "e0e9befa-834d-41aa-9c87-b573c269b87f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 23:11:54.997272 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:54.997208 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret podName:a0f28df4-16eb-4de1-ac26-a54f20a2f998 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:26.99720252 +0000 UTC m=+66.218636847 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret") pod "global-pull-secret-syncer-dxqh9" (UID: "a0f28df4-16eb-4de1-ac26-a54f20a2f998") : object "kube-system"/"original-pull-secret" not registered Jul 07 23:11:55.301261 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:55.301231 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:55.301425 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:55.301319 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65tk4" podUID="ac6868f6-fc8f-47c0-b103-7b366bb3844e" Jul 07 23:11:55.301425 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:55.301416 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:55.301786 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:55.301511 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxqh9" podUID="a0f28df4-16eb-4de1-ac26-a54f20a2f998" Jul 07 23:11:56.300852 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.300816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:56.301042 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:56.300944 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9d2t" podUID="e0e9befa-834d-41aa-9c87-b573c269b87f" Jul 07 23:11:56.619729 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.619656 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-40.ec2.internal" event="NodeReady" Jul 07 23:11:56.620247 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.619791 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 23:11:56.665575 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.665545 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6qlq4"] Jul 07 23:11:56.667511 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.667490 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-66x6d"] Jul 07 23:11:56.667652 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.667613 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:56.669220 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.669200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-66x6d" Jul 07 23:11:56.670271 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.670248 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 23:11:56.670406 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.670392 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 23:11:56.670448 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.670424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-78s5w\"" Jul 07 23:11:56.671970 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.671953 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 23:11:56.672418 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.672398 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 23:11:56.672507 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.672402 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 23:11:56.672507 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.672458 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pkjct\"" Jul 07 23:11:56.682492 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.682473 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6qlq4"] Jul 07 23:11:56.693078 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.693040 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-66x6d"] Jul 07 23:11:56.810463 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.810430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f959f2-af03-410e-b53a-4a2a7a1e970d-tmp-dir\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:56.810463 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.810462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:56.810672 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.810480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2cf53bc-8567-4b09-bb6a-378dbd919666-cert\") pod \"ingress-canary-66x6d\" (UID: \"c2cf53bc-8567-4b09-bb6a-378dbd919666\") " pod="openshift-ingress-canary/ingress-canary-66x6d" Jul 07 23:11:56.810672 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.810496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-579vn\" (UniqueName: \"kubernetes.io/projected/c2cf53bc-8567-4b09-bb6a-378dbd919666-kube-api-access-579vn\") pod \"ingress-canary-66x6d\" (UID: \"c2cf53bc-8567-4b09-bb6a-378dbd919666\") " pod="openshift-ingress-canary/ingress-canary-66x6d" Jul 07 23:11:56.810672 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.810615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/17f959f2-af03-410e-b53a-4a2a7a1e970d-config-volume\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:56.810672 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.810651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xsb6\" (UniqueName: \"kubernetes.io/projected/17f959f2-af03-410e-b53a-4a2a7a1e970d-kube-api-access-4xsb6\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:56.911612 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.911496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/17f959f2-af03-410e-b53a-4a2a7a1e970d-config-volume\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:56.911612 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.911597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xsb6\" (UniqueName: \"kubernetes.io/projected/17f959f2-af03-410e-b53a-4a2a7a1e970d-kube-api-access-4xsb6\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:56.911819 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.911698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f959f2-af03-410e-b53a-4a2a7a1e970d-tmp-dir\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:56.911819 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.911726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:56.911819 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.911750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2cf53bc-8567-4b09-bb6a-378dbd919666-cert\") pod \"ingress-canary-66x6d\" (UID: \"c2cf53bc-8567-4b09-bb6a-378dbd919666\") " pod="openshift-ingress-canary/ingress-canary-66x6d" Jul 07 23:11:56.911819 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.911774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-579vn\" (UniqueName: \"kubernetes.io/projected/c2cf53bc-8567-4b09-bb6a-378dbd919666-kube-api-access-579vn\") pod \"ingress-canary-66x6d\" (UID: \"c2cf53bc-8567-4b09-bb6a-378dbd919666\") " pod="openshift-ingress-canary/ingress-canary-66x6d" Jul 07 23:11:56.912007 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:56.911899 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 23:11:56.912007 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:56.911968 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls podName:17f959f2-af03-410e-b53a-4a2a7a1e970d nodeName:}" failed. No retries permitted until 2026-07-07 23:11:57.411946071 +0000 UTC m=+36.633380418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls") pod "dns-default-6qlq4" (UID: "17f959f2-af03-410e-b53a-4a2a7a1e970d") : secret "dns-default-metrics-tls" not found Jul 07 23:11:56.912120 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.912044 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f959f2-af03-410e-b53a-4a2a7a1e970d-tmp-dir\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:56.912216 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.912193 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/17f959f2-af03-410e-b53a-4a2a7a1e970d-config-volume\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:56.916713 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.916694 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2cf53bc-8567-4b09-bb6a-378dbd919666-cert\") pod \"ingress-canary-66x6d\" (UID: \"c2cf53bc-8567-4b09-bb6a-378dbd919666\") " pod="openshift-ingress-canary/ingress-canary-66x6d" Jul 07 23:11:56.920269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.920240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xsb6\" (UniqueName: \"kubernetes.io/projected/17f959f2-af03-410e-b53a-4a2a7a1e970d-kube-api-access-4xsb6\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:56.920430 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.920415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-579vn\" (UniqueName: \"kubernetes.io/projected/c2cf53bc-8567-4b09-bb6a-378dbd919666-kube-api-access-579vn\") pod \"ingress-canary-66x6d\" (UID: \"c2cf53bc-8567-4b09-bb6a-378dbd919666\") " pod="openshift-ingress-canary/ingress-canary-66x6d" Jul 07 23:11:56.984097 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:56.984067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-66x6d" Jul 07 23:11:57.127582 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.127553 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-66x6d"] Jul 07 23:11:57.132548 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:11:57.132498 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2cf53bc_8567_4b09_bb6a_378dbd919666.slice/crio-3e7cb4b29a2adcd40d4c0acabece22156a1c922fcb66e54a93363e22401a691d WatchSource:0}: Error finding container 3e7cb4b29a2adcd40d4c0acabece22156a1c922fcb66e54a93363e22401a691d: Status 404 returned error can't find the container with id 3e7cb4b29a2adcd40d4c0acabece22156a1c922fcb66e54a93363e22401a691d Jul 07 23:11:57.264372 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.264335 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rmsnx"] Jul 07 23:11:57.267223 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.267203 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.269875 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.269854 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 23:11:57.270236 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.270218 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 23:11:57.270364 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.270338 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 23:11:57.270460 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.270431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 23:11:57.271389 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.271375 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xvbwm\"" Jul 07 23:11:57.277922 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.277903 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rmsnx"] Jul 07 23:11:57.300830 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.300806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:11:57.300830 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.300829 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:11:57.303455 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.303430 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 23:11:57.303603 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.303537 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tj8ww\"" Jul 07 23:11:57.303802 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.303774 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 23:11:57.303871 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.303809 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 23:11:57.416819 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.416782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/887a34a3-e940-4e2e-963b-e4f06cd969d2-data-volume\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.416819 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.416824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/887a34a3-e940-4e2e-963b-e4f06cd969d2-crio-socket\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.417052 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.416842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.417052 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.416938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.417052 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.417003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnmfq\" (UniqueName: \"kubernetes.io/projected/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-api-access-gnmfq\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.417195 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.417069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:57.417242 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:57.417204 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 23:11:57.417285 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:57.417272 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls podName:17f959f2-af03-410e-b53a-4a2a7a1e970d nodeName:}" failed. No retries permitted until 2026-07-07 23:11:58.417253043 +0000 UTC m=+37.638687386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls") pod "dns-default-6qlq4" (UID: "17f959f2-af03-410e-b53a-4a2a7a1e970d") : secret "dns-default-metrics-tls" not found Jul 07 23:11:57.518171 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.518090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/887a34a3-e940-4e2e-963b-e4f06cd969d2-data-volume\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.518171 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.518136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/887a34a3-e940-4e2e-963b-e4f06cd969d2-crio-socket\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.518171 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.518160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.518425 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.518221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.518425 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.518250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnmfq\" (UniqueName: \"kubernetes.io/projected/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-api-access-gnmfq\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.518425 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:57.518311 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 23:11:57.518425 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:57.518326 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 23:11:57.518425 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.518354 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/887a34a3-e940-4e2e-963b-e4f06cd969d2-crio-socket\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.518425 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:57.518385 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls podName:887a34a3-e940-4e2e-963b-e4f06cd969d2 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:58.018368849 +0000 UTC m=+37.239803179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rmsnx" (UID: "887a34a3-e940-4e2e-963b-e4f06cd969d2") : secret "insights-runtime-extractor-tls" not found Jul 07 23:11:57.518425 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:57.518400 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-rbac-proxy-cm podName:887a34a3-e940-4e2e-963b-e4f06cd969d2 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:58.018393359 +0000 UTC m=+37.239827687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rmsnx" (UID: "887a34a3-e940-4e2e-963b-e4f06cd969d2") : configmap "kube-rbac-proxy" not found Jul 07 23:11:57.518687 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.518456 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/887a34a3-e940-4e2e-963b-e4f06cd969d2-data-volume\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.529491 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.529316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnmfq\" (UniqueName: \"kubernetes.io/projected/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-api-access-gnmfq\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:57.535773 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:57.535742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-66x6d" event={"ID":"c2cf53bc-8567-4b09-bb6a-378dbd919666","Type":"ContainerStarted","Data":"3e7cb4b29a2adcd40d4c0acabece22156a1c922fcb66e54a93363e22401a691d"} Jul 07 23:11:58.023790 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.023752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:58.023790 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.023829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:58.024644 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:58.023936 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 23:11:58.024644 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:58.023935 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 23:11:58.024644 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:58.024002 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-rbac-proxy-cm podName:887a34a3-e940-4e2e-963b-e4f06cd969d2 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:59.023985283 +0000 UTC m=+38.245419627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rmsnx" (UID: "887a34a3-e940-4e2e-963b-e4f06cd969d2") : configmap "kube-rbac-proxy" not found Jul 07 23:11:58.024644 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:58.024019 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls podName:887a34a3-e940-4e2e-963b-e4f06cd969d2 nodeName:}" failed. No retries permitted until 2026-07-07 23:11:59.024011389 +0000 UTC m=+38.245445719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rmsnx" (UID: "887a34a3-e940-4e2e-963b-e4f06cd969d2") : secret "insights-runtime-extractor-tls" not found Jul 07 23:11:58.290491 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.290410 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7nfnc"] Jul 07 23:11:58.292732 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.292709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7nfnc" Jul 07 23:11:58.295569 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.295541 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 23:11:58.295843 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.295825 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 23:11:58.296828 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.296807 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bxsgx\"" Jul 07 23:11:58.300806 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.300731 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:11:58.303351 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.303326 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 23:11:58.303442 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.303378 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hfxvw\"" Jul 07 23:11:58.304601 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.304582 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7nfnc"] Jul 07 23:11:58.428249 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.428213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:11:58.428413 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.428271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkr7t\" (UniqueName: \"kubernetes.io/projected/a5cbd424-dd05-4dd7-b5d7-e308ac5d7b0b-kube-api-access-gkr7t\") pod \"migrator-d57d58cc9-7nfnc\" (UID: \"a5cbd424-dd05-4dd7-b5d7-e308ac5d7b0b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7nfnc" Jul 07 23:11:58.428413 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:58.428359 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 23:11:58.428498 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:58.428418 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls podName:17f959f2-af03-410e-b53a-4a2a7a1e970d nodeName:}" failed. No retries permitted until 2026-07-07 23:12:00.42840241 +0000 UTC m=+39.649836737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls") pod "dns-default-6qlq4" (UID: "17f959f2-af03-410e-b53a-4a2a7a1e970d") : secret "dns-default-metrics-tls" not found Jul 07 23:11:58.529170 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.529135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkr7t\" (UniqueName: \"kubernetes.io/projected/a5cbd424-dd05-4dd7-b5d7-e308ac5d7b0b-kube-api-access-gkr7t\") pod \"migrator-d57d58cc9-7nfnc\" (UID: \"a5cbd424-dd05-4dd7-b5d7-e308ac5d7b0b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7nfnc" Jul 07 23:11:58.538960 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.538934 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkr7t\" (UniqueName: \"kubernetes.io/projected/a5cbd424-dd05-4dd7-b5d7-e308ac5d7b0b-kube-api-access-gkr7t\") pod \"migrator-d57d58cc9-7nfnc\" (UID: \"a5cbd424-dd05-4dd7-b5d7-e308ac5d7b0b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7nfnc" Jul 07 23:11:58.606110 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:58.606001 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7nfnc" Jul 07 23:11:59.032439 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.032398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:59.032922 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.032507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:11:59.032922 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:59.032571 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 23:11:59.032922 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:59.032647 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-rbac-proxy-cm podName:887a34a3-e940-4e2e-963b-e4f06cd969d2 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:01.032626264 +0000 UTC m=+40.254060606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rmsnx" (UID: "887a34a3-e940-4e2e-963b-e4f06cd969d2") : configmap "kube-rbac-proxy" not found Jul 07 23:11:59.032922 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:59.032647 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 23:11:59.032922 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:11:59.032698 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls podName:887a34a3-e940-4e2e-963b-e4f06cd969d2 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:01.032686348 +0000 UTC m=+40.254120675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rmsnx" (UID: "887a34a3-e940-4e2e-963b-e4f06cd969d2") : secret "insights-runtime-extractor-tls" not found Jul 07 23:11:59.052454 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.052351 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5zw6t_fbb464bf-fb7f-4337-9e4d-60369b88912a/dns-node-resolver/0.log" Jul 07 23:11:59.551732 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.551695 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-r2xwq"] Jul 07 23:11:59.553715 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.553693 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-r2xwq" Jul 07 23:11:59.556398 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.556373 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 07 23:11:59.556508 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.556374 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 07 23:11:59.557713 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.557461 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5kjsj\"" Jul 07 23:11:59.557713 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.557461 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 07 23:11:59.557713 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.557491 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 07 23:11:59.562569 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.562546 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-r2xwq"] Jul 07 23:11:59.638576 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.638541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/da87ca33-5e89-4deb-9a3b-1f4c113bfd05-signing-key\") pod \"service-ca-758f599c5-r2xwq\" (UID: \"da87ca33-5e89-4deb-9a3b-1f4c113bfd05\") " pod="openshift-service-ca/service-ca-758f599c5-r2xwq" Jul 07 23:11:59.638754 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.638689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlx2r\" (UniqueName: \"kubernetes.io/projected/da87ca33-5e89-4deb-9a3b-1f4c113bfd05-kube-api-access-zlx2r\") pod \"service-ca-758f599c5-r2xwq\" (UID: \"da87ca33-5e89-4deb-9a3b-1f4c113bfd05\") " pod="openshift-service-ca/service-ca-758f599c5-r2xwq" Jul 07 23:11:59.638754 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.638738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/da87ca33-5e89-4deb-9a3b-1f4c113bfd05-signing-cabundle\") pod \"service-ca-758f599c5-r2xwq\" (UID: \"da87ca33-5e89-4deb-9a3b-1f4c113bfd05\") " pod="openshift-service-ca/service-ca-758f599c5-r2xwq" Jul 07 23:11:59.739946 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.739911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlx2r\" (UniqueName: \"kubernetes.io/projected/da87ca33-5e89-4deb-9a3b-1f4c113bfd05-kube-api-access-zlx2r\") pod \"service-ca-758f599c5-r2xwq\" (UID: \"da87ca33-5e89-4deb-9a3b-1f4c113bfd05\") " pod="openshift-service-ca/service-ca-758f599c5-r2xwq" Jul 07 23:11:59.740090 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.739963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/da87ca33-5e89-4deb-9a3b-1f4c113bfd05-signing-cabundle\") pod \"service-ca-758f599c5-r2xwq\" (UID: \"da87ca33-5e89-4deb-9a3b-1f4c113bfd05\") " pod="openshift-service-ca/service-ca-758f599c5-r2xwq" Jul 07 23:11:59.740090 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.740054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/da87ca33-5e89-4deb-9a3b-1f4c113bfd05-signing-key\") pod \"service-ca-758f599c5-r2xwq\" (UID: \"da87ca33-5e89-4deb-9a3b-1f4c113bfd05\") " pod="openshift-service-ca/service-ca-758f599c5-r2xwq" Jul 07 23:11:59.740944 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.740921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/da87ca33-5e89-4deb-9a3b-1f4c113bfd05-signing-cabundle\") pod \"service-ca-758f599c5-r2xwq\" (UID: \"da87ca33-5e89-4deb-9a3b-1f4c113bfd05\") " pod="openshift-service-ca/service-ca-758f599c5-r2xwq" Jul 07 23:11:59.743084 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.743064 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/da87ca33-5e89-4deb-9a3b-1f4c113bfd05-signing-key\") pod \"service-ca-758f599c5-r2xwq\" (UID: \"da87ca33-5e89-4deb-9a3b-1f4c113bfd05\") " pod="openshift-service-ca/service-ca-758f599c5-r2xwq" Jul 07 23:11:59.749939 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.749913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlx2r\" (UniqueName: \"kubernetes.io/projected/da87ca33-5e89-4deb-9a3b-1f4c113bfd05-kube-api-access-zlx2r\") pod \"service-ca-758f599c5-r2xwq\" (UID: \"da87ca33-5e89-4deb-9a3b-1f4c113bfd05\") " pod="openshift-service-ca/service-ca-758f599c5-r2xwq" Jul 07 23:11:59.864235 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:11:59.864157 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-r2xwq" Jul 07 23:12:00.052998 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:00.052972 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4nkdt_b24fbe48-6f49-4103-b35a-846f722f2eca/node-ca/0.log" Jul 07 23:12:00.446271 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:00.446228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:12:00.446441 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:12:00.446378 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 23:12:00.446539 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:12:00.446457 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls podName:17f959f2-af03-410e-b53a-4a2a7a1e970d nodeName:}" failed. No retries permitted until 2026-07-07 23:12:04.446434694 +0000 UTC m=+43.667869039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls") pod "dns-default-6qlq4" (UID: "17f959f2-af03-410e-b53a-4a2a7a1e970d") : secret "dns-default-metrics-tls" not found Jul 07 23:12:01.052175 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:01.052137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:12:01.052361 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:01.052209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:12:01.052361 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:12:01.052317 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 23:12:01.052472 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:12:01.052400 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls podName:887a34a3-e940-4e2e-963b-e4f06cd969d2 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:05.052378178 +0000 UTC m=+44.273812523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rmsnx" (UID: "887a34a3-e940-4e2e-963b-e4f06cd969d2") : secret "insights-runtime-extractor-tls" not found Jul 07 23:12:01.052632 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:01.052613 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887a34a3-e940-4e2e-963b-e4f06cd969d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:12:01.429490 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:01.429461 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7nfnc"] Jul 07 23:12:01.438638 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:12:01.438607 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5cbd424_dd05_4dd7_b5d7_e308ac5d7b0b.slice/crio-02ffbfdbca151e884f1c15239358c499ab0264ecc862e917c974065061c52c4a WatchSource:0}: Error finding container 02ffbfdbca151e884f1c15239358c499ab0264ecc862e917c974065061c52c4a: Status 404 returned error can't find the container with id 02ffbfdbca151e884f1c15239358c499ab0264ecc862e917c974065061c52c4a Jul 07 23:12:01.450254 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:01.450168 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-r2xwq"] Jul 07 23:12:01.453574 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:12:01.453552 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda87ca33_5e89_4deb_9a3b_1f4c113bfd05.slice/crio-270803fea0cfaa657353862481ad4c74902459f60d49d565c3617b5a39b28f1a WatchSource:0}: Error finding container 270803fea0cfaa657353862481ad4c74902459f60d49d565c3617b5a39b28f1a: Status 404 returned error can't find the container with id 270803fea0cfaa657353862481ad4c74902459f60d49d565c3617b5a39b28f1a Jul 07 23:12:01.548889 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:01.548855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7nfnc" event={"ID":"a5cbd424-dd05-4dd7-b5d7-e308ac5d7b0b","Type":"ContainerStarted","Data":"02ffbfdbca151e884f1c15239358c499ab0264ecc862e917c974065061c52c4a"} Jul 07 23:12:01.551990 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:01.551957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvk6j" event={"ID":"9583ff81-a722-44f2-8cce-11ad80ef4ca5","Type":"ContainerStarted","Data":"dfe735e85bf34cd1aecec151743913d06c67b41be45c279b10749b996b6e226a"} Jul 07 23:12:01.553741 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:01.553711 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-66x6d" event={"ID":"c2cf53bc-8567-4b09-bb6a-378dbd919666","Type":"ContainerStarted","Data":"973aacef52de72cd009e6eff0734c387ed0c040ab50d01f405ce966fef9f85ce"} Jul 07 23:12:01.554915 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:01.554889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-r2xwq" event={"ID":"da87ca33-5e89-4deb-9a3b-1f4c113bfd05","Type":"ContainerStarted","Data":"270803fea0cfaa657353862481ad4c74902459f60d49d565c3617b5a39b28f1a"} Jul 07 23:12:02.561239 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:02.561141 2576 generic.go:356] "Generic (PLEG): container finished" podID="9583ff81-a722-44f2-8cce-11ad80ef4ca5" containerID="dfe735e85bf34cd1aecec151743913d06c67b41be45c279b10749b996b6e226a" exitCode=0 Jul 07 23:12:02.561766 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:02.561229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvk6j" event={"ID":"9583ff81-a722-44f2-8cce-11ad80ef4ca5","Type":"ContainerDied","Data":"dfe735e85bf34cd1aecec151743913d06c67b41be45c279b10749b996b6e226a"} Jul 07 23:12:02.595784 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:02.595722 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-66x6d" podStartSLOduration=2.451153623 podStartE2EDuration="6.595701144s" totalImagesPullingTime="4.144547521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:01.609804617 +0000 UTC m=+40.831238969" watchObservedRunningTime="2026-07-07 23:12:02.595701144 +0000 UTC m=+41.817135494" Jul 07 23:12:03.567604 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:03.567568 2576 generic.go:356] "Generic (PLEG): container finished" podID="9583ff81-a722-44f2-8cce-11ad80ef4ca5" containerID="7fa2d28934a34f99f5cb3a2cd96ea3c307f51668195466b6c86642633451f9dd" exitCode=0 Jul 07 23:12:03.568018 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:03.567621 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvk6j" event={"ID":"9583ff81-a722-44f2-8cce-11ad80ef4ca5","Type":"ContainerDied","Data":"7fa2d28934a34f99f5cb3a2cd96ea3c307f51668195466b6c86642633451f9dd"} Jul 07 23:12:04.482548 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:04.482496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:12:04.482703 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:12:04.482673 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 23:12:04.482771 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:12:04.482757 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls podName:17f959f2-af03-410e-b53a-4a2a7a1e970d nodeName:}" failed. No retries permitted until 2026-07-07 23:12:12.482734388 +0000 UTC m=+51.704168732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls") pod "dns-default-6qlq4" (UID: "17f959f2-af03-410e-b53a-4a2a7a1e970d") : secret "dns-default-metrics-tls" not found Jul 07 23:12:04.572293 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:04.572204 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7nfnc" event={"ID":"a5cbd424-dd05-4dd7-b5d7-e308ac5d7b0b","Type":"ContainerStarted","Data":"11793a2636010b93a5d3401865fcbc644193b7e953c44e6ca7d64104990964a1"} Jul 07 23:12:04.572758 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:04.572292 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7nfnc" event={"ID":"a5cbd424-dd05-4dd7-b5d7-e308ac5d7b0b","Type":"ContainerStarted","Data":"9ec117d2483beeb8f93ebc5ff0e88b809aca8d47c1efb03cd1fa49be3ce5eb37"} Jul 07 23:12:04.575674 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:04.575646 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvk6j" event={"ID":"9583ff81-a722-44f2-8cce-11ad80ef4ca5","Type":"ContainerStarted","Data":"beedd8b8543bbc4716e757dfa1043e3ff979fd59801ab372e38eb5e2d0aba940"} Jul 07 23:12:04.577103 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:04.577083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-r2xwq" event={"ID":"da87ca33-5e89-4deb-9a3b-1f4c113bfd05","Type":"ContainerStarted","Data":"7e42cb1abe270abab64cb5ee43ff56d90a6e41ba847299708d068564399cb659"} Jul 07 23:12:04.589357 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:04.589308 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7nfnc" podStartSLOduration=4.086469184 podStartE2EDuration="6.589290449s" totalImagesPullingTime="2.502821265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:04.588788745 +0000 UTC m=+43.810223096" watchObservedRunningTime="2026-07-07 23:12:04.589290449 +0000 UTC m=+43.810724799" Jul 07 23:12:04.614657 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:04.614619 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tvk6j" podStartSLOduration=8.57849348 podStartE2EDuration="42.614607388s" totalImagesPullingTime="34.036113908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:04.614104882 +0000 UTC m=+43.835539232" watchObservedRunningTime="2026-07-07 23:12:04.614607388 +0000 UTC m=+43.836041737" Jul 07 23:12:04.630995 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:04.630943 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-r2xwq" podStartSLOduration=2.78777194 podStartE2EDuration="5.630927843s" totalImagesPullingTime="2.843155903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:04.630283575 +0000 UTC m=+43.851717924" watchObservedRunningTime="2026-07-07 23:12:04.630927843 +0000 UTC m=+43.852362192" Jul 07 23:12:05.088376 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:05.088332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:12:05.088555 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:12:05.088471 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 23:12:05.088599 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:12:05.088564 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls podName:887a34a3-e940-4e2e-963b-e4f06cd969d2 nodeName:}" failed. No retries permitted until 2026-07-07 23:12:13.088546673 +0000 UTC m=+52.309981003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rmsnx" (UID: "887a34a3-e940-4e2e-963b-e4f06cd969d2") : secret "insights-runtime-extractor-tls" not found Jul 07 23:12:12.545460 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:12.545424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:12:12.548272 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:12.548249 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/17f959f2-af03-410e-b53a-4a2a7a1e970d-metrics-tls\") pod \"dns-default-6qlq4\" (UID: \"17f959f2-af03-410e-b53a-4a2a7a1e970d\") " pod="openshift-dns/dns-default-6qlq4" Jul 07 23:12:12.579230 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:12.579204 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qlq4" Jul 07 23:12:12.751708 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:12.751678 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6qlq4"] Jul 07 23:12:12.756249 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:12:12.756222 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f959f2_af03_410e_b53a_4a2a7a1e970d.slice/crio-bd688cb1a6ef6f12e4c7b5f32a596a64be6adf593c969d4fe773a994bc138b5e WatchSource:0}: Error finding container bd688cb1a6ef6f12e4c7b5f32a596a64be6adf593c969d4fe773a994bc138b5e: Status 404 returned error can't find the container with id bd688cb1a6ef6f12e4c7b5f32a596a64be6adf593c969d4fe773a994bc138b5e Jul 07 23:12:13.150141 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:13.150100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:12:13.153057 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:13.153013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887a34a3-e940-4e2e-963b-e4f06cd969d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rmsnx\" (UID: \"887a34a3-e940-4e2e-963b-e4f06cd969d2\") " pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:12:13.177958 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:13.177921 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rmsnx" Jul 07 23:12:13.347724 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:13.347695 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rmsnx"] Jul 07 23:12:13.351636 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:12:13.351604 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887a34a3_e940_4e2e_963b_e4f06cd969d2.slice/crio-34de74bf0b13ac161fb6463252beef3d623c5e538511730d0d1424fb439a318a WatchSource:0}: Error finding container 34de74bf0b13ac161fb6463252beef3d623c5e538511730d0d1424fb439a318a: Status 404 returned error can't find the container with id 34de74bf0b13ac161fb6463252beef3d623c5e538511730d0d1424fb439a318a Jul 07 23:12:13.601751 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:13.601710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rmsnx" event={"ID":"887a34a3-e940-4e2e-963b-e4f06cd969d2","Type":"ContainerStarted","Data":"34de74bf0b13ac161fb6463252beef3d623c5e538511730d0d1424fb439a318a"} Jul 07 23:12:13.602950 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:13.602924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qlq4" event={"ID":"17f959f2-af03-410e-b53a-4a2a7a1e970d","Type":"ContainerStarted","Data":"bd688cb1a6ef6f12e4c7b5f32a596a64be6adf593c969d4fe773a994bc138b5e"} Jul 07 23:12:18.620002 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:18.619910 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rmsnx" event={"ID":"887a34a3-e940-4e2e-963b-e4f06cd969d2","Type":"ContainerStarted","Data":"fb9607083fd1b79fe1c15e1fc81223bdb070f8e16a09e473b753b20458b79cc3"} Jul 07 23:12:18.620002 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:18.619979 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rmsnx" event={"ID":"887a34a3-e940-4e2e-963b-e4f06cd969d2","Type":"ContainerStarted","Data":"32e7159ad89f1d7c3a73d167ec70f344b69856b4df1b5053d95b7f8d62d2f5b7"} Jul 07 23:12:18.621824 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:18.621800 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qlq4" event={"ID":"17f959f2-af03-410e-b53a-4a2a7a1e970d","Type":"ContainerStarted","Data":"bec1c1fc0b693e10181ce81f491ba87ac60439c944c2cfcaad6ee8ec25a0e9cb"} Jul 07 23:12:18.621944 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:18.621843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qlq4" event={"ID":"17f959f2-af03-410e-b53a-4a2a7a1e970d","Type":"ContainerStarted","Data":"ca5d1bada78c5975c4f2132b1285700e13c88d61ca3ac79606fea80d8dff8395"} Jul 07 23:12:18.622000 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:18.621937 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6qlq4" Jul 07 23:12:21.635344 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:21.635303 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rmsnx" event={"ID":"887a34a3-e940-4e2e-963b-e4f06cd969d2","Type":"ContainerStarted","Data":"0762baac54f626c47905684a2d1eb382401df83f5e66cc2ba8134d7b6c33aef6"} Jul 07 23:12:21.658167 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:21.658103 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6qlq4" podStartSLOduration=20.794735514 podStartE2EDuration="25.658084259s" totalImagesPullingTime="4.863348745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:18.637975376 +0000 UTC m=+57.859409727" watchObservedRunningTime="2026-07-07 23:12:21.658084259 +0000 UTC m=+60.879518612" Jul 07 23:12:23.522222 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.522162 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rmsnx" podStartSLOduration=19.163604503 podStartE2EDuration="26.522141451s" totalImagesPullingTime="7.358536948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:21.658286046 +0000 UTC m=+60.879720395" watchObservedRunningTime="2026-07-07 23:12:23.522141451 +0000 UTC m=+62.743575793" Jul 07 23:12:23.523323 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.523299 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8"] Jul 07 23:12:23.559325 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.559298 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8"] Jul 07 23:12:23.559481 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.559418 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7f2fb" Jul 07 23:12:23.559609 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.559483 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.562575 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.562556 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 23:12:23.563679 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.563660 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 07 23:12:23.567090 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.567068 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 07 23:12:23.568669 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.568653 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 07 23:12:23.569680 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.569665 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 23:12:23.569942 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.569929 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 07 23:12:23.576168 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.576149 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 23:12:23.630101 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.630068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5added99-f3dc-4857-82a5-1a19dc1e3952-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.630264 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.630243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5added99-f3dc-4857-82a5-1a19dc1e3952-ca\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.630329 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.630274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5added99-f3dc-4857-82a5-1a19dc1e3952-hub\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.630391 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.630339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5added99-f3dc-4857-82a5-1a19dc1e3952-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.630391 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.630359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twwj4\" (UniqueName: \"kubernetes.io/projected/5added99-f3dc-4857-82a5-1a19dc1e3952-kube-api-access-twwj4\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.630391 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.630381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5added99-f3dc-4857-82a5-1a19dc1e3952-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.730967 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.730922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5added99-f3dc-4857-82a5-1a19dc1e3952-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.731136 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.730998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5added99-f3dc-4857-82a5-1a19dc1e3952-ca\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.731136 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.731017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5added99-f3dc-4857-82a5-1a19dc1e3952-hub\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.731136 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.731037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5added99-f3dc-4857-82a5-1a19dc1e3952-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.731136 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.731054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twwj4\" (UniqueName: \"kubernetes.io/projected/5added99-f3dc-4857-82a5-1a19dc1e3952-kube-api-access-twwj4\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.731136 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.731072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5added99-f3dc-4857-82a5-1a19dc1e3952-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.732044 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.732014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5added99-f3dc-4857-82a5-1a19dc1e3952-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.733718 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.733696 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5added99-f3dc-4857-82a5-1a19dc1e3952-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.733813 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.733759 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5added99-f3dc-4857-82a5-1a19dc1e3952-ca\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.733859 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.733813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5added99-f3dc-4857-82a5-1a19dc1e3952-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.733957 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.733936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5added99-f3dc-4857-82a5-1a19dc1e3952-hub\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.742051 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.742031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twwj4\" (UniqueName: \"kubernetes.io/projected/5added99-f3dc-4857-82a5-1a19dc1e3952-kube-api-access-twwj4\") pod \"cluster-proxy-proxy-agent-84988df9ff-dwpg8\" (UID: \"5added99-f3dc-4857-82a5-1a19dc1e3952\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:23.877804 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:23.877726 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" Jul 07 23:12:24.076869 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:24.076844 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8"] Jul 07 23:12:24.079203 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:12:24.079180 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5added99_f3dc_4857_82a5_1a19dc1e3952.slice/crio-096c09545f6fd4c461d66927a05bbe2a9f93da9d732d8c24e9bd543dc5be7852 WatchSource:0}: Error finding container 096c09545f6fd4c461d66927a05bbe2a9f93da9d732d8c24e9bd543dc5be7852: Status 404 returned error can't find the container with id 096c09545f6fd4c461d66927a05bbe2a9f93da9d732d8c24e9bd543dc5be7852 Jul 07 23:12:24.644576 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:24.644533 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" event={"ID":"5added99-f3dc-4857-82a5-1a19dc1e3952","Type":"ContainerStarted","Data":"096c09545f6fd4c461d66927a05bbe2a9f93da9d732d8c24e9bd543dc5be7852"} Jul 07 23:12:26.958871 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:26.958831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwpx\" (UniqueName: \"kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx\") pod \"network-check-target-65tk4\" (UID: \"ac6868f6-fc8f-47c0-b103-7b366bb3844e\") " pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:12:26.961877 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:26.961859 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 23:12:26.972495 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:26.972464 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 23:12:26.982556 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:26.982511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkwpx\" (UniqueName: \"kubernetes.io/projected/ac6868f6-fc8f-47c0-b103-7b366bb3844e-kube-api-access-vkwpx\") pod \"network-check-target-65tk4\" (UID: \"ac6868f6-fc8f-47c0-b103-7b366bb3844e\") " pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:12:27.018086 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:27.018054 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tj8ww\"" Jul 07 23:12:27.023435 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:27.023414 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:12:27.060048 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:27.060016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:12:27.060174 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:27.060064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:12:27.063308 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:27.063278 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 23:12:27.063416 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:27.063292 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 23:12:27.073475 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:27.073419 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0f28df4-16eb-4de1-ac26-a54f20a2f998-original-pull-secret\") pod \"global-pull-secret-syncer-dxqh9\" (UID: \"a0f28df4-16eb-4de1-ac26-a54f20a2f998\") " pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:12:27.073597 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:27.073577 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e9befa-834d-41aa-9c87-b573c269b87f-metrics-certs\") pod \"network-metrics-daemon-q9d2t\" (UID: \"e0e9befa-834d-41aa-9c87-b573c269b87f\") " pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:12:27.118974 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:27.118941 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hfxvw\"" Jul 07 23:12:27.123412 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:27.123384 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9d2t" Jul 07 23:12:27.318984 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:27.318954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxqh9" Jul 07 23:12:28.237206 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:28.237178 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q9d2t"] Jul 07 23:12:28.241193 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:12:28.241158 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e9befa_834d_41aa_9c87_b573c269b87f.slice/crio-1971fef4e91087c568cb78b130e9e704851a1741672a13d92e0cea8a77a79cdf WatchSource:0}: Error finding container 1971fef4e91087c568cb78b130e9e704851a1741672a13d92e0cea8a77a79cdf: Status 404 returned error can't find the container with id 1971fef4e91087c568cb78b130e9e704851a1741672a13d92e0cea8a77a79cdf Jul 07 23:12:28.249065 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:28.248963 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-65tk4"] Jul 07 23:12:28.252888 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:12:28.252861 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac6868f6_fc8f_47c0_b103_7b366bb3844e.slice/crio-89e7f785bbc2eafd035bbdb62edd8e60644fab8c6e0031b810b392b5a20ff9ce WatchSource:0}: Error finding container 89e7f785bbc2eafd035bbdb62edd8e60644fab8c6e0031b810b392b5a20ff9ce: Status 404 returned error can't find the container with id 89e7f785bbc2eafd035bbdb62edd8e60644fab8c6e0031b810b392b5a20ff9ce Jul 07 23:12:28.267059 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:28.267035 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dxqh9"] Jul 07 23:12:28.269702 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:12:28.269682 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f28df4_16eb_4de1_ac26_a54f20a2f998.slice/crio-22df69b538cdb7c228075a0d264ffa9172de0bbcf5a8702bda04661ed1a33fc8 WatchSource:0}: Error finding container 22df69b538cdb7c228075a0d264ffa9172de0bbcf5a8702bda04661ed1a33fc8: Status 404 returned error can't find the container with id 22df69b538cdb7c228075a0d264ffa9172de0bbcf5a8702bda04661ed1a33fc8 Jul 07 23:12:28.629081 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:28.628996 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6qlq4" Jul 07 23:12:28.660680 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:28.660647 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dxqh9" event={"ID":"a0f28df4-16eb-4de1-ac26-a54f20a2f998","Type":"ContainerStarted","Data":"22df69b538cdb7c228075a0d264ffa9172de0bbcf5a8702bda04661ed1a33fc8"} Jul 07 23:12:28.662985 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:28.662955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" event={"ID":"5added99-f3dc-4857-82a5-1a19dc1e3952","Type":"ContainerStarted","Data":"8f64e27ea0d53d9dcd3cc2544cc4f6186242ce25a523df40caabc064631947cc"} Jul 07 23:12:28.663096 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:28.662997 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" event={"ID":"5added99-f3dc-4857-82a5-1a19dc1e3952","Type":"ContainerStarted","Data":"901420a25ea9d3afe867cf19665c1a4ca89e25c361fcc7ef195965bfb9228b99"} Jul 07 23:12:28.663096 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:28.663013 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" event={"ID":"5added99-f3dc-4857-82a5-1a19dc1e3952","Type":"ContainerStarted","Data":"b2eb0404ecc343bf8f70e163b69e4c5cf0f8fca43e079c4da54e9221e52df4c8"} Jul 07 23:12:28.664176 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:28.664154 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-65tk4" event={"ID":"ac6868f6-fc8f-47c0-b103-7b366bb3844e","Type":"ContainerStarted","Data":"89e7f785bbc2eafd035bbdb62edd8e60644fab8c6e0031b810b392b5a20ff9ce"} Jul 07 23:12:28.665505 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:28.665485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q9d2t" event={"ID":"e0e9befa-834d-41aa-9c87-b573c269b87f","Type":"ContainerStarted","Data":"1971fef4e91087c568cb78b130e9e704851a1741672a13d92e0cea8a77a79cdf"} Jul 07 23:12:28.680491 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:28.680441 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84988df9ff-dwpg8" podStartSLOduration=1.623781804 podStartE2EDuration="5.680427884s" totalImagesPullingTime="4.05664608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:28.680227611 +0000 UTC m=+67.901661960" watchObservedRunningTime="2026-07-07 23:12:28.680427884 +0000 UTC m=+67.901862233" Jul 07 23:12:29.678429 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:29.678183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q9d2t" event={"ID":"e0e9befa-834d-41aa-9c87-b573c269b87f","Type":"ContainerStarted","Data":"519418673f81fa205f1038eb4ccb0aadb63bbad3fba3334bd9baea5cc363c50b"} Jul 07 23:12:29.678429 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:29.678251 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q9d2t" event={"ID":"e0e9befa-834d-41aa-9c87-b573c269b87f","Type":"ContainerStarted","Data":"307d2bdea348fd2ca2151a4e725cf22599a42371a3df07f99fe96e34ffdb92bb"} Jul 07 23:12:33.698887 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:33.698846 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dxqh9" event={"ID":"a0f28df4-16eb-4de1-ac26-a54f20a2f998","Type":"ContainerStarted","Data":"a13455595ecf2210233a103da00f425399fa6ea35dca13e38f1be9bf58ee6f6e"} Jul 07 23:12:33.700318 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:33.700294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-65tk4" event={"ID":"ac6868f6-fc8f-47c0-b103-7b366bb3844e","Type":"ContainerStarted","Data":"700106c75887145de83f7453ad7ecf88c34eb38b42ed27d933563b7274a5155d"} Jul 07 23:12:33.700425 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:33.700414 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:12:33.722251 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:33.722204 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q9d2t" podStartSLOduration=70.633311753 podStartE2EDuration="1m11.722187298s" totalImagesPullingTime="1.088875545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:29.695948641 +0000 UTC m=+68.917382991" watchObservedRunningTime="2026-07-07 23:12:33.722187298 +0000 UTC m=+72.943621647" Jul 07 23:12:33.723379 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:33.723345 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dxqh9" podStartSLOduration=66.944465263 podStartE2EDuration="1m11.723335659s" totalImagesPullingTime="4.778870396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:33.721282438 +0000 UTC m=+72.942716788" watchObservedRunningTime="2026-07-07 23:12:33.723335659 +0000 UTC m=+72.944770007" Jul 07 23:12:33.755384 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:33.755344 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-65tk4" podStartSLOduration=66.962901957 podStartE2EDuration="1m11.755330316s" totalImagesPullingTime="4.792428359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:33.754948275 +0000 UTC m=+72.976382624" watchObservedRunningTime="2026-07-07 23:12:33.755330316 +0000 UTC m=+72.976764664" Jul 07 23:12:40.836348 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.836305 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4"] Jul 07 23:12:40.839451 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.839428 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:40.843412 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.843390 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 23:12:40.843565 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.843389 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 23:12:40.844749 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.844676 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 23:12:40.844863 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.844844 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 23:12:40.844937 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.844901 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lcsb9\"" Jul 07 23:12:40.845057 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.845036 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 23:12:40.855916 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.855889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4"] Jul 07 23:12:40.869194 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.869169 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl"] Jul 07 23:12:40.872149 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.872132 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:40.877492 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.877467 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 23:12:40.877858 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.877760 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 23:12:40.877928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.877909 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 23:12:40.878332 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.878302 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qz692\"" Jul 07 23:12:40.897728 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.897704 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl"] Jul 07 23:12:40.926239 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.926206 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rr2qg"] Jul 07 23:12:40.929496 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.929478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:40.935811 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.935791 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 23:12:40.935992 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.935973 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 23:12:40.936084 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.936067 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s7wx8\"" Jul 07 23:12:40.937028 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.937010 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 23:12:40.958700 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.958674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb97b6f5-9428-4303-b584-8d6377ef5ef3-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5w4b4\" (UID: \"eb97b6f5-9428-4303-b584-8d6377ef5ef3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:40.958799 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.958702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/428587b3-b08e-4b12-8e18-40e2869d4f51-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:40.958799 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.958733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/428587b3-b08e-4b12-8e18-40e2869d4f51-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:40.958873 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.958802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/428587b3-b08e-4b12-8e18-40e2869d4f51-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:40.958873 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.958828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb97b6f5-9428-4303-b584-8d6377ef5ef3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5w4b4\" (UID: \"eb97b6f5-9428-4303-b584-8d6377ef5ef3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:40.958873 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.958848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8flz9\" (UniqueName: \"kubernetes.io/projected/eb97b6f5-9428-4303-b584-8d6377ef5ef3-kube-api-access-8flz9\") pod \"openshift-state-metrics-54cf96dfcf-5w4b4\" (UID: \"eb97b6f5-9428-4303-b584-8d6377ef5ef3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:40.958962 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.958870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428587b3-b08e-4b12-8e18-40e2869d4f51-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:40.958962 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.958897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/428587b3-b08e-4b12-8e18-40e2869d4f51-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:40.958962 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.958916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf9p9\" (UniqueName: \"kubernetes.io/projected/428587b3-b08e-4b12-8e18-40e2869d4f51-kube-api-access-pf9p9\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:40.958962 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:40.958948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb97b6f5-9428-4303-b584-8d6377ef5ef3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5w4b4\" (UID: \"eb97b6f5-9428-4303-b584-8d6377ef5ef3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:41.059462 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-tls\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.059462 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb97b6f5-9428-4303-b584-8d6377ef5ef3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5w4b4\" (UID: \"eb97b6f5-9428-4303-b584-8d6377ef5ef3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:41.059659 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb97b6f5-9428-4303-b584-8d6377ef5ef3-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5w4b4\" (UID: \"eb97b6f5-9428-4303-b584-8d6377ef5ef3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:41.059659 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/428587b3-b08e-4b12-8e18-40e2869d4f51-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.059740 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-metrics-client-ca\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.059740 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/428587b3-b08e-4b12-8e18-40e2869d4f51-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.059740 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.059856 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059763 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgzcf\" (UniqueName: \"kubernetes.io/projected/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-kube-api-access-tgzcf\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.059856 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-accelerators-collector-config\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.059947 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059883 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-textfile\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.059947 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/428587b3-b08e-4b12-8e18-40e2869d4f51-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.060034 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-wtmp\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.060034 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.059980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-sys\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.060137 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.060115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb97b6f5-9428-4303-b584-8d6377ef5ef3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5w4b4\" (UID: \"eb97b6f5-9428-4303-b584-8d6377ef5ef3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:41.060191 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.060160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8flz9\" (UniqueName: \"kubernetes.io/projected/eb97b6f5-9428-4303-b584-8d6377ef5ef3-kube-api-access-8flz9\") pod \"openshift-state-metrics-54cf96dfcf-5w4b4\" (UID: \"eb97b6f5-9428-4303-b584-8d6377ef5ef3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:41.060249 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.060199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428587b3-b08e-4b12-8e18-40e2869d4f51-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.060249 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.060232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/428587b3-b08e-4b12-8e18-40e2869d4f51-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.060369 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.060256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-root\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.060369 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.060257 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb97b6f5-9428-4303-b584-8d6377ef5ef3-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5w4b4\" (UID: \"eb97b6f5-9428-4303-b584-8d6377ef5ef3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:41.060369 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.060291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf9p9\" (UniqueName: \"kubernetes.io/projected/428587b3-b08e-4b12-8e18-40e2869d4f51-kube-api-access-pf9p9\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.060369 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.060331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/428587b3-b08e-4b12-8e18-40e2869d4f51-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.060693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.060625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/428587b3-b08e-4b12-8e18-40e2869d4f51-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.061150 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.061128 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/428587b3-b08e-4b12-8e18-40e2869d4f51-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.062336 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.062306 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/428587b3-b08e-4b12-8e18-40e2869d4f51-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.062415 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.062384 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb97b6f5-9428-4303-b584-8d6377ef5ef3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5w4b4\" (UID: \"eb97b6f5-9428-4303-b584-8d6377ef5ef3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:41.062468 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.062453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/428587b3-b08e-4b12-8e18-40e2869d4f51-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.063113 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.063094 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb97b6f5-9428-4303-b584-8d6377ef5ef3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5w4b4\" (UID: \"eb97b6f5-9428-4303-b584-8d6377ef5ef3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:41.075912 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.075887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf9p9\" (UniqueName: \"kubernetes.io/projected/428587b3-b08e-4b12-8e18-40e2869d4f51-kube-api-access-pf9p9\") pod \"kube-state-metrics-7c9dbb8b7d-4l4sl\" (UID: \"428587b3-b08e-4b12-8e18-40e2869d4f51\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.077900 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.077879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8flz9\" (UniqueName: \"kubernetes.io/projected/eb97b6f5-9428-4303-b584-8d6377ef5ef3-kube-api-access-8flz9\") pod \"openshift-state-metrics-54cf96dfcf-5w4b4\" (UID: \"eb97b6f5-9428-4303-b584-8d6377ef5ef3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:41.148869 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.148793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" Jul 07 23:12:41.161043 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-root\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.161158 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-tls\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.161158 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-metrics-client-ca\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.161158 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.161310 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161150 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-root\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.161430 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgzcf\" (UniqueName: \"kubernetes.io/projected/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-kube-api-access-tgzcf\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.161650 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-accelerators-collector-config\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.161819 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-metrics-client-ca\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.161819 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-textfile\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.161819 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161815 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-wtmp\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.162184 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-sys\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.162184 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161943 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-wtmp\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.162184 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.161991 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-sys\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.162333 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.162233 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-textfile\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.162716 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.162693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-accelerators-collector-config\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.163968 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.163946 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-tls\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.164069 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.164036 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.172956 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.172937 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgzcf\" (UniqueName: \"kubernetes.io/projected/9ffc2c93-5b5c-4e8a-a291-13763ac9aee1-kube-api-access-tgzcf\") pod \"node-exporter-rr2qg\" (UID: \"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1\") " pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.180859 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.180841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" Jul 07 23:12:41.237799 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.237772 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rr2qg" Jul 07 23:12:41.254131 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:12:41.254096 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ffc2c93_5b5c_4e8a_a291_13763ac9aee1.slice/crio-20abe347afd5dd23e0cc046818e5b4f09c96f14a0d1ddedf2652fc10fb72474b WatchSource:0}: Error finding container 20abe347afd5dd23e0cc046818e5b4f09c96f14a0d1ddedf2652fc10fb72474b: Status 404 returned error can't find the container with id 20abe347afd5dd23e0cc046818e5b4f09c96f14a0d1ddedf2652fc10fb72474b Jul 07 23:12:41.310620 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.310582 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4"] Jul 07 23:12:41.314780 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:12:41.314759 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb97b6f5_9428_4303_b584_8d6377ef5ef3.slice/crio-3c3bfd914662c474733975e8b7bc974254649fe77b28211927a996af7ffdcc4e WatchSource:0}: Error finding container 3c3bfd914662c474733975e8b7bc974254649fe77b28211927a996af7ffdcc4e: Status 404 returned error can't find the container with id 3c3bfd914662c474733975e8b7bc974254649fe77b28211927a996af7ffdcc4e Jul 07 23:12:41.336238 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.336205 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl"] Jul 07 23:12:41.346498 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:12:41.346476 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428587b3_b08e_4b12_8e18_40e2869d4f51.slice/crio-8d24567820bebf3ad2f6197dfd0a52b82a0db90e63587fb833522c0ae024071b WatchSource:0}: Error finding container 8d24567820bebf3ad2f6197dfd0a52b82a0db90e63587fb833522c0ae024071b: Status 404 returned error can't find the container with id 8d24567820bebf3ad2f6197dfd0a52b82a0db90e63587fb833522c0ae024071b Jul 07 23:12:41.728571 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.728505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" event={"ID":"eb97b6f5-9428-4303-b584-8d6377ef5ef3","Type":"ContainerStarted","Data":"70669ba7f5e63c0d72fd169625ae3722b0ec5e26c892c2be673c2c94a5774ecb"} Jul 07 23:12:41.728733 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.728615 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" event={"ID":"eb97b6f5-9428-4303-b584-8d6377ef5ef3","Type":"ContainerStarted","Data":"00a5687e0c02a16a831747433ecac729a02bc7c56fa57f515af5db7f4ca46173"} Jul 07 23:12:41.728733 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.728650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" event={"ID":"eb97b6f5-9428-4303-b584-8d6377ef5ef3","Type":"ContainerStarted","Data":"3c3bfd914662c474733975e8b7bc974254649fe77b28211927a996af7ffdcc4e"} Jul 07 23:12:41.729894 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.729870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rr2qg" event={"ID":"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1","Type":"ContainerStarted","Data":"20abe347afd5dd23e0cc046818e5b4f09c96f14a0d1ddedf2652fc10fb72474b"} Jul 07 23:12:41.731041 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:41.731013 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" event={"ID":"428587b3-b08e-4b12-8e18-40e2869d4f51","Type":"ContainerStarted","Data":"8d24567820bebf3ad2f6197dfd0a52b82a0db90e63587fb833522c0ae024071b"} Jul 07 23:12:43.741422 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:43.741383 2576 generic.go:356] "Generic (PLEG): container finished" podID="9ffc2c93-5b5c-4e8a-a291-13763ac9aee1" containerID="4c74692d5e9a26f242d15d00d68dbd12f1b91e06ebaa87999813bc7d9ab59688" exitCode=0 Jul 07 23:12:43.741937 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:43.741488 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rr2qg" event={"ID":"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1","Type":"ContainerDied","Data":"4c74692d5e9a26f242d15d00d68dbd12f1b91e06ebaa87999813bc7d9ab59688"} Jul 07 23:12:43.744534 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:43.744481 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" event={"ID":"428587b3-b08e-4b12-8e18-40e2869d4f51","Type":"ContainerStarted","Data":"31cb6cb652d9505a2e719b19cf4148c9f8e8e1e57ddd417645239828420fe1af"} Jul 07 23:12:43.744668 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:43.744559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" event={"ID":"428587b3-b08e-4b12-8e18-40e2869d4f51","Type":"ContainerStarted","Data":"5ff3ba900540a92fc21ecc23cd1d867ba0d2b61b81680258d03b0903449396fb"} Jul 07 23:12:43.744668 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:43.744592 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" event={"ID":"428587b3-b08e-4b12-8e18-40e2869d4f51","Type":"ContainerStarted","Data":"7e244fe4cf63565f5762ea3ebd544eaa708f69f998e371aa7eb95c4a54eb101e"} Jul 07 23:12:43.747129 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:43.747102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" event={"ID":"eb97b6f5-9428-4303-b584-8d6377ef5ef3","Type":"ContainerStarted","Data":"8276122524d8506fa4c57597f936872b7154a92e8a88f31d73b39187d74d0acd"} Jul 07 23:12:43.797429 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:43.797383 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5w4b4" podStartSLOduration=2.221113045 podStartE2EDuration="3.79736826s" totalImagesPullingTime="1.576255215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:43.796206217 +0000 UTC m=+83.017640568" watchObservedRunningTime="2026-07-07 23:12:43.79736826 +0000 UTC m=+83.018802608" Jul 07 23:12:43.832766 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:43.832708 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-4l4sl" podStartSLOduration=2.162259117 podStartE2EDuration="3.832686819s" totalImagesPullingTime="1.670427702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:43.827834754 +0000 UTC m=+83.049269132" watchObservedRunningTime="2026-07-07 23:12:43.832686819 +0000 UTC m=+83.054121165" Jul 07 23:12:44.752605 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:44.752562 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rr2qg" event={"ID":"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1","Type":"ContainerStarted","Data":"c6b813fb1666a89cff0b971894cf1282d245909cda530d7996efdc94ba02f347"} Jul 07 23:12:44.752965 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:44.752657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rr2qg" event={"ID":"9ffc2c93-5b5c-4e8a-a291-13763ac9aee1","Type":"ContainerStarted","Data":"4e00676a72cb4e46c59afe7323fb0731372f1449bf9f679cc92f07340afc3565"} Jul 07 23:12:44.777232 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:12:44.777191 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rr2qg" podStartSLOduration=2.9206374950000002 podStartE2EDuration="4.777176343s" totalImagesPullingTime="1.760433706s" totalInitContainerRuntime="96.105142ms" isStatefulPod=true podCreationTimestamp="2026-07-07 23:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:12:44.776020471 +0000 UTC m=+83.997454823" watchObservedRunningTime="2026-07-07 23:12:44.777176343 +0000 UTC m=+83.998610693" Jul 07 23:13:04.705608 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:13:04.705511 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-65tk4" Jul 07 23:13:12.892811 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:13:12.892779 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-66x6d_c2cf53bc-8567-4b09-bb6a-378dbd919666/serve-healthcheck-canary/0.log" Jul 07 23:16:18.158375 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.158337 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j"] Jul 07 23:16:18.162284 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.162257 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j" Jul 07 23:16:18.165093 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.165073 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 23:16:18.165218 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.165074 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xhm74\"" Jul 07 23:16:18.165218 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.165135 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 23:16:18.178826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.178800 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j"] Jul 07 23:16:18.273881 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.273851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e8d974f-a9db-4279-b7cc-62c183bdbad6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f876j\" (UID: \"4e8d974f-a9db-4279-b7cc-62c183bdbad6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j" Jul 07 23:16:18.274032 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.273901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzp8m\" (UniqueName: \"kubernetes.io/projected/4e8d974f-a9db-4279-b7cc-62c183bdbad6-kube-api-access-pzp8m\") pod \"cert-manager-operator-controller-manager-55c444bf86-f876j\" (UID: \"4e8d974f-a9db-4279-b7cc-62c183bdbad6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j" Jul 07 23:16:18.374249 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.374217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e8d974f-a9db-4279-b7cc-62c183bdbad6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f876j\" (UID: \"4e8d974f-a9db-4279-b7cc-62c183bdbad6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j" Jul 07 23:16:18.374422 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.374342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzp8m\" (UniqueName: \"kubernetes.io/projected/4e8d974f-a9db-4279-b7cc-62c183bdbad6-kube-api-access-pzp8m\") pod \"cert-manager-operator-controller-manager-55c444bf86-f876j\" (UID: \"4e8d974f-a9db-4279-b7cc-62c183bdbad6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j" Jul 07 23:16:18.374659 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.374638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e8d974f-a9db-4279-b7cc-62c183bdbad6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f876j\" (UID: \"4e8d974f-a9db-4279-b7cc-62c183bdbad6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j" Jul 07 23:16:18.383211 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.383192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzp8m\" (UniqueName: \"kubernetes.io/projected/4e8d974f-a9db-4279-b7cc-62c183bdbad6-kube-api-access-pzp8m\") pod \"cert-manager-operator-controller-manager-55c444bf86-f876j\" (UID: \"4e8d974f-a9db-4279-b7cc-62c183bdbad6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j" Jul 07 23:16:18.470658 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.470636 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j" Jul 07 23:16:18.600996 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:18.600970 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j"] Jul 07 23:16:18.604496 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:16:18.604468 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8d974f_a9db_4279_b7cc_62c183bdbad6.slice/crio-a21f4dc7d448a3833f01a83fe5a3c9e36d0871e813ef306ad6cb8ed68bfb51bd WatchSource:0}: Error finding container a21f4dc7d448a3833f01a83fe5a3c9e36d0871e813ef306ad6cb8ed68bfb51bd: Status 404 returned error can't find the container with id a21f4dc7d448a3833f01a83fe5a3c9e36d0871e813ef306ad6cb8ed68bfb51bd Jul 07 23:16:19.481274 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:19.481222 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j" event={"ID":"4e8d974f-a9db-4279-b7cc-62c183bdbad6","Type":"ContainerStarted","Data":"a21f4dc7d448a3833f01a83fe5a3c9e36d0871e813ef306ad6cb8ed68bfb51bd"} Jul 07 23:16:21.337531 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:21.337393 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 23:16:21.492438 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:21.492401 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j" event={"ID":"4e8d974f-a9db-4279-b7cc-62c183bdbad6","Type":"ContainerStarted","Data":"474f46094c574be296cd950fdb15216a6c3ac20aaf2d1e67141a6a291035f2d4"} Jul 07 23:16:21.514427 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:21.514384 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f876j" podStartSLOduration=0.742429666 podStartE2EDuration="3.514369455s" totalImagesPullingTime="2.771939789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:16:21.512275418 +0000 UTC m=+300.733709770" watchObservedRunningTime="2026-07-07 23:16:21.514369455 +0000 UTC m=+300.735803804" Jul 07 23:16:28.753331 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:28.753301 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2jq9f"] Jul 07 23:16:28.756430 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:28.756410 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" Jul 07 23:16:28.759291 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:28.759264 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 23:16:28.760312 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:28.760294 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 23:16:28.760393 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:28.760297 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r8v89\"" Jul 07 23:16:28.766264 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:28.766234 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2jq9f"] Jul 07 23:16:28.861505 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:28.861470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f476dc07-264c-4d59-b984-8ba24a27f4c6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2jq9f\" (UID: \"f476dc07-264c-4d59-b984-8ba24a27f4c6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" Jul 07 23:16:28.861505 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:28.861506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r89wz\" (UniqueName: \"kubernetes.io/projected/f476dc07-264c-4d59-b984-8ba24a27f4c6-kube-api-access-r89wz\") pod \"cert-manager-webhook-6486ffd997-2jq9f\" (UID: \"f476dc07-264c-4d59-b984-8ba24a27f4c6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" Jul 07 23:16:28.962473 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:28.962432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f476dc07-264c-4d59-b984-8ba24a27f4c6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2jq9f\" (UID: \"f476dc07-264c-4d59-b984-8ba24a27f4c6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" Jul 07 23:16:28.962650 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:28.962491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r89wz\" (UniqueName: \"kubernetes.io/projected/f476dc07-264c-4d59-b984-8ba24a27f4c6-kube-api-access-r89wz\") pod \"cert-manager-webhook-6486ffd997-2jq9f\" (UID: \"f476dc07-264c-4d59-b984-8ba24a27f4c6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" Jul 07 23:16:28.970500 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:28.970477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f476dc07-264c-4d59-b984-8ba24a27f4c6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2jq9f\" (UID: \"f476dc07-264c-4d59-b984-8ba24a27f4c6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" Jul 07 23:16:28.970622 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:28.970567 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r89wz\" (UniqueName: \"kubernetes.io/projected/f476dc07-264c-4d59-b984-8ba24a27f4c6-kube-api-access-r89wz\") pod \"cert-manager-webhook-6486ffd997-2jq9f\" (UID: \"f476dc07-264c-4d59-b984-8ba24a27f4c6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" Jul 07 23:16:29.065751 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:29.065665 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" Jul 07 23:16:29.197007 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:29.196978 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2jq9f"] Jul 07 23:16:29.199957 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:16:29.199932 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf476dc07_264c_4d59_b984_8ba24a27f4c6.slice/crio-c60c87cd30484071092f57821ec1a914e7e78826823647c88c80cf51e7b75b46 WatchSource:0}: Error finding container c60c87cd30484071092f57821ec1a914e7e78826823647c88c80cf51e7b75b46: Status 404 returned error can't find the container with id c60c87cd30484071092f57821ec1a914e7e78826823647c88c80cf51e7b75b46 Jul 07 23:16:29.201951 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:29.201934 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 23:16:29.520783 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:29.520746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" event={"ID":"f476dc07-264c-4d59-b984-8ba24a27f4c6","Type":"ContainerStarted","Data":"c60c87cd30484071092f57821ec1a914e7e78826823647c88c80cf51e7b75b46"} Jul 07 23:16:32.534129 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:32.534091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" event={"ID":"f476dc07-264c-4d59-b984-8ba24a27f4c6","Type":"ContainerStarted","Data":"6e486843d75070dc5e78b3fbfb52149c911479752e7545bc22f840f4ad3d94d3"} Jul 07 23:16:32.534544 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:32.534220 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" Jul 07 23:16:32.551383 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:32.551335 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" podStartSLOduration=1.8307111219999999 podStartE2EDuration="4.551321775s" totalImagesPullingTime="2.720610653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:16:32.550150467 +0000 UTC m=+311.771584815" watchObservedRunningTime="2026-07-07 23:16:32.551321775 +0000 UTC m=+311.772756123" Jul 07 23:16:38.540581 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:38.540543 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2jq9f" Jul 07 23:16:40.619964 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.619930 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2"] Jul 07 23:16:40.623168 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.623151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2" Jul 07 23:16:40.625749 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.625730 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 23:16:40.625866 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.625801 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-f2vd6\"" Jul 07 23:16:40.626753 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.626738 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 23:16:40.632101 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.632079 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2"] Jul 07 23:16:40.747677 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.747640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4faa3bd-f0cf-4502-8744-2e55a2061a6d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mzdk2\" (UID: \"c4faa3bd-f0cf-4502-8744-2e55a2061a6d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2" Jul 07 23:16:40.747836 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.747683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkl4g\" (UniqueName: \"kubernetes.io/projected/c4faa3bd-f0cf-4502-8744-2e55a2061a6d-kube-api-access-vkl4g\") pod \"openshift-lws-operator-fd8ccff4c-mzdk2\" (UID: \"c4faa3bd-f0cf-4502-8744-2e55a2061a6d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2" Jul 07 23:16:40.848476 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.848433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4faa3bd-f0cf-4502-8744-2e55a2061a6d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mzdk2\" (UID: \"c4faa3bd-f0cf-4502-8744-2e55a2061a6d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2" Jul 07 23:16:40.848691 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.848489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkl4g\" (UniqueName: \"kubernetes.io/projected/c4faa3bd-f0cf-4502-8744-2e55a2061a6d-kube-api-access-vkl4g\") pod \"openshift-lws-operator-fd8ccff4c-mzdk2\" (UID: \"c4faa3bd-f0cf-4502-8744-2e55a2061a6d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2" Jul 07 23:16:40.848822 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.848799 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4faa3bd-f0cf-4502-8744-2e55a2061a6d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mzdk2\" (UID: \"c4faa3bd-f0cf-4502-8744-2e55a2061a6d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2" Jul 07 23:16:40.857364 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.857337 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkl4g\" (UniqueName: \"kubernetes.io/projected/c4faa3bd-f0cf-4502-8744-2e55a2061a6d-kube-api-access-vkl4g\") pod \"openshift-lws-operator-fd8ccff4c-mzdk2\" (UID: \"c4faa3bd-f0cf-4502-8744-2e55a2061a6d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2" Jul 07 23:16:40.932795 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:40.932709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2" Jul 07 23:16:41.063024 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:41.062995 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2"] Jul 07 23:16:41.066616 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:16:41.066590 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4faa3bd_f0cf_4502_8744_2e55a2061a6d.slice/crio-3de70603692cbb63d6ee050e97aeaea864cf1c127c908f8b80926e5142159364 WatchSource:0}: Error finding container 3de70603692cbb63d6ee050e97aeaea864cf1c127c908f8b80926e5142159364: Status 404 returned error can't find the container with id 3de70603692cbb63d6ee050e97aeaea864cf1c127c908f8b80926e5142159364 Jul 07 23:16:41.566216 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:41.566180 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2" event={"ID":"c4faa3bd-f0cf-4502-8744-2e55a2061a6d","Type":"ContainerStarted","Data":"3de70603692cbb63d6ee050e97aeaea864cf1c127c908f8b80926e5142159364"} Jul 07 23:16:44.579938 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:44.579899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2" event={"ID":"c4faa3bd-f0cf-4502-8744-2e55a2061a6d","Type":"ContainerStarted","Data":"347de0e2a948bd98b6639204202d1c332646bbf98ce798959b6eb4a45e544144"} Jul 07 23:16:44.596902 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:16:44.596858 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mzdk2" podStartSLOduration=2.025819652 podStartE2EDuration="4.596844115s" totalImagesPullingTime="2.571024463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:16:44.595162589 +0000 UTC m=+323.816596943" watchObservedRunningTime="2026-07-07 23:16:44.596844115 +0000 UTC m=+323.818278465" Jul 07 23:17:00.196484 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.193847 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk"] Jul 07 23:17:00.200201 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.200182 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.203995 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.203974 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 23:17:00.207723 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.207700 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 23:17:00.207723 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.207719 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 23:17:00.207874 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.207765 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 23:17:00.214418 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.214404 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5mqtv\"" Jul 07 23:17:00.227088 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.227066 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk"] Jul 07 23:17:00.292444 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.292412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1d03444-9971-47d9-9920-a9d8dabb2fb8-webhook-cert\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.292619 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.292449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdp9p\" (UniqueName: \"kubernetes.io/projected/d1d03444-9971-47d9-9920-a9d8dabb2fb8-kube-api-access-fdp9p\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.292619 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.292549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1d03444-9971-47d9-9920-a9d8dabb2fb8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.292619 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.292607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1d03444-9971-47d9-9920-a9d8dabb2fb8-tmp\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.292719 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.292633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1d03444-9971-47d9-9920-a9d8dabb2fb8-manifests\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.393643 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.393603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1d03444-9971-47d9-9920-a9d8dabb2fb8-tmp\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.393643 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.393647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1d03444-9971-47d9-9920-a9d8dabb2fb8-manifests\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.393852 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.393673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1d03444-9971-47d9-9920-a9d8dabb2fb8-webhook-cert\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.393852 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.393690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdp9p\" (UniqueName: \"kubernetes.io/projected/d1d03444-9971-47d9-9920-a9d8dabb2fb8-kube-api-access-fdp9p\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.393852 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.393727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1d03444-9971-47d9-9920-a9d8dabb2fb8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.394040 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.394009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1d03444-9971-47d9-9920-a9d8dabb2fb8-manifests\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.396122 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.396095 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1d03444-9971-47d9-9920-a9d8dabb2fb8-tmp\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.396321 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.396298 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1d03444-9971-47d9-9920-a9d8dabb2fb8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.396451 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.396430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1d03444-9971-47d9-9920-a9d8dabb2fb8-webhook-cert\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.404435 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.404411 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdp9p\" (UniqueName: \"kubernetes.io/projected/d1d03444-9971-47d9-9920-a9d8dabb2fb8-kube-api-access-fdp9p\") pod \"opendatahub-operator-controller-manager-855c64c48d-vkfvk\" (UID: \"d1d03444-9971-47d9-9920-a9d8dabb2fb8\") " pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.509667 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.509637 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:00.652175 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:00.652134 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk"] Jul 07 23:17:00.655351 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:17:00.655327 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d03444_9971_47d9_9920_a9d8dabb2fb8.slice/crio-a581db018f5e61eda435955aa7274079d93e6e74e69b9939e989ea98f7e12102 WatchSource:0}: Error finding container a581db018f5e61eda435955aa7274079d93e6e74e69b9939e989ea98f7e12102: Status 404 returned error can't find the container with id a581db018f5e61eda435955aa7274079d93e6e74e69b9939e989ea98f7e12102 Jul 07 23:17:01.648856 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:01.648823 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" event={"ID":"d1d03444-9971-47d9-9920-a9d8dabb2fb8","Type":"ContainerStarted","Data":"a581db018f5e61eda435955aa7274079d93e6e74e69b9939e989ea98f7e12102"} Jul 07 23:17:04.665591 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:04.665551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" event={"ID":"d1d03444-9971-47d9-9920-a9d8dabb2fb8","Type":"ContainerStarted","Data":"1e9d6de7b4d6ecb407c78e308a938c5f0bbd1b37a0da5babaf4e1452011e90f1"} Jul 07 23:17:05.671289 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:05.671254 2576 generic.go:356] "Generic (PLEG): container finished" podID="d1d03444-9971-47d9-9920-a9d8dabb2fb8" containerID="1e9d6de7b4d6ecb407c78e308a938c5f0bbd1b37a0da5babaf4e1452011e90f1" exitCode=0 Jul 07 23:17:05.671289 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:05.671294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" event={"ID":"d1d03444-9971-47d9-9920-a9d8dabb2fb8","Type":"ContainerDied","Data":"1e9d6de7b4d6ecb407c78e308a938c5f0bbd1b37a0da5babaf4e1452011e90f1"} Jul 07 23:17:06.677162 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:06.677127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" event={"ID":"d1d03444-9971-47d9-9920-a9d8dabb2fb8","Type":"ContainerStarted","Data":"da58b6a5038f7a64445b4bb60586a64bdbb4d53f050a778a984a34dac3143ee2"} Jul 07 23:17:06.677565 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:06.677255 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:06.699391 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:06.699336 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" podStartSLOduration=2.280551292 podStartE2EDuration="6.699320922s" totalImagesPullingTime="3.400132753s" totalInitContainerRuntime="1.018636877s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:17:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:17:06.69767138 +0000 UTC m=+345.919105720" watchObservedRunningTime="2026-07-07 23:17:06.699320922 +0000 UTC m=+345.920755270" Jul 07 23:17:17.683986 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:17.683902 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-855c64c48d-vkfvk" Jul 07 23:17:35.394781 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.394749 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc"] Jul 07 23:17:35.402009 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.401983 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" Jul 07 23:17:35.406158 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.406134 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 23:17:35.406261 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.406137 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 23:17:35.406261 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.406135 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t7z4l\"" Jul 07 23:17:35.406261 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.406144 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 23:17:35.407485 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.407457 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 23:17:35.422126 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.422100 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc"] Jul 07 23:17:35.558119 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.558083 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-g725l"] Jul 07 23:17:35.560296 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.560261 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-g725l" Jul 07 23:17:35.562977 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.562957 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 23:17:35.563108 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.563051 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4228m\"" Jul 07 23:17:35.565608 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.565588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86e10322-7624-47e1-86a0-4e86406be7cd-tls-certs\") pod \"kube-auth-proxy-67dd9c547-fc4rc\" (UID: \"86e10322-7624-47e1-86a0-4e86406be7cd\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" Jul 07 23:17:35.565729 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.565621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86e10322-7624-47e1-86a0-4e86406be7cd-tmp\") pod \"kube-auth-proxy-67dd9c547-fc4rc\" (UID: \"86e10322-7624-47e1-86a0-4e86406be7cd\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" Jul 07 23:17:35.565729 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.565708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmwsh\" (UniqueName: \"kubernetes.io/projected/86e10322-7624-47e1-86a0-4e86406be7cd-kube-api-access-gmwsh\") pod \"kube-auth-proxy-67dd9c547-fc4rc\" (UID: \"86e10322-7624-47e1-86a0-4e86406be7cd\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" Jul 07 23:17:35.573858 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.573840 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-g725l"] Jul 07 23:17:35.666579 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.666465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7108ffb6-2f47-428d-b676-c86d6b61fbbd-cert\") pod \"odh-model-controller-7998c67dc4-g725l\" (UID: \"7108ffb6-2f47-428d-b676-c86d6b61fbbd\") " pod="opendatahub/odh-model-controller-7998c67dc4-g725l" Jul 07 23:17:35.666579 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.666571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmwsh\" (UniqueName: \"kubernetes.io/projected/86e10322-7624-47e1-86a0-4e86406be7cd-kube-api-access-gmwsh\") pod \"kube-auth-proxy-67dd9c547-fc4rc\" (UID: \"86e10322-7624-47e1-86a0-4e86406be7cd\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" Jul 07 23:17:35.666794 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.666626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbpnn\" (UniqueName: \"kubernetes.io/projected/7108ffb6-2f47-428d-b676-c86d6b61fbbd-kube-api-access-tbpnn\") pod \"odh-model-controller-7998c67dc4-g725l\" (UID: \"7108ffb6-2f47-428d-b676-c86d6b61fbbd\") " pod="opendatahub/odh-model-controller-7998c67dc4-g725l" Jul 07 23:17:35.666794 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.666739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86e10322-7624-47e1-86a0-4e86406be7cd-tls-certs\") pod \"kube-auth-proxy-67dd9c547-fc4rc\" (UID: \"86e10322-7624-47e1-86a0-4e86406be7cd\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" Jul 07 23:17:35.666794 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.666774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86e10322-7624-47e1-86a0-4e86406be7cd-tmp\") pod \"kube-auth-proxy-67dd9c547-fc4rc\" (UID: \"86e10322-7624-47e1-86a0-4e86406be7cd\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" Jul 07 23:17:35.669154 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.669125 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86e10322-7624-47e1-86a0-4e86406be7cd-tmp\") pod \"kube-auth-proxy-67dd9c547-fc4rc\" (UID: \"86e10322-7624-47e1-86a0-4e86406be7cd\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" Jul 07 23:17:35.669316 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.669300 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86e10322-7624-47e1-86a0-4e86406be7cd-tls-certs\") pod \"kube-auth-proxy-67dd9c547-fc4rc\" (UID: \"86e10322-7624-47e1-86a0-4e86406be7cd\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" Jul 07 23:17:35.682729 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.682699 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmwsh\" (UniqueName: \"kubernetes.io/projected/86e10322-7624-47e1-86a0-4e86406be7cd-kube-api-access-gmwsh\") pod \"kube-auth-proxy-67dd9c547-fc4rc\" (UID: \"86e10322-7624-47e1-86a0-4e86406be7cd\") " pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" Jul 07 23:17:35.711645 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.711619 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" Jul 07 23:17:35.767318 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.767291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7108ffb6-2f47-428d-b676-c86d6b61fbbd-cert\") pod \"odh-model-controller-7998c67dc4-g725l\" (UID: \"7108ffb6-2f47-428d-b676-c86d6b61fbbd\") " pod="opendatahub/odh-model-controller-7998c67dc4-g725l" Jul 07 23:17:35.767433 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.767355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbpnn\" (UniqueName: \"kubernetes.io/projected/7108ffb6-2f47-428d-b676-c86d6b61fbbd-kube-api-access-tbpnn\") pod \"odh-model-controller-7998c67dc4-g725l\" (UID: \"7108ffb6-2f47-428d-b676-c86d6b61fbbd\") " pod="opendatahub/odh-model-controller-7998c67dc4-g725l" Jul 07 23:17:35.770125 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.770099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7108ffb6-2f47-428d-b676-c86d6b61fbbd-cert\") pod \"odh-model-controller-7998c67dc4-g725l\" (UID: \"7108ffb6-2f47-428d-b676-c86d6b61fbbd\") " pod="opendatahub/odh-model-controller-7998c67dc4-g725l" Jul 07 23:17:35.778979 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.778951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbpnn\" (UniqueName: \"kubernetes.io/projected/7108ffb6-2f47-428d-b676-c86d6b61fbbd-kube-api-access-tbpnn\") pod \"odh-model-controller-7998c67dc4-g725l\" (UID: \"7108ffb6-2f47-428d-b676-c86d6b61fbbd\") " pod="opendatahub/odh-model-controller-7998c67dc4-g725l" Jul 07 23:17:35.847965 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.847934 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc"] Jul 07 23:17:35.851745 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:17:35.851716 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e10322_7624_47e1_86a0_4e86406be7cd.slice/crio-f3d562365a08169348fd211b4f95ee4a58d0a6178b231c9a81dc0716707a5743 WatchSource:0}: Error finding container f3d562365a08169348fd211b4f95ee4a58d0a6178b231c9a81dc0716707a5743: Status 404 returned error can't find the container with id f3d562365a08169348fd211b4f95ee4a58d0a6178b231c9a81dc0716707a5743 Jul 07 23:17:35.869697 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:35.869677 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-g725l" Jul 07 23:17:36.016599 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:36.016575 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-g725l"] Jul 07 23:17:36.019080 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:17:36.019049 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7108ffb6_2f47_428d_b676_c86d6b61fbbd.slice/crio-2ea2c8ba46a9e8b5b35affe5db1710516ad758ead596fa7bdbda9c2b621d5ee0 WatchSource:0}: Error finding container 2ea2c8ba46a9e8b5b35affe5db1710516ad758ead596fa7bdbda9c2b621d5ee0: Status 404 returned error can't find the container with id 2ea2c8ba46a9e8b5b35affe5db1710516ad758ead596fa7bdbda9c2b621d5ee0 Jul 07 23:17:36.801888 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:36.801780 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" event={"ID":"86e10322-7624-47e1-86a0-4e86406be7cd","Type":"ContainerStarted","Data":"f3d562365a08169348fd211b4f95ee4a58d0a6178b231c9a81dc0716707a5743"} Jul 07 23:17:36.803428 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:36.803398 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-g725l" event={"ID":"7108ffb6-2f47-428d-b676-c86d6b61fbbd","Type":"ContainerStarted","Data":"2ea2c8ba46a9e8b5b35affe5db1710516ad758ead596fa7bdbda9c2b621d5ee0"} Jul 07 23:17:39.820178 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:39.820146 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-g725l" event={"ID":"7108ffb6-2f47-428d-b676-c86d6b61fbbd","Type":"ContainerStarted","Data":"b72aa12c42a0c1710f36da0e2a6cb0feed20e1fb918fe0d51185c8436608e562"} Jul 07 23:17:39.820572 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:39.820267 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-g725l" Jul 07 23:17:39.837109 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:39.837059 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-g725l" podStartSLOduration=1.108685268 podStartE2EDuration="4.837043909s" totalImagesPullingTime="3.728358641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:17:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:17:39.835709829 +0000 UTC m=+379.057144188" watchObservedRunningTime="2026-07-07 23:17:39.837043909 +0000 UTC m=+379.058478257" Jul 07 23:17:40.826168 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:40.826130 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" event={"ID":"86e10322-7624-47e1-86a0-4e86406be7cd","Type":"ContainerStarted","Data":"f7d658f38bb777c86d2ec4b90e6562c604c8bb497853af834749ed655d7cbe82"} Jul 07 23:17:40.844209 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:40.844162 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67dd9c547-fc4rc" podStartSLOduration=1.948252815 podStartE2EDuration="5.844148703s" totalImagesPullingTime="3.895895888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:17:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:17:40.84255279 +0000 UTC m=+380.063987142" watchObservedRunningTime="2026-07-07 23:17:40.844148703 +0000 UTC m=+380.065583051" Jul 07 23:17:41.988223 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:41.988194 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd"] Jul 07 23:17:41.991119 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:41.991098 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:41.994746 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:41.994712 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 23:17:41.994929 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:41.994909 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-h6fld\"" Jul 07 23:17:42.006639 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.006614 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd"] Jul 07 23:17:42.126264 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.126226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.126424 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.126292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.126424 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.126359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.126424 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.126388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a5641ed-355b-402f-9140-b93c40fc7274-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.126424 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.126406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a5641ed-355b-402f-9140-b93c40fc7274-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.126597 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.126435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.126597 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.126470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7hcm\" (UniqueName: \"kubernetes.io/projected/1a5641ed-355b-402f-9140-b93c40fc7274-kube-api-access-d7hcm\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.126597 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.126540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.126597 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.126573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a5641ed-355b-402f-9140-b93c40fc7274-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.227774 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.227738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a5641ed-355b-402f-9140-b93c40fc7274-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.227951 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.227788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.227951 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.227828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.227951 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.227860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.227951 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.227882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a5641ed-355b-402f-9140-b93c40fc7274-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.227951 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.227901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a5641ed-355b-402f-9140-b93c40fc7274-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.227951 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.227922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.227951 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.227951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7hcm\" (UniqueName: \"kubernetes.io/projected/1a5641ed-355b-402f-9140-b93c40fc7274-kube-api-access-d7hcm\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.228276 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.227985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.228325 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.228269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.228433 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.228408 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.228730 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.228704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.228827 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.228722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a5641ed-355b-402f-9140-b93c40fc7274-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.228827 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.228741 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.230466 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.230433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a5641ed-355b-402f-9140-b93c40fc7274-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.231135 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.231113 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a5641ed-355b-402f-9140-b93c40fc7274-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.240375 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.240309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7hcm\" (UniqueName: \"kubernetes.io/projected/1a5641ed-355b-402f-9140-b93c40fc7274-kube-api-access-d7hcm\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.240653 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.240634 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a5641ed-355b-402f-9140-b93c40fc7274-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ngkwd\" (UID: \"1a5641ed-355b-402f-9140-b93c40fc7274\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.302179 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.302143 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:42.442380 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.442350 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd"] Jul 07 23:17:42.445974 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:17:42.445947 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a5641ed_355b_402f_9140_b93c40fc7274.slice/crio-2b6549d827f29176231c1179370ffa6ed3766fa07af2c6894e587a3f6a6fd1e7 WatchSource:0}: Error finding container 2b6549d827f29176231c1179370ffa6ed3766fa07af2c6894e587a3f6a6fd1e7: Status 404 returned error can't find the container with id 2b6549d827f29176231c1179370ffa6ed3766fa07af2c6894e587a3f6a6fd1e7 Jul 07 23:17:42.839057 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:42.839017 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" event={"ID":"1a5641ed-355b-402f-9140-b93c40fc7274","Type":"ContainerStarted","Data":"2b6549d827f29176231c1179370ffa6ed3766fa07af2c6894e587a3f6a6fd1e7"} Jul 07 23:17:43.812469 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:43.812432 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw"] Jul 07 23:17:43.815743 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:43.815722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:43.821347 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:43.821286 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 23:17:43.821347 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:43.821300 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 23:17:43.822321 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:43.822298 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 23:17:43.827066 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:43.827045 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9qcpm\"" Jul 07 23:17:43.835073 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:43.835051 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw"] Jul 07 23:17:43.942378 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:43.942341 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/74dc86af-14dd-4eac-8af9-7491505036b6-manager-config\") pod \"lws-controller-manager-55b8865445-c7jqw\" (UID: \"74dc86af-14dd-4eac-8af9-7491505036b6\") " pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:43.942378 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:43.942383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74dc86af-14dd-4eac-8af9-7491505036b6-cert\") pod \"lws-controller-manager-55b8865445-c7jqw\" (UID: \"74dc86af-14dd-4eac-8af9-7491505036b6\") " pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:43.942602 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:43.942485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/74dc86af-14dd-4eac-8af9-7491505036b6-metrics-cert\") pod \"lws-controller-manager-55b8865445-c7jqw\" (UID: \"74dc86af-14dd-4eac-8af9-7491505036b6\") " pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:43.942602 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:43.942569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8srsq\" (UniqueName: \"kubernetes.io/projected/74dc86af-14dd-4eac-8af9-7491505036b6-kube-api-access-8srsq\") pod \"lws-controller-manager-55b8865445-c7jqw\" (UID: \"74dc86af-14dd-4eac-8af9-7491505036b6\") " pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:44.043927 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:44.043892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/74dc86af-14dd-4eac-8af9-7491505036b6-manager-config\") pod \"lws-controller-manager-55b8865445-c7jqw\" (UID: \"74dc86af-14dd-4eac-8af9-7491505036b6\") " pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:44.044106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:44.043936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74dc86af-14dd-4eac-8af9-7491505036b6-cert\") pod \"lws-controller-manager-55b8865445-c7jqw\" (UID: \"74dc86af-14dd-4eac-8af9-7491505036b6\") " pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:44.044106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:44.043997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/74dc86af-14dd-4eac-8af9-7491505036b6-metrics-cert\") pod \"lws-controller-manager-55b8865445-c7jqw\" (UID: \"74dc86af-14dd-4eac-8af9-7491505036b6\") " pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:44.044106 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:44.044042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8srsq\" (UniqueName: \"kubernetes.io/projected/74dc86af-14dd-4eac-8af9-7491505036b6-kube-api-access-8srsq\") pod \"lws-controller-manager-55b8865445-c7jqw\" (UID: \"74dc86af-14dd-4eac-8af9-7491505036b6\") " pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:44.044961 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:44.044931 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/74dc86af-14dd-4eac-8af9-7491505036b6-manager-config\") pod \"lws-controller-manager-55b8865445-c7jqw\" (UID: \"74dc86af-14dd-4eac-8af9-7491505036b6\") " pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:44.047504 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:44.047475 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74dc86af-14dd-4eac-8af9-7491505036b6-cert\") pod \"lws-controller-manager-55b8865445-c7jqw\" (UID: \"74dc86af-14dd-4eac-8af9-7491505036b6\") " pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:44.047612 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:44.047552 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/74dc86af-14dd-4eac-8af9-7491505036b6-metrics-cert\") pod \"lws-controller-manager-55b8865445-c7jqw\" (UID: \"74dc86af-14dd-4eac-8af9-7491505036b6\") " pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:44.055555 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:44.055481 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8srsq\" (UniqueName: \"kubernetes.io/projected/74dc86af-14dd-4eac-8af9-7491505036b6-kube-api-access-8srsq\") pod \"lws-controller-manager-55b8865445-c7jqw\" (UID: \"74dc86af-14dd-4eac-8af9-7491505036b6\") " pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:44.127075 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:44.126974 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:44.290317 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:44.290283 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw"] Jul 07 23:17:45.239286 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:17:45.239245 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74dc86af_14dd_4eac_8af9_7491505036b6.slice/crio-277b04a50b6e7dc95e979814aa917b4ec77e7ef5d5d22261067eb9431c7b0d6b WatchSource:0}: Error finding container 277b04a50b6e7dc95e979814aa917b4ec77e7ef5d5d22261067eb9431c7b0d6b: Status 404 returned error can't find the container with id 277b04a50b6e7dc95e979814aa917b4ec77e7ef5d5d22261067eb9431c7b0d6b Jul 07 23:17:45.300649 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:45.300028 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:17:45.300649 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:45.300130 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:17:45.300649 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:45.300168 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:17:45.855953 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:45.855912 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" event={"ID":"1a5641ed-355b-402f-9140-b93c40fc7274","Type":"ContainerStarted","Data":"4012917a8f8011b50ae0c0c91e1f22b27384cb7f07ceeb1d0e319a9896481847"} Jul 07 23:17:45.857264 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:45.857230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" event={"ID":"74dc86af-14dd-4eac-8af9-7491505036b6","Type":"ContainerStarted","Data":"277b04a50b6e7dc95e979814aa917b4ec77e7ef5d5d22261067eb9431c7b0d6b"} Jul 07 23:17:45.884796 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:45.884714 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" podStartSLOduration=2.032958719 podStartE2EDuration="4.884689312s" totalImagesPullingTime="2.851730593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:17:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:17:45.88316105 +0000 UTC m=+385.104595400" watchObservedRunningTime="2026-07-07 23:17:45.884689312 +0000 UTC m=+385.106123663" Jul 07 23:17:46.303171 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:46.303141 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:46.308906 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:46.308880 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:46.863882 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:46.863799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" event={"ID":"74dc86af-14dd-4eac-8af9-7491505036b6","Type":"ContainerStarted","Data":"2bfb78594f05313aa8ccc08355b8784aab4e6d4eb9c28f6ca8848c0a24223989"} Jul 07 23:17:46.864137 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:46.864120 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:46.864201 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:46.864169 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:17:46.865111 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:46.865089 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ngkwd" Jul 07 23:17:46.914932 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:46.914881 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" podStartSLOduration=2.577558694 podStartE2EDuration="3.914865486s" totalImagesPullingTime="1.337306792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:17:46.914095785 +0000 UTC m=+386.135530135" watchObservedRunningTime="2026-07-07 23:17:46.914865486 +0000 UTC m=+386.136299835" Jul 07 23:17:50.828269 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:50.828237 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-g725l" Jul 07 23:17:57.870609 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:17:57.870578 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55b8865445-c7jqw" Jul 07 23:20:17.679827 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.679748 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt"] Jul 07 23:20:17.683359 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.683335 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.685916 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.685896 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qt54j\"" Jul 07 23:20:17.694420 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.694396 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt"] Jul 07 23:20:17.790441 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.790402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.790619 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.790448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.790619 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.790577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq2ph\" (UniqueName: \"kubernetes.io/projected/7c5d8d83-571b-434b-9215-1257953433b7-kube-api-access-qq2ph\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.790691 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.790622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c5d8d83-571b-434b-9215-1257953433b7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.790691 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.790671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c5d8d83-571b-434b-9215-1257953433b7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.790762 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.790703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.790762 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.790724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.790762 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.790739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.790762 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.790759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c5d8d83-571b-434b-9215-1257953433b7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.891629 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.891597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.891629 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.891639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq2ph\" (UniqueName: \"kubernetes.io/projected/7c5d8d83-571b-434b-9215-1257953433b7-kube-api-access-qq2ph\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.891878 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.891661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c5d8d83-571b-434b-9215-1257953433b7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.891878 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.891686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c5d8d83-571b-434b-9215-1257953433b7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.891878 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.891728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.891878 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.891846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.892087 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.891889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.892087 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.891923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c5d8d83-571b-434b-9215-1257953433b7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.892087 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.891970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.892087 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.892042 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.892283 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.892111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.892283 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.892205 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.892283 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.892263 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.892536 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.892489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c5d8d83-571b-434b-9215-1257953433b7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.894288 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.894259 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c5d8d83-571b-434b-9215-1257953433b7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.894920 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.894899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c5d8d83-571b-434b-9215-1257953433b7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.900091 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.900069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq2ph\" (UniqueName: \"kubernetes.io/projected/7c5d8d83-571b-434b-9215-1257953433b7-kube-api-access-qq2ph\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.900180 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.900113 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c5d8d83-571b-434b-9215-1257953433b7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-226gt\" (UID: \"7c5d8d83-571b-434b-9215-1257953433b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:17.993769 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:17.993733 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:18.130012 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:18.129976 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt"] Jul 07 23:20:18.133098 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:20:18.133069 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5d8d83_571b_434b_9215_1257953433b7.slice/crio-0f308b193b042922f409926624be7a2c1834748dff90b5b4fae8176ae9fff50e WatchSource:0}: Error finding container 0f308b193b042922f409926624be7a2c1834748dff90b5b4fae8176ae9fff50e: Status 404 returned error can't find the container with id 0f308b193b042922f409926624be7a2c1834748dff90b5b4fae8176ae9fff50e Jul 07 23:20:18.135156 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:18.135123 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:20:18.135241 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:18.135196 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:20:18.135241 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:18.135231 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:20:18.503344 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:18.503306 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" event={"ID":"7c5d8d83-571b-434b-9215-1257953433b7","Type":"ContainerStarted","Data":"45586e070641ea0b95f259aad3efc8d88c391786cde973cd8cf0723e12257f62"} Jul 07 23:20:18.503551 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:18.503388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" event={"ID":"7c5d8d83-571b-434b-9215-1257953433b7","Type":"ContainerStarted","Data":"0f308b193b042922f409926624be7a2c1834748dff90b5b4fae8176ae9fff50e"} Jul 07 23:20:18.525254 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:18.525206 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" podStartSLOduration=1.525191175 podStartE2EDuration="1.525191175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:20:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:20:18.523824977 +0000 UTC m=+537.745259327" watchObservedRunningTime="2026-07-07 23:20:18.525191175 +0000 UTC m=+537.746625525" Jul 07 23:20:18.994651 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:18.994617 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:19.999453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:19.999423 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:20.511358 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:20.511326 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:20.512367 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:20.512347 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:20:32.272585 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:32.272542 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-kscnv"] Jul 07 23:20:32.275905 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:32.275888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kscnv" Jul 07 23:20:32.278600 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:32.278567 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 23:20:32.278786 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:32.278741 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 23:20:32.279674 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:32.279656 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9zck9\"" Jul 07 23:20:32.283708 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:32.283685 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kscnv"] Jul 07 23:20:32.417531 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:32.417498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flzsw\" (UniqueName: \"kubernetes.io/projected/2dd15709-10af-47bc-9126-4f8e6a602d7c-kube-api-access-flzsw\") pod \"authorino-75d556bd77-kscnv\" (UID: \"2dd15709-10af-47bc-9126-4f8e6a602d7c\") " pod="kuadrant-system/authorino-75d556bd77-kscnv" Jul 07 23:20:32.518017 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:32.517986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flzsw\" (UniqueName: \"kubernetes.io/projected/2dd15709-10af-47bc-9126-4f8e6a602d7c-kube-api-access-flzsw\") pod \"authorino-75d556bd77-kscnv\" (UID: \"2dd15709-10af-47bc-9126-4f8e6a602d7c\") " pod="kuadrant-system/authorino-75d556bd77-kscnv" Jul 07 23:20:32.526567 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:32.526481 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flzsw\" (UniqueName: \"kubernetes.io/projected/2dd15709-10af-47bc-9126-4f8e6a602d7c-kube-api-access-flzsw\") pod \"authorino-75d556bd77-kscnv\" (UID: \"2dd15709-10af-47bc-9126-4f8e6a602d7c\") " pod="kuadrant-system/authorino-75d556bd77-kscnv" Jul 07 23:20:32.585267 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:32.585243 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kscnv" Jul 07 23:20:32.714941 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:32.714756 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kscnv"] Jul 07 23:20:32.717840 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:20:32.717809 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dd15709_10af_47bc_9126_4f8e6a602d7c.slice/crio-c1bdb866ac9f81948f94a82bab2d2c5a3a35dcb8c20ba9ec23c7024fc9f92c68 WatchSource:0}: Error finding container c1bdb866ac9f81948f94a82bab2d2c5a3a35dcb8c20ba9ec23c7024fc9f92c68: Status 404 returned error can't find the container with id c1bdb866ac9f81948f94a82bab2d2c5a3a35dcb8c20ba9ec23c7024fc9f92c68 Jul 07 23:20:33.568091 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:33.568052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kscnv" event={"ID":"2dd15709-10af-47bc-9126-4f8e6a602d7c","Type":"ContainerStarted","Data":"c1bdb866ac9f81948f94a82bab2d2c5a3a35dcb8c20ba9ec23c7024fc9f92c68"} Jul 07 23:20:36.583999 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:36.583961 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kscnv" event={"ID":"2dd15709-10af-47bc-9126-4f8e6a602d7c","Type":"ContainerStarted","Data":"c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d"} Jul 07 23:20:36.600253 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:20:36.600204 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-kscnv" podStartSLOduration=1.350716196 podStartE2EDuration="4.600188442s" totalImagesPullingTime="3.249472246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:20:36.59901452 +0000 UTC m=+555.820448870" watchObservedRunningTime="2026-07-07 23:20:36.600188442 +0000 UTC m=+555.821622834" Jul 07 23:21:06.670206 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:06.670170 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kscnv"] Jul 07 23:21:06.670893 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:06.670339 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-kscnv" podUID="2dd15709-10af-47bc-9126-4f8e6a602d7c" containerName="authorino" containerID="cri-o://c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d" gracePeriod=30 Jul 07 23:21:06.922467 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:06.922400 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kscnv" Jul 07 23:21:07.005014 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:07.004985 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flzsw\" (UniqueName: \"kubernetes.io/projected/2dd15709-10af-47bc-9126-4f8e6a602d7c-kube-api-access-flzsw\") pod \"2dd15709-10af-47bc-9126-4f8e6a602d7c\" (UID: \"2dd15709-10af-47bc-9126-4f8e6a602d7c\") " Jul 07 23:21:07.007309 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:07.007277 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd15709-10af-47bc-9126-4f8e6a602d7c-kube-api-access-flzsw" (OuterVolumeSpecName: "kube-api-access-flzsw") pod "2dd15709-10af-47bc-9126-4f8e6a602d7c" (UID: "2dd15709-10af-47bc-9126-4f8e6a602d7c"). InnerVolumeSpecName "kube-api-access-flzsw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:21:07.105670 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:07.105630 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flzsw\" (UniqueName: \"kubernetes.io/projected/2dd15709-10af-47bc-9126-4f8e6a602d7c-kube-api-access-flzsw\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:21:07.714735 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:07.714637 2576 generic.go:356] "Generic (PLEG): container finished" podID="2dd15709-10af-47bc-9126-4f8e6a602d7c" containerID="c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d" exitCode=0 Jul 07 23:21:07.714735 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:07.714683 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kscnv" Jul 07 23:21:07.715246 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:07.714723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kscnv" event={"ID":"2dd15709-10af-47bc-9126-4f8e6a602d7c","Type":"ContainerDied","Data":"c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d"} Jul 07 23:21:07.715246 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:07.714774 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kscnv" event={"ID":"2dd15709-10af-47bc-9126-4f8e6a602d7c","Type":"ContainerDied","Data":"c1bdb866ac9f81948f94a82bab2d2c5a3a35dcb8c20ba9ec23c7024fc9f92c68"} Jul 07 23:21:07.715246 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:07.714808 2576 scope.go:117] "RemoveContainer" containerID="c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d" Jul 07 23:21:07.722993 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:07.722975 2576 scope.go:117] "RemoveContainer" containerID="c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d" Jul 07 23:21:07.723270 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:21:07.723251 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d\": container with ID starting with c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d not found: ID does not exist" containerID="c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d" Jul 07 23:21:07.723316 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:07.723279 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d"} err="failed to get container status \"c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d\": rpc error: code = NotFound desc = could not find container \"c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d\": container with ID starting with c6332ce1b7ca5f25e9fd5c073343956aff4564435d2661d34f3c5f8d9ded389d not found: ID does not exist" Jul 07 23:21:07.730746 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:07.730724 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kscnv"] Jul 07 23:21:07.733855 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:07.733832 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kscnv"] Jul 07 23:21:09.306059 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:09.306024 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dd15709-10af-47bc-9126-4f8e6a602d7c" path="/var/lib/kubelet/pods/2dd15709-10af-47bc-9126-4f8e6a602d7c/volumes" Jul 07 23:21:56.933668 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:56.933625 2576 generic.go:356] "Generic (PLEG): container finished" podID="7c5d8d83-571b-434b-9215-1257953433b7" containerID="45586e070641ea0b95f259aad3efc8d88c391786cde973cd8cf0723e12257f62" exitCode=0 Jul 07 23:21:56.933668 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:56.933670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" event={"ID":"7c5d8d83-571b-434b-9215-1257953433b7","Type":"ContainerDied","Data":"45586e070641ea0b95f259aad3efc8d88c391786cde973cd8cf0723e12257f62"} Jul 07 23:21:56.934104 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:56.934031 2576 scope.go:117] "RemoveContainer" containerID="45586e070641ea0b95f259aad3efc8d88c391786cde973cd8cf0723e12257f62" Jul 07 23:21:56.935012 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:56.934986 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:21:56.935084 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:56.935050 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:21:56.935133 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:56.935083 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:21:57.940017 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:57.939981 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" event={"ID":"7c5d8d83-571b-434b-9215-1257953433b7","Type":"ContainerStarted","Data":"4ce48414980b87eea0a53234f5e6263280d43e0eaa257151641e9b14a9a0de02"} Jul 07 23:21:57.994309 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:57.994269 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:21:57.994806 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:57.994771 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-226gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 07 23:21:57.994920 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:57.994851 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" podUID="7c5d8d83-571b-434b-9215-1257953433b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 07 23:21:58.994807 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:58.994767 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-226gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 07 23:21:58.995722 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:58.995683 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" podUID="7c5d8d83-571b-434b-9215-1257953433b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 07 23:21:59.994816 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:59.994774 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-226gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 07 23:21:59.995306 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:21:59.994862 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" podUID="7c5d8d83-571b-434b-9215-1257953433b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 07 23:22:00.995042 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:00.994999 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-226gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 07 23:22:00.995557 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:00.995072 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" podUID="7c5d8d83-571b-434b-9215-1257953433b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 07 23:22:01.994912 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:01.994871 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-226gt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 07 23:22:01.995100 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:01.994931 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" podUID="7c5d8d83-571b-434b-9215-1257953433b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 07 23:22:02.998178 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:02.998147 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:22:02.998574 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:02.998427 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:22:02.999163 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:02.999146 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-226gt" Jul 07 23:22:27.771929 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.771885 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v"] Jul 07 23:22:27.772423 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.772305 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd15709-10af-47bc-9126-4f8e6a602d7c" containerName="authorino" Jul 07 23:22:27.772423 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.772324 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd15709-10af-47bc-9126-4f8e6a602d7c" containerName="authorino" Jul 07 23:22:27.772423 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.772410 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd15709-10af-47bc-9126-4f8e6a602d7c" containerName="authorino" Jul 07 23:22:27.775440 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.775420 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:27.778206 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.778188 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 23:22:27.778206 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.778198 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vcn5l\"" Jul 07 23:22:27.779488 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.779473 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 23:22:27.779616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.779548 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 07 23:22:27.783769 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.783747 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v"] Jul 07 23:22:27.906805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.906772 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79bae112-d16d-4c50-b760-66518437e374-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:27.906805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.906806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79bae112-d16d-4c50-b760-66518437e374-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:27.907042 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.906826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79bae112-d16d-4c50-b760-66518437e374-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:27.907042 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.906847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79bae112-d16d-4c50-b760-66518437e374-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:27.907042 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.906866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6f2t\" (UniqueName: \"kubernetes.io/projected/79bae112-d16d-4c50-b760-66518437e374-kube-api-access-c6f2t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:27.907042 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:27.906961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79bae112-d16d-4c50-b760-66518437e374-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.008282 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.008244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79bae112-d16d-4c50-b760-66518437e374-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.008475 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.008313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79bae112-d16d-4c50-b760-66518437e374-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.008475 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.008329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79bae112-d16d-4c50-b760-66518437e374-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.008475 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.008438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79bae112-d16d-4c50-b760-66518437e374-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.008657 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.008483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79bae112-d16d-4c50-b760-66518437e374-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.008657 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.008507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6f2t\" (UniqueName: \"kubernetes.io/projected/79bae112-d16d-4c50-b760-66518437e374-kube-api-access-c6f2t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.008756 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.008743 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79bae112-d16d-4c50-b760-66518437e374-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.008867 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.008840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79bae112-d16d-4c50-b760-66518437e374-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.009007 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.008907 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79bae112-d16d-4c50-b760-66518437e374-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.010916 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.010887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79bae112-d16d-4c50-b760-66518437e374-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.011159 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.011141 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79bae112-d16d-4c50-b760-66518437e374-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.015990 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.015961 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6f2t\" (UniqueName: \"kubernetes.io/projected/79bae112-d16d-4c50-b760-66518437e374-kube-api-access-c6f2t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ld52v\" (UID: \"79bae112-d16d-4c50-b760-66518437e374\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.086182 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.086118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:28.221952 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.221924 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v"] Jul 07 23:22:28.224693 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:22:28.224662 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79bae112_d16d_4c50_b760_66518437e374.slice/crio-2a1a536066133cde248ad3f6662202bd01da5a83e280c4b44a6ee9bb55bd9219 WatchSource:0}: Error finding container 2a1a536066133cde248ad3f6662202bd01da5a83e280c4b44a6ee9bb55bd9219: Status 404 returned error can't find the container with id 2a1a536066133cde248ad3f6662202bd01da5a83e280c4b44a6ee9bb55bd9219 Jul 07 23:22:28.226333 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:28.226316 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 23:22:29.072055 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:29.072003 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" event={"ID":"79bae112-d16d-4c50-b760-66518437e374","Type":"ContainerStarted","Data":"2a1a536066133cde248ad3f6662202bd01da5a83e280c4b44a6ee9bb55bd9219"} Jul 07 23:22:30.077678 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:30.077636 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" event={"ID":"79bae112-d16d-4c50-b760-66518437e374","Type":"ContainerStarted","Data":"98718a5ae12f05b8cd6636243213c02fc67d5cb5aace52ce3ad4bfaadd397b27"} Jul 07 23:22:30.094423 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:30.094371 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" podStartSLOduration=2.102772206 podStartE2EDuration="3.094357603s" totalImagesPullingTime="991.585397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:22:30.093641586 +0000 UTC m=+669.315075934" watchObservedRunningTime="2026-07-07 23:22:30.094357603 +0000 UTC m=+669.315791949" Jul 07 23:22:38.087101 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:38.087064 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:38.087485 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:38.087136 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:38.099614 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:38.099590 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:22:38.122789 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:22:38.122759 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ld52v" Jul 07 23:23:13.584626 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.584545 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr"] Jul 07 23:23:13.590579 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.590559 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.595104 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.595070 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 07 23:23:13.596500 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.596470 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr"] Jul 07 23:23:13.651145 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.651107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/401149b6-1600-4d60-aa1e-a83d2d236b56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.651321 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.651162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/401149b6-1600-4d60-aa1e-a83d2d236b56-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.651321 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.651260 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/401149b6-1600-4d60-aa1e-a83d2d236b56-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.651321 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.651297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/401149b6-1600-4d60-aa1e-a83d2d236b56-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.651486 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.651327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzf9v\" (UniqueName: \"kubernetes.io/projected/401149b6-1600-4d60-aa1e-a83d2d236b56-kube-api-access-bzf9v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.651486 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.651366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/401149b6-1600-4d60-aa1e-a83d2d236b56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.752484 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.752447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/401149b6-1600-4d60-aa1e-a83d2d236b56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.752692 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.752505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/401149b6-1600-4d60-aa1e-a83d2d236b56-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.752692 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.752576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/401149b6-1600-4d60-aa1e-a83d2d236b56-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.752692 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.752592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/401149b6-1600-4d60-aa1e-a83d2d236b56-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.752692 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.752615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzf9v\" (UniqueName: \"kubernetes.io/projected/401149b6-1600-4d60-aa1e-a83d2d236b56-kube-api-access-bzf9v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.752692 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.752649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/401149b6-1600-4d60-aa1e-a83d2d236b56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.752956 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.752929 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/401149b6-1600-4d60-aa1e-a83d2d236b56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.753057 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.753025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/401149b6-1600-4d60-aa1e-a83d2d236b56-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.753200 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.753053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/401149b6-1600-4d60-aa1e-a83d2d236b56-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.755163 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.755138 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/401149b6-1600-4d60-aa1e-a83d2d236b56-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.755279 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.755266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/401149b6-1600-4d60-aa1e-a83d2d236b56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.762435 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.762411 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzf9v\" (UniqueName: \"kubernetes.io/projected/401149b6-1600-4d60-aa1e-a83d2d236b56-kube-api-access-bzf9v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxjr\" (UID: \"401149b6-1600-4d60-aa1e-a83d2d236b56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:13.903693 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:13.903605 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:14.040322 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:14.040298 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr"] Jul 07 23:23:14.042636 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:23:14.042609 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401149b6_1600_4d60_aa1e_a83d2d236b56.slice/crio-28d81b462df0f9d9370256cd46da243f1d8aa872ac3be40a198a73f903c4e3c5 WatchSource:0}: Error finding container 28d81b462df0f9d9370256cd46da243f1d8aa872ac3be40a198a73f903c4e3c5: Status 404 returned error can't find the container with id 28d81b462df0f9d9370256cd46da243f1d8aa872ac3be40a198a73f903c4e3c5 Jul 07 23:23:14.275344 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:14.275314 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" event={"ID":"401149b6-1600-4d60-aa1e-a83d2d236b56","Type":"ContainerStarted","Data":"4065c87e452542903428a250a5400d2a109fe2ce40ffe7c50c6ed07dd3fc548d"} Jul 07 23:23:14.275455 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:14.275369 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" event={"ID":"401149b6-1600-4d60-aa1e-a83d2d236b56","Type":"ContainerStarted","Data":"28d81b462df0f9d9370256cd46da243f1d8aa872ac3be40a198a73f903c4e3c5"} Jul 07 23:23:14.294321 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:14.294263 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" podStartSLOduration=1.121602081 podStartE2EDuration="1.294245333s" totalImagesPullingTime="172.643252ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:23:14.292237679 +0000 UTC m=+713.513672029" watchObservedRunningTime="2026-07-07 23:23:14.294245333 +0000 UTC m=+713.515679678" Jul 07 23:23:23.904044 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:23.904009 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:23.904424 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:23.904066 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:23.916775 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:23.916745 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:24.330390 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:24.330361 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxjr" Jul 07 23:23:26.778493 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.778460 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr"] Jul 07 23:23:26.781865 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.781849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.784354 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.784329 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 07 23:23:26.795174 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.795152 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr"] Jul 07 23:23:26.866303 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.866265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4d8b752-114e-4959-9b2e-8cfef9a4be83-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.866466 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.866308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4d8b752-114e-4959-9b2e-8cfef9a4be83-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.866466 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.866372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d8b752-114e-4959-9b2e-8cfef9a4be83-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.866466 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.866454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4d8b752-114e-4959-9b2e-8cfef9a4be83-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.866644 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.866513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4d8b752-114e-4959-9b2e-8cfef9a4be83-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.866644 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.866559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llnn6\" (UniqueName: \"kubernetes.io/projected/d4d8b752-114e-4959-9b2e-8cfef9a4be83-kube-api-access-llnn6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.967830 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.967792 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4d8b752-114e-4959-9b2e-8cfef9a4be83-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.967995 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.967836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4d8b752-114e-4959-9b2e-8cfef9a4be83-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.967995 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.967862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llnn6\" (UniqueName: \"kubernetes.io/projected/d4d8b752-114e-4959-9b2e-8cfef9a4be83-kube-api-access-llnn6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.967995 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.967905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4d8b752-114e-4959-9b2e-8cfef9a4be83-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.967995 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.967939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4d8b752-114e-4959-9b2e-8cfef9a4be83-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.967995 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.967993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d8b752-114e-4959-9b2e-8cfef9a4be83-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.968268 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.968245 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4d8b752-114e-4959-9b2e-8cfef9a4be83-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.968331 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.968307 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4d8b752-114e-4959-9b2e-8cfef9a4be83-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.968388 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.968344 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4d8b752-114e-4959-9b2e-8cfef9a4be83-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.970419 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.970399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4d8b752-114e-4959-9b2e-8cfef9a4be83-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.970813 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.970791 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d8b752-114e-4959-9b2e-8cfef9a4be83-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:26.975874 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:26.975851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llnn6\" (UniqueName: \"kubernetes.io/projected/d4d8b752-114e-4959-9b2e-8cfef9a4be83-kube-api-access-llnn6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr\" (UID: \"d4d8b752-114e-4959-9b2e-8cfef9a4be83\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:27.092312 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:27.092229 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:27.225564 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:27.225528 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr"] Jul 07 23:23:27.229705 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:23:27.229677 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4d8b752_114e_4959_9b2e_8cfef9a4be83.slice/crio-d813e5428c486ec70cb2b1b908a24b3ab9ef2efa50758bf1436820835c973aaa WatchSource:0}: Error finding container d813e5428c486ec70cb2b1b908a24b3ab9ef2efa50758bf1436820835c973aaa: Status 404 returned error can't find the container with id d813e5428c486ec70cb2b1b908a24b3ab9ef2efa50758bf1436820835c973aaa Jul 07 23:23:27.333309 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:27.333275 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" event={"ID":"d4d8b752-114e-4959-9b2e-8cfef9a4be83","Type":"ContainerStarted","Data":"d813e5428c486ec70cb2b1b908a24b3ab9ef2efa50758bf1436820835c973aaa"} Jul 07 23:23:28.339973 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:28.339939 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" event={"ID":"d4d8b752-114e-4959-9b2e-8cfef9a4be83","Type":"ContainerStarted","Data":"7a615750a3631aab5e5f4c64d776fe191865ed27851a8a5ff84d5e527ffd6af1"} Jul 07 23:23:28.357116 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:28.357062 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" podStartSLOduration=2.172670219 podStartE2EDuration="2.357048206s" totalImagesPullingTime="184.377987ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:23:28.356236828 +0000 UTC m=+727.577671178" watchObservedRunningTime="2026-07-07 23:23:28.357048206 +0000 UTC m=+727.578482554" Jul 07 23:23:37.093193 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:37.093148 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:37.093193 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:37.093203 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:37.105563 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:37.105513 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:23:37.388723 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:23:37.388633 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr" Jul 07 23:24:16.716321 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.716279 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-755dcf9586-4xz2t"] Jul 07 23:24:16.719493 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.719469 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-755dcf9586-4xz2t" Jul 07 23:24:16.722063 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.722041 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 23:24:16.723149 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.723127 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 23:24:16.723258 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.723170 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 23:24:16.723258 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.723170 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9zck9\"" Jul 07 23:24:16.729270 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.729245 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-755dcf9586-4xz2t"] Jul 07 23:24:16.797108 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.797080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbhrk\" (UniqueName: \"kubernetes.io/projected/a576abe0-19fd-4dac-8f0c-3bd008291cb7-kube-api-access-fbhrk\") pod \"authorino-755dcf9586-4xz2t\" (UID: \"a576abe0-19fd-4dac-8f0c-3bd008291cb7\") " pod="kuadrant-system/authorino-755dcf9586-4xz2t" Jul 07 23:24:16.797253 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.797136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a576abe0-19fd-4dac-8f0c-3bd008291cb7-tls-cert\") pod \"authorino-755dcf9586-4xz2t\" (UID: \"a576abe0-19fd-4dac-8f0c-3bd008291cb7\") " pod="kuadrant-system/authorino-755dcf9586-4xz2t" Jul 07 23:24:16.898097 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.898061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a576abe0-19fd-4dac-8f0c-3bd008291cb7-tls-cert\") pod \"authorino-755dcf9586-4xz2t\" (UID: \"a576abe0-19fd-4dac-8f0c-3bd008291cb7\") " pod="kuadrant-system/authorino-755dcf9586-4xz2t" Jul 07 23:24:16.898259 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.898135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbhrk\" (UniqueName: \"kubernetes.io/projected/a576abe0-19fd-4dac-8f0c-3bd008291cb7-kube-api-access-fbhrk\") pod \"authorino-755dcf9586-4xz2t\" (UID: \"a576abe0-19fd-4dac-8f0c-3bd008291cb7\") " pod="kuadrant-system/authorino-755dcf9586-4xz2t" Jul 07 23:24:16.900709 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.900682 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a576abe0-19fd-4dac-8f0c-3bd008291cb7-tls-cert\") pod \"authorino-755dcf9586-4xz2t\" (UID: \"a576abe0-19fd-4dac-8f0c-3bd008291cb7\") " pod="kuadrant-system/authorino-755dcf9586-4xz2t" Jul 07 23:24:16.907933 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:16.907913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbhrk\" (UniqueName: \"kubernetes.io/projected/a576abe0-19fd-4dac-8f0c-3bd008291cb7-kube-api-access-fbhrk\") pod \"authorino-755dcf9586-4xz2t\" (UID: \"a576abe0-19fd-4dac-8f0c-3bd008291cb7\") " pod="kuadrant-system/authorino-755dcf9586-4xz2t" Jul 07 23:24:17.030202 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:17.030103 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-755dcf9586-4xz2t" Jul 07 23:24:17.191194 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:17.191168 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-755dcf9586-4xz2t"] Jul 07 23:24:17.193734 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:24:17.193706 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda576abe0_19fd_4dac_8f0c_3bd008291cb7.slice/crio-fad5823f5e9473df345fcbe85d0230b32dadb4dc7e3d2273f12470a2f5507ec1 WatchSource:0}: Error finding container fad5823f5e9473df345fcbe85d0230b32dadb4dc7e3d2273f12470a2f5507ec1: Status 404 returned error can't find the container with id fad5823f5e9473df345fcbe85d0230b32dadb4dc7e3d2273f12470a2f5507ec1 Jul 07 23:24:17.550830 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:17.550804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-755dcf9586-4xz2t" event={"ID":"a576abe0-19fd-4dac-8f0c-3bd008291cb7","Type":"ContainerStarted","Data":"fad5823f5e9473df345fcbe85d0230b32dadb4dc7e3d2273f12470a2f5507ec1"} Jul 07 23:24:18.557071 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:18.557031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-755dcf9586-4xz2t" event={"ID":"a576abe0-19fd-4dac-8f0c-3bd008291cb7","Type":"ContainerStarted","Data":"1fcb9e02e9ec832034324a75e8128edc2100eedc6e3c5b919adec9e1fca98c72"} Jul 07 23:24:18.578925 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:24:18.578875 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-755dcf9586-4xz2t" podStartSLOduration=2.296370762 podStartE2EDuration="2.578859397s" totalImagesPullingTime="282.488635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:24:18.577399218 +0000 UTC m=+777.798833567" watchObservedRunningTime="2026-07-07 23:24:18.578859397 +0000 UTC m=+777.800293745" Jul 07 23:41:21.290016 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.289984 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6"] Jul 07 23:41:21.293147 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.293129 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.297104 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.297078 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3d30887b\"/\"kube-root-ca.crt\"" Jul 07 23:41:21.297230 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.297078 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3d30887b\"/\"default-dockercfg-mqln7\"" Jul 07 23:41:21.297230 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.297081 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3d30887b\"/\"openshift-service-ca.crt\"" Jul 07 23:41:21.297360 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.297346 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3d30887b\"/\"e2e-lifecycle-model-3d30887b-kserve-self-signed-certs\"" Jul 07 23:41:21.308712 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.308688 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6"] Jul 07 23:41:21.329392 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.329363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-tmp-dir\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.329566 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.329408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac3456d-5b2f-4307-a594-5586309504de-tls-certs\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.329566 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.329455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-model-cache\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.329566 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.329506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-home\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.329748 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.329589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmlh6\" (UniqueName: \"kubernetes.io/projected/6ac3456d-5b2f-4307-a594-5586309504de-kube-api-access-mmlh6\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.329748 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.329627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-dshm\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.430986 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.430951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmlh6\" (UniqueName: \"kubernetes.io/projected/6ac3456d-5b2f-4307-a594-5586309504de-kube-api-access-mmlh6\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.431166 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.431003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-dshm\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.431166 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.431037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-tmp-dir\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.431166 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.431062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac3456d-5b2f-4307-a594-5586309504de-tls-certs\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.431166 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.431119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-model-cache\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.431374 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.431169 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-home\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.431428 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.431415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-tmp-dir\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.431574 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.431509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-model-cache\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.431655 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.431614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-home\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.434049 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.434026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-dshm\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.434277 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.434261 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac3456d-5b2f-4307-a594-5586309504de-tls-certs\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.440157 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.440136 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmlh6\" (UniqueName: \"kubernetes.io/projected/6ac3456d-5b2f-4307-a594-5586309504de-kube-api-access-mmlh6\") pod \"e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.604128 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.604039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:21.739396 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:21.739372 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6"] Jul 07 23:41:21.741925 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:41:21.741898 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ac3456d_5b2f_4307_a594_5586309504de.slice/crio-e6a2b5e81320cd75ab5661c6db71fe6cf7c1677c3086699d62c44b6c36e2a74d WatchSource:0}: Error finding container e6a2b5e81320cd75ab5661c6db71fe6cf7c1677c3086699d62c44b6c36e2a74d: Status 404 returned error can't find the container with id e6a2b5e81320cd75ab5661c6db71fe6cf7c1677c3086699d62c44b6c36e2a74d Jul 07 23:41:22.131892 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:22.131855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" event={"ID":"6ac3456d-5b2f-4307-a594-5586309504de","Type":"ContainerStarted","Data":"61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76"} Jul 07 23:41:22.131892 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:22.131896 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" event={"ID":"6ac3456d-5b2f-4307-a594-5586309504de","Type":"ContainerStarted","Data":"e6a2b5e81320cd75ab5661c6db71fe6cf7c1677c3086699d62c44b6c36e2a74d"} Jul 07 23:41:22.148560 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:22.148491 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" podStartSLOduration=1.148476888 podStartE2EDuration="1.148476888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:41:22.146870982 +0000 UTC m=+1801.368305333" watchObservedRunningTime="2026-07-07 23:41:22.148476888 +0000 UTC m=+1801.369911236" Jul 07 23:41:31.604759 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:31.604720 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:31.605126 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:31.604779 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:31.617292 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:31.617271 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:32.184805 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:32.184778 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:41:52.988356 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:41:52.988318 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6"] Jul 07 23:42:08.008973 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.008931 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" podUID="6ac3456d-5b2f-4307-a594-5586309504de" containerName="main" containerID="cri-o://61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76" gracePeriod=45 Jul 07 23:42:08.262967 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.262912 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:42:08.338452 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.338419 2576 generic.go:356] "Generic (PLEG): container finished" podID="6ac3456d-5b2f-4307-a594-5586309504de" containerID="61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76" exitCode=0 Jul 07 23:42:08.338635 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.338465 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" Jul 07 23:42:08.338635 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.338505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" event={"ID":"6ac3456d-5b2f-4307-a594-5586309504de","Type":"ContainerDied","Data":"61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76"} Jul 07 23:42:08.338635 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.338570 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6" event={"ID":"6ac3456d-5b2f-4307-a594-5586309504de","Type":"ContainerDied","Data":"e6a2b5e81320cd75ab5661c6db71fe6cf7c1677c3086699d62c44b6c36e2a74d"} Jul 07 23:42:08.338635 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.338589 2576 scope.go:117] "RemoveContainer" containerID="61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76" Jul 07 23:42:08.340851 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.340834 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-tmp-dir\") pod \"6ac3456d-5b2f-4307-a594-5586309504de\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " Jul 07 23:42:08.340953 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.340891 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmlh6\" (UniqueName: \"kubernetes.io/projected/6ac3456d-5b2f-4307-a594-5586309504de-kube-api-access-mmlh6\") pod \"6ac3456d-5b2f-4307-a594-5586309504de\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " Jul 07 23:42:08.340953 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.340934 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-model-cache\") pod \"6ac3456d-5b2f-4307-a594-5586309504de\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " Jul 07 23:42:08.341066 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.340988 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac3456d-5b2f-4307-a594-5586309504de-tls-certs\") pod \"6ac3456d-5b2f-4307-a594-5586309504de\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " Jul 07 23:42:08.341066 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.341044 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-home\") pod \"6ac3456d-5b2f-4307-a594-5586309504de\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " Jul 07 23:42:08.341168 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.341093 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-dshm\") pod \"6ac3456d-5b2f-4307-a594-5586309504de\" (UID: \"6ac3456d-5b2f-4307-a594-5586309504de\") " Jul 07 23:42:08.341168 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.341115 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ac3456d-5b2f-4307-a594-5586309504de" (UID: "6ac3456d-5b2f-4307-a594-5586309504de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:42:08.341168 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.341151 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ac3456d-5b2f-4307-a594-5586309504de" (UID: "6ac3456d-5b2f-4307-a594-5586309504de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:42:08.341360 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.341337 2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-model-cache\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:42:08.341453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.341368 2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-tmp-dir\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:42:08.341453 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.341332 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-home" (OuterVolumeSpecName: "home") pod "6ac3456d-5b2f-4307-a594-5586309504de" (UID: "6ac3456d-5b2f-4307-a594-5586309504de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:42:08.343473 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.343446 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-dshm" (OuterVolumeSpecName: "dshm") pod "6ac3456d-5b2f-4307-a594-5586309504de" (UID: "6ac3456d-5b2f-4307-a594-5586309504de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:42:08.343473 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.343458 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ac3456d-5b2f-4307-a594-5586309504de-kube-api-access-mmlh6" (OuterVolumeSpecName: "kube-api-access-mmlh6") pod "6ac3456d-5b2f-4307-a594-5586309504de" (UID: "6ac3456d-5b2f-4307-a594-5586309504de"). InnerVolumeSpecName "kube-api-access-mmlh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:42:08.344001 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.343978 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ac3456d-5b2f-4307-a594-5586309504de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ac3456d-5b2f-4307-a594-5586309504de" (UID: "6ac3456d-5b2f-4307-a594-5586309504de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:42:08.348969 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.348940 2576 scope.go:117] "RemoveContainer" containerID="61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76" Jul 07 23:42:08.349254 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:42:08.349228 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76\": container with ID starting with 61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76 not found: ID does not exist" containerID="61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76" Jul 07 23:42:08.349339 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.349265 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76"} err="failed to get container status \"61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76\": rpc error: code = NotFound desc = could not find container \"61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76\": container with ID starting with 61ad5a0854f79ec476ef51b8df59a7f506d868be3f78e0f12a13f8d40030ab76 not found: ID does not exist" Jul 07 23:42:08.442598 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.442565 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmlh6\" (UniqueName: \"kubernetes.io/projected/6ac3456d-5b2f-4307-a594-5586309504de-kube-api-access-mmlh6\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:42:08.442598 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.442593 2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac3456d-5b2f-4307-a594-5586309504de-tls-certs\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:42:08.442598 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.442603 2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-home\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:42:08.442808 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.442611 2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ac3456d-5b2f-4307-a594-5586309504de-dshm\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:42:08.659727 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.659686 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6"] Jul 07 23:42:08.661866 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:08.661837 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-3d30887b/e2e-lifecycle-model-3d30887b-kserve-7b77f94987-bnpj6"] Jul 07 23:42:09.307650 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:42:09.307614 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ac3456d-5b2f-4307-a594-5586309504de" path="/var/lib/kubelet/pods/6ac3456d-5b2f-4307-a594-5586309504de/volumes" Jul 07 23:43:37.629845 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.629802 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf"] Jul 07 23:43:37.630243 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.630142 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ac3456d-5b2f-4307-a594-5586309504de" containerName="main" Jul 07 23:43:37.630243 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.630153 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ac3456d-5b2f-4307-a594-5586309504de" containerName="main" Jul 07 23:43:37.630243 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.630216 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ac3456d-5b2f-4307-a594-5586309504de" containerName="main" Jul 07 23:43:37.633141 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.633122 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.635595 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.635572 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4bd96c-openshift-default-dockercfg-ttdlk\"" Jul 07 23:43:37.645070 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.645049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf"] Jul 07 23:43:37.727795 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.727746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpkp4\" (UniqueName: \"kubernetes.io/projected/5e3f8660-0f6d-4166-8b39-7de096c39a83-kube-api-access-fpkp4\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.727993 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.727803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-workload-certs\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.727993 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.727827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-podinfo\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.727993 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.727854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-envoy\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.727993 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.727915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-credential-socket\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.727993 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.727955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e3f8660-0f6d-4166-8b39-7de096c39a83-istiod-ca-cert\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.728268 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.728022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-token\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.728268 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.728083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-workload-socket\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.728268 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.728165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-data\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.828945 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.828911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpkp4\" (UniqueName: \"kubernetes.io/projected/5e3f8660-0f6d-4166-8b39-7de096c39a83-kube-api-access-fpkp4\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.828945 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.828948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-workload-certs\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.829184 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.828964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-podinfo\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.829184 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.828983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-envoy\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.829184 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.829026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-credential-socket\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.829184 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.829053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e3f8660-0f6d-4166-8b39-7de096c39a83-istiod-ca-cert\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.829184 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.829069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-token\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.829184 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.829113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-workload-socket\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.829184 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.829137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-data\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.829583 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.829551 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-credential-socket\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.829666 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.829609 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-data\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.829666 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.829656 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-workload-socket\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.829728 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.829698 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-workload-certs\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.829854 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.829836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e3f8660-0f6d-4166-8b39-7de096c39a83-istiod-ca-cert\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.831549 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.831510 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-envoy\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.831642 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.831626 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-podinfo\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.838318 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.838297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-token\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.838650 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.838629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpkp4\" (UniqueName: \"kubernetes.io/projected/5e3f8660-0f6d-4166-8b39-7de096c39a83-kube-api-access-fpkp4\") pod \"e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:37.945230 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:37.945140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:38.081097 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:38.081033 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf"] Jul 07 23:43:38.083342 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:43:38.083316 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3f8660_0f6d_4166_8b39_7de096c39a83.slice/crio-883d4fb2481c868e2124cc315989b68dd46f66b295613fbd07e1cf87cb78b822 WatchSource:0}: Error finding container 883d4fb2481c868e2124cc315989b68dd46f66b295613fbd07e1cf87cb78b822: Status 404 returned error can't find the container with id 883d4fb2481c868e2124cc315989b68dd46f66b295613fbd07e1cf87cb78b822 Jul 07 23:43:38.085579 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:38.085513 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:43:38.085639 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:38.085627 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:43:38.085684 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:38.085667 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:43:38.748925 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:38.748892 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" event={"ID":"5e3f8660-0f6d-4166-8b39-7de096c39a83","Type":"ContainerStarted","Data":"911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253"} Jul 07 23:43:38.749313 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:38.748943 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" event={"ID":"5e3f8660-0f6d-4166-8b39-7de096c39a83","Type":"ContainerStarted","Data":"883d4fb2481c868e2124cc315989b68dd46f66b295613fbd07e1cf87cb78b822"} Jul 07 23:43:38.768904 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:38.768861 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" podStartSLOduration=1.768847113 podStartE2EDuration="1.768847113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:43:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:43:38.767481428 +0000 UTC m=+1937.988915779" watchObservedRunningTime="2026-07-07 23:43:38.768847113 +0000 UTC m=+1937.990281462" Jul 07 23:43:38.946137 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:38.946101 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:39.951218 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:39.951189 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:40.757832 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:40.757799 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:40.758808 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:40.758790 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:55.475757 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.475715 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj"] Jul 07 23:43:55.479879 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.479857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.482894 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.482865 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7ddfc0\"/\"kube-root-ca.crt\"" Jul 07 23:43:55.484060 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.484041 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7ddfc0\"/\"openshift-service-ca.crt\"" Jul 07 23:43:55.484060 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.484042 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7ddfc0\"/\"default-dockercfg-sbmrs\"" Jul 07 23:43:55.484400 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.484378 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7ddfc0\"/\"test-model-7ddfc0-kserve-self-signed-certs\"" Jul 07 23:43:55.488575 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.488556 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj"] Jul 07 23:43:55.594199 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.594162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-tmp-dir\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.594375 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.594297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-dshm\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.594375 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.594358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-model-cache\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.594471 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.594377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-home\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.594471 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.594401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf8qt\" (UniqueName: \"kubernetes.io/projected/fd417f97-5cf0-4013-ad9e-22a2ac620886-kube-api-access-qf8qt\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.594471 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.594447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd417f97-5cf0-4013-ad9e-22a2ac620886-tls-certs\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.695357 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.695318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf8qt\" (UniqueName: \"kubernetes.io/projected/fd417f97-5cf0-4013-ad9e-22a2ac620886-kube-api-access-qf8qt\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.695357 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.695372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd417f97-5cf0-4013-ad9e-22a2ac620886-tls-certs\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.695653 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.695403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-tmp-dir\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.695653 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.695461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-dshm\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.695653 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.695499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-model-cache\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.695653 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.695537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-home\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.695965 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.695932 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-tmp-dir\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.695965 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.695954 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-home\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.696144 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.696001 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-model-cache\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.698057 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.698025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-dshm\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.698172 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.698151 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd417f97-5cf0-4013-ad9e-22a2ac620886-tls-certs\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.703189 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.703167 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf8qt\" (UniqueName: \"kubernetes.io/projected/fd417f97-5cf0-4013-ad9e-22a2ac620886-kube-api-access-qf8qt\") pod \"test-model-7ddfc0-kserve-d5588d445-wd7bj\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.791608 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.791508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:43:55.934138 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:55.934114 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj"] Jul 07 23:43:55.936886 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:43:55.936850 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd417f97_5cf0_4013_ad9e_22a2ac620886.slice/crio-6ba4b823912ef843b2473ca0e625701339ed00119f58f401c84ab6cbf7500c07 WatchSource:0}: Error finding container 6ba4b823912ef843b2473ca0e625701339ed00119f58f401c84ab6cbf7500c07: Status 404 returned error can't find the container with id 6ba4b823912ef843b2473ca0e625701339ed00119f58f401c84ab6cbf7500c07 Jul 07 23:43:56.555625 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:56.555589 2576 patch_prober.go:28] interesting pod/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": read tcp 10.134.0.2:51484->10.134.0.29:15021: read: connection reset by peer" start-of-body= Jul 07 23:43:56.555980 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:56.555656 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": read tcp 10.134.0.2:51484->10.134.0.29:15021: read: connection reset by peer" Jul 07 23:43:56.841972 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:56.841889 2576 generic.go:356] "Generic (PLEG): container finished" podID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerID="911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253" exitCode=0 Jul 07 23:43:56.842120 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:56.841966 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" event={"ID":"5e3f8660-0f6d-4166-8b39-7de096c39a83","Type":"ContainerDied","Data":"911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253"} Jul 07 23:43:56.842439 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:56.842419 2576 scope.go:117] "RemoveContainer" containerID="911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253" Jul 07 23:43:56.843570 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:56.843543 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:43:56.843670 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:56.843612 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:43:56.843670 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:56.843609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" event={"ID":"fd417f97-5cf0-4013-ad9e-22a2ac620886","Type":"ContainerStarted","Data":"69cdb140300d39558215c2c923efa68ef65f2cadcdb1d0a1e978842b55b5e2a6"} Jul 07 23:43:56.843670 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:56.843644 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:43:56.843670 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:56.843646 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" event={"ID":"fd417f97-5cf0-4013-ad9e-22a2ac620886","Type":"ContainerStarted","Data":"6ba4b823912ef843b2473ca0e625701339ed00119f58f401c84ab6cbf7500c07"} Jul 07 23:43:56.878392 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:56.878345 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" podStartSLOduration=1.878328547 podStartE2EDuration="1.878328547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:43:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:43:56.876858711 +0000 UTC m=+1956.098293062" watchObservedRunningTime="2026-07-07 23:43:56.878328547 +0000 UTC m=+1956.099762898" Jul 07 23:43:57.850163 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:57.850130 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" event={"ID":"5e3f8660-0f6d-4166-8b39-7de096c39a83","Type":"ContainerStarted","Data":"fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e"} Jul 07 23:43:57.946156 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:57.946118 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:43:57.946376 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:57.946351 2576 patch_prober.go:28] interesting pod/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 07 23:43:57.946446 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:57.946408 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 07 23:43:58.945734 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:58.945693 2576 patch_prober.go:28] interesting pod/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 07 23:43:58.946195 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:58.945768 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 07 23:43:59.945983 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:59.945938 2576 patch_prober.go:28] interesting pod/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 07 23:43:59.946370 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:43:59.946011 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 07 23:44:00.945658 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:44:00.945621 2576 patch_prober.go:28] interesting pod/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 07 23:44:00.945833 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:44:00.945675 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 07 23:44:01.949772 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:44:01.949741 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:44:01.950256 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:44:01.950139 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:44:01.950741 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:44:01.950723 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:44:05.792149 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:44:05.792109 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:44:05.792149 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:44:05.792155 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:44:05.804511 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:44:05.804491 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:44:05.904865 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:44:05.904837 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:44:48.959510 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:44:48.959468 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj"] Jul 07 23:45:03.980193 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:03.980142 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" podUID="fd417f97-5cf0-4013-ad9e-22a2ac620886" containerName="main" containerID="cri-o://69cdb140300d39558215c2c923efa68ef65f2cadcdb1d0a1e978842b55b5e2a6" gracePeriod=45 Jul 07 23:45:04.158783 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.158746 2576 generic.go:356] "Generic (PLEG): container finished" podID="fd417f97-5cf0-4013-ad9e-22a2ac620886" containerID="69cdb140300d39558215c2c923efa68ef65f2cadcdb1d0a1e978842b55b5e2a6" exitCode=0 Jul 07 23:45:04.158901 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.158810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" event={"ID":"fd417f97-5cf0-4013-ad9e-22a2ac620886","Type":"ContainerDied","Data":"69cdb140300d39558215c2c923efa68ef65f2cadcdb1d0a1e978842b55b5e2a6"} Jul 07 23:45:04.234621 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.234565 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:45:04.317285 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.317253 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-dshm\") pod \"fd417f97-5cf0-4013-ad9e-22a2ac620886\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " Jul 07 23:45:04.317463 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.317300 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd417f97-5cf0-4013-ad9e-22a2ac620886-tls-certs\") pod \"fd417f97-5cf0-4013-ad9e-22a2ac620886\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " Jul 07 23:45:04.317463 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.317331 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf8qt\" (UniqueName: \"kubernetes.io/projected/fd417f97-5cf0-4013-ad9e-22a2ac620886-kube-api-access-qf8qt\") pod \"fd417f97-5cf0-4013-ad9e-22a2ac620886\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " Jul 07 23:45:04.317463 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.317372 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-model-cache\") pod \"fd417f97-5cf0-4013-ad9e-22a2ac620886\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " Jul 07 23:45:04.317463 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.317404 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-tmp-dir\") pod \"fd417f97-5cf0-4013-ad9e-22a2ac620886\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " Jul 07 23:45:04.317463 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.317428 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-home\") pod \"fd417f97-5cf0-4013-ad9e-22a2ac620886\" (UID: \"fd417f97-5cf0-4013-ad9e-22a2ac620886\") " Jul 07 23:45:04.317746 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.317686 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-model-cache" (OuterVolumeSpecName: "model-cache") pod "fd417f97-5cf0-4013-ad9e-22a2ac620886" (UID: "fd417f97-5cf0-4013-ad9e-22a2ac620886"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:45:04.317746 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.317722 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fd417f97-5cf0-4013-ad9e-22a2ac620886" (UID: "fd417f97-5cf0-4013-ad9e-22a2ac620886"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:45:04.317852 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.317761 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-home" (OuterVolumeSpecName: "home") pod "fd417f97-5cf0-4013-ad9e-22a2ac620886" (UID: "fd417f97-5cf0-4013-ad9e-22a2ac620886"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:45:04.319705 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.319646 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd417f97-5cf0-4013-ad9e-22a2ac620886-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fd417f97-5cf0-4013-ad9e-22a2ac620886" (UID: "fd417f97-5cf0-4013-ad9e-22a2ac620886"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 23:45:04.319828 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.319710 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-dshm" (OuterVolumeSpecName: "dshm") pod "fd417f97-5cf0-4013-ad9e-22a2ac620886" (UID: "fd417f97-5cf0-4013-ad9e-22a2ac620886"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:45:04.319828 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.319774 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd417f97-5cf0-4013-ad9e-22a2ac620886-kube-api-access-qf8qt" (OuterVolumeSpecName: "kube-api-access-qf8qt") pod "fd417f97-5cf0-4013-ad9e-22a2ac620886" (UID: "fd417f97-5cf0-4013-ad9e-22a2ac620886"). InnerVolumeSpecName "kube-api-access-qf8qt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:45:04.418498 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.418468 2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-model-cache\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:04.418672 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.418537 2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-tmp-dir\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:04.418672 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.418547 2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-home\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:04.418672 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.418554 2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd417f97-5cf0-4013-ad9e-22a2ac620886-dshm\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:04.418672 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.418562 2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd417f97-5cf0-4013-ad9e-22a2ac620886-tls-certs\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:04.418672 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:04.418571 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf8qt\" (UniqueName: \"kubernetes.io/projected/fd417f97-5cf0-4013-ad9e-22a2ac620886-kube-api-access-qf8qt\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:05.164416 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:05.164382 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" event={"ID":"fd417f97-5cf0-4013-ad9e-22a2ac620886","Type":"ContainerDied","Data":"6ba4b823912ef843b2473ca0e625701339ed00119f58f401c84ab6cbf7500c07"} Jul 07 23:45:05.164416 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:05.164401 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj" Jul 07 23:45:05.164928 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:05.164428 2576 scope.go:117] "RemoveContainer" containerID="69cdb140300d39558215c2c923efa68ef65f2cadcdb1d0a1e978842b55b5e2a6" Jul 07 23:45:05.187093 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:05.187067 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj"] Jul 07 23:45:05.190789 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:05.190768 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-7ddfc0/test-model-7ddfc0-kserve-d5588d445-wd7bj"] Jul 07 23:45:05.306776 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:05.306745 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd417f97-5cf0-4013-ad9e-22a2ac620886" path="/var/lib/kubelet/pods/fd417f97-5cf0-4013-ad9e-22a2ac620886/volumes" Jul 07 23:45:39.596899 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:39.596863 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf"] Jul 07 23:45:39.597450 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:39.597113 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerName="istio-proxy" containerID="cri-o://fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e" gracePeriod=30 Jul 07 23:45:44.846027 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.846000 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:45:44.970048 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970019 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-token\") pod \"5e3f8660-0f6d-4166-8b39-7de096c39a83\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " Jul 07 23:45:44.970223 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970057 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-workload-certs\") pod \"5e3f8660-0f6d-4166-8b39-7de096c39a83\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " Jul 07 23:45:44.970223 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970074 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-data\") pod \"5e3f8660-0f6d-4166-8b39-7de096c39a83\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " Jul 07 23:45:44.970223 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970105 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpkp4\" (UniqueName: \"kubernetes.io/projected/5e3f8660-0f6d-4166-8b39-7de096c39a83-kube-api-access-fpkp4\") pod \"5e3f8660-0f6d-4166-8b39-7de096c39a83\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " Jul 07 23:45:44.970223 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970121 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-workload-socket\") pod \"5e3f8660-0f6d-4166-8b39-7de096c39a83\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " Jul 07 23:45:44.970223 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970179 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e3f8660-0f6d-4166-8b39-7de096c39a83-istiod-ca-cert\") pod \"5e3f8660-0f6d-4166-8b39-7de096c39a83\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " Jul 07 23:45:44.970471 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970249 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-credential-socket\") pod \"5e3f8660-0f6d-4166-8b39-7de096c39a83\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " Jul 07 23:45:44.970471 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970280 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-podinfo\") pod \"5e3f8660-0f6d-4166-8b39-7de096c39a83\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " Jul 07 23:45:44.970471 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970299 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-envoy\") pod \"5e3f8660-0f6d-4166-8b39-7de096c39a83\" (UID: \"5e3f8660-0f6d-4166-8b39-7de096c39a83\") " Jul 07 23:45:44.970471 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970375 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e3f8660-0f6d-4166-8b39-7de096c39a83" (UID: "5e3f8660-0f6d-4166-8b39-7de096c39a83"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:45:44.970725 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970581 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e3f8660-0f6d-4166-8b39-7de096c39a83" (UID: "5e3f8660-0f6d-4166-8b39-7de096c39a83"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:45:44.970725 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970587 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-workload-certs\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:44.970725 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970657 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e3f8660-0f6d-4166-8b39-7de096c39a83" (UID: "5e3f8660-0f6d-4166-8b39-7de096c39a83"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:45:44.971063 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970780 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e3f8660-0f6d-4166-8b39-7de096c39a83-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e3f8660-0f6d-4166-8b39-7de096c39a83" (UID: "5e3f8660-0f6d-4166-8b39-7de096c39a83"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 23:45:44.971063 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.970962 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e3f8660-0f6d-4166-8b39-7de096c39a83" (UID: "5e3f8660-0f6d-4166-8b39-7de096c39a83"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:45:44.972736 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.972710 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e3f8660-0f6d-4166-8b39-7de096c39a83" (UID: "5e3f8660-0f6d-4166-8b39-7de096c39a83"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:45:44.972854 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.972736 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3f8660-0f6d-4166-8b39-7de096c39a83-kube-api-access-fpkp4" (OuterVolumeSpecName: "kube-api-access-fpkp4") pod "5e3f8660-0f6d-4166-8b39-7de096c39a83" (UID: "5e3f8660-0f6d-4166-8b39-7de096c39a83"). InnerVolumeSpecName "kube-api-access-fpkp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:45:44.972999 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.972982 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e3f8660-0f6d-4166-8b39-7de096c39a83" (UID: "5e3f8660-0f6d-4166-8b39-7de096c39a83"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:45:44.973068 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:44.973051 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e3f8660-0f6d-4166-8b39-7de096c39a83" (UID: "5e3f8660-0f6d-4166-8b39-7de096c39a83"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 23:45:45.071825 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.071791 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpkp4\" (UniqueName: \"kubernetes.io/projected/5e3f8660-0f6d-4166-8b39-7de096c39a83-kube-api-access-fpkp4\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:45.071825 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.071820 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-workload-socket\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:45.071825 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.071830 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e3f8660-0f6d-4166-8b39-7de096c39a83-istiod-ca-cert\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:45.072032 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.071839 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-credential-socket\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:45.072032 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.071847 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-podinfo\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:45.072032 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.071855 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-envoy\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:45.072032 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.071862 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-token\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:45.072032 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.071869 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e3f8660-0f6d-4166-8b39-7de096c39a83-istio-data\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:45:45.345211 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.345178 2576 generic.go:356] "Generic (PLEG): container finished" podID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerID="fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e" exitCode=0 Jul 07 23:45:45.345358 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.345226 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" Jul 07 23:45:45.345358 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.345269 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" event={"ID":"5e3f8660-0f6d-4166-8b39-7de096c39a83","Type":"ContainerDied","Data":"fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e"} Jul 07 23:45:45.345358 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.345322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf" event={"ID":"5e3f8660-0f6d-4166-8b39-7de096c39a83","Type":"ContainerDied","Data":"883d4fb2481c868e2124cc315989b68dd46f66b295613fbd07e1cf87cb78b822"} Jul 07 23:45:45.345358 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.345344 2576 scope.go:117] "RemoveContainer" containerID="fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e" Jul 07 23:45:45.354062 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.354025 2576 scope.go:117] "RemoveContainer" containerID="911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253" Jul 07 23:45:45.361762 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.361739 2576 scope.go:117] "RemoveContainer" containerID="fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e" Jul 07 23:45:45.362251 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:45:45.362224 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e\": container with ID starting with fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e not found: ID does not exist" containerID="fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e" Jul 07 23:45:45.362343 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.362262 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e"} err="failed to get container status \"fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e\": rpc error: code = NotFound desc = could not find container \"fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e\": container with ID starting with fc26162109c9fe7cc871db6461993a81cb78b7876fe6d0421d1ea6350148629e not found: ID does not exist" Jul 07 23:45:45.362343 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.362286 2576 scope.go:117] "RemoveContainer" containerID="911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253" Jul 07 23:45:45.362593 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:45:45.362574 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253\": container with ID starting with 911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253 not found: ID does not exist" containerID="911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253" Jul 07 23:45:45.362648 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.362600 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253"} err="failed to get container status \"911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253\": rpc error: code = NotFound desc = could not find container \"911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253\": container with ID starting with 911759e053b28df6f77400efda534262a637430e26d549f30927bfba56637253 not found: ID does not exist" Jul 07 23:45:45.363851 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.363833 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf"] Jul 07 23:45:45.369797 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:45.369772 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4bd96c-openshift-default-677969bc4c-x4bgf"] Jul 07 23:45:47.308142 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:47.308108 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" path="/var/lib/kubelet/pods/5e3f8660-0f6d-4166-8b39-7de096c39a83/volumes" Jul 07 23:45:48.535050 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.535012 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84"] Jul 07 23:45:48.535499 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.535469 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd417f97-5cf0-4013-ad9e-22a2ac620886" containerName="main" Jul 07 23:45:48.535499 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.535483 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd417f97-5cf0-4013-ad9e-22a2ac620886" containerName="main" Jul 07 23:45:48.535614 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.535500 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerName="istio-proxy" Jul 07 23:45:48.535614 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.535508 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerName="istio-proxy" Jul 07 23:45:48.535685 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.535613 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerName="istio-proxy" Jul 07 23:45:48.535685 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.535626 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerName="istio-proxy" Jul 07 23:45:48.535685 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.535636 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd417f97-5cf0-4013-ad9e-22a2ac620886" containerName="main" Jul 07 23:45:48.540550 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.540511 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.543155 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.543139 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0746a7-openshift-default-dockercfg-wczfl\"" Jul 07 23:45:48.549421 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.549395 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84"] Jul 07 23:45:48.604327 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.604299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-envoy\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.604465 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.604348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ec6147b-57ef-4ac3-a37e-42b095345412-istiod-ca-cert\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.604465 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.604416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-workload-certs\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.604465 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.604457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-workload-socket\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.604610 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.604479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-data\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.604610 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.604542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-token\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.604610 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.604596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-credential-socket\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.604701 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.604621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-podinfo\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.604701 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.604646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcmx9\" (UniqueName: \"kubernetes.io/projected/4ec6147b-57ef-4ac3-a37e-42b095345412-kube-api-access-gcmx9\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.705587 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.705509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-credential-socket\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.705587 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.705596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-podinfo\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.705826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.705628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcmx9\" (UniqueName: \"kubernetes.io/projected/4ec6147b-57ef-4ac3-a37e-42b095345412-kube-api-access-gcmx9\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.705826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.705656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-envoy\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.705826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.705710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ec6147b-57ef-4ac3-a37e-42b095345412-istiod-ca-cert\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.705826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.705744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-workload-certs\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.705826 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.705810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-workload-socket\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.706077 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.705912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-data\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.706205 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.706109 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-credential-socket\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.706205 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.706176 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-workload-socket\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.706303 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.706218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-workload-certs\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.706303 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.706283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-token\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.706588 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.706369 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-data\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.706588 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.706477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ec6147b-57ef-4ac3-a37e-42b095345412-istiod-ca-cert\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.708186 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.708163 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-envoy\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.708302 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.708284 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-podinfo\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.714780 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.714715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcmx9\" (UniqueName: \"kubernetes.io/projected/4ec6147b-57ef-4ac3-a37e-42b095345412-kube-api-access-gcmx9\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.714780 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.714767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-token\") pod \"e2e-api-b-0746a7-openshift-default-566b864d55-42p84\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.851672 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.851588 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:48.995307 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:48.995280 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84"] Jul 07 23:45:48.997924 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:45:48.997884 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec6147b_57ef_4ac3_a37e_42b095345412.slice/crio-68692e8d201a13297fc2fd160ee429db107ddaa009700370527418b615bbd0da WatchSource:0}: Error finding container 68692e8d201a13297fc2fd160ee429db107ddaa009700370527418b615bbd0da: Status 404 returned error can't find the container with id 68692e8d201a13297fc2fd160ee429db107ddaa009700370527418b615bbd0da Jul 07 23:45:49.000148 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:49.000116 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:45:49.000265 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:49.000191 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:45:49.000265 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:49.000234 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:45:49.364913 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:49.364874 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" event={"ID":"4ec6147b-57ef-4ac3-a37e-42b095345412","Type":"ContainerStarted","Data":"8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85"} Jul 07 23:45:49.365119 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:49.364932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" event={"ID":"4ec6147b-57ef-4ac3-a37e-42b095345412","Type":"ContainerStarted","Data":"68692e8d201a13297fc2fd160ee429db107ddaa009700370527418b615bbd0da"} Jul 07 23:45:49.386364 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:49.386307 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" podStartSLOduration=1.386292687 podStartE2EDuration="1.386292687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:45:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:45:49.383874127 +0000 UTC m=+2068.605308501" watchObservedRunningTime="2026-07-07 23:45:49.386292687 +0000 UTC m=+2068.607727035" Jul 07 23:45:49.852191 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:49.852154 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:50.856689 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:50.856661 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:51.374853 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:51.374821 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:45:51.375964 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:45:51.375941 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:46:10.461903 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:10.461870 2576 generic.go:356] "Generic (PLEG): container finished" podID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerID="8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85" exitCode=0 Jul 07 23:46:10.462297 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:10.461937 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" event={"ID":"4ec6147b-57ef-4ac3-a37e-42b095345412","Type":"ContainerDied","Data":"8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85"} Jul 07 23:46:10.462340 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:10.462327 2576 scope.go:117] "RemoveContainer" containerID="8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85" Jul 07 23:46:10.463450 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:10.463424 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:46:10.463560 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:10.463491 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:46:10.463653 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:10.463639 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:46:11.468482 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:11.468450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" event={"ID":"4ec6147b-57ef-4ac3-a37e-42b095345412","Type":"ContainerStarted","Data":"3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa"} Jul 07 23:46:11.852568 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:11.852456 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:46:11.852711 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:11.852654 2576 patch_prober.go:28] interesting pod/e2e-api-b-0746a7-openshift-default-566b864d55-42p84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 07 23:46:11.852764 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:11.852707 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" podUID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 07 23:46:12.852974 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:12.852938 2576 patch_prober.go:28] interesting pod/e2e-api-b-0746a7-openshift-default-566b864d55-42p84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 07 23:46:12.853362 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:12.852995 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" podUID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 07 23:46:13.852672 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:13.852638 2576 patch_prober.go:28] interesting pod/e2e-api-b-0746a7-openshift-default-566b864d55-42p84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 07 23:46:13.853045 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:13.852690 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" podUID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 07 23:46:14.852741 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:14.852698 2576 patch_prober.go:28] interesting pod/e2e-api-b-0746a7-openshift-default-566b864d55-42p84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 07 23:46:14.852921 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:14.852767 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" podUID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 07 23:46:15.856221 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:15.856189 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:46:15.856599 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:15.856447 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:46:15.857082 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:15.857063 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:46:17.451992 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:17.451959 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84"] Jul 07 23:46:17.496492 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:17.496458 2576 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" secret="" err="secret \"e2e-api-b-0746a7-openshift-default-dockercfg-wczfl\" not found" Jul 07 23:46:18.500988 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:18.500944 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" podUID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerName="istio-proxy" containerID="cri-o://3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa" gracePeriod=30 Jul 07 23:46:23.750861 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.750835 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:46:23.825856 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.825758 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-credential-socket\") pod \"4ec6147b-57ef-4ac3-a37e-42b095345412\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " Jul 07 23:46:23.825856 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.825830 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ec6147b-57ef-4ac3-a37e-42b095345412-istiod-ca-cert\") pod \"4ec6147b-57ef-4ac3-a37e-42b095345412\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " Jul 07 23:46:23.826079 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.825876 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-workload-certs\") pod \"4ec6147b-57ef-4ac3-a37e-42b095345412\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " Jul 07 23:46:23.826079 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.825904 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-data\") pod \"4ec6147b-57ef-4ac3-a37e-42b095345412\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " Jul 07 23:46:23.826079 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.825942 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-podinfo\") pod \"4ec6147b-57ef-4ac3-a37e-42b095345412\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " Jul 07 23:46:23.826079 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.826003 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-workload-socket\") pod \"4ec6147b-57ef-4ac3-a37e-42b095345412\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " Jul 07 23:46:23.826079 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.826029 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcmx9\" (UniqueName: \"kubernetes.io/projected/4ec6147b-57ef-4ac3-a37e-42b095345412-kube-api-access-gcmx9\") pod \"4ec6147b-57ef-4ac3-a37e-42b095345412\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " Jul 07 23:46:23.826079 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.826061 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-envoy\") pod \"4ec6147b-57ef-4ac3-a37e-42b095345412\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " Jul 07 23:46:23.826360 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.826093 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-token\") pod \"4ec6147b-57ef-4ac3-a37e-42b095345412\" (UID: \"4ec6147b-57ef-4ac3-a37e-42b095345412\") " Jul 07 23:46:23.826360 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.826065 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ec6147b-57ef-4ac3-a37e-42b095345412" (UID: "4ec6147b-57ef-4ac3-a37e-42b095345412"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:46:23.826360 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.826256 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ec6147b-57ef-4ac3-a37e-42b095345412" (UID: "4ec6147b-57ef-4ac3-a37e-42b095345412"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:46:23.826360 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.826286 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ec6147b-57ef-4ac3-a37e-42b095345412" (UID: "4ec6147b-57ef-4ac3-a37e-42b095345412"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:46:23.826360 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.826301 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ec6147b-57ef-4ac3-a37e-42b095345412-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ec6147b-57ef-4ac3-a37e-42b095345412" (UID: "4ec6147b-57ef-4ac3-a37e-42b095345412"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 23:46:23.826628 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.826368 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-workload-socket\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:46:23.826628 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.826387 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-credential-socket\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:46:23.826628 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.826403 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-workload-certs\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:46:23.827126 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.827093 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ec6147b-57ef-4ac3-a37e-42b095345412" (UID: "4ec6147b-57ef-4ac3-a37e-42b095345412"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:46:23.828370 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.828343 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ec6147b-57ef-4ac3-a37e-42b095345412" (UID: "4ec6147b-57ef-4ac3-a37e-42b095345412"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 23:46:23.828476 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.828390 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ec6147b-57ef-4ac3-a37e-42b095345412" (UID: "4ec6147b-57ef-4ac3-a37e-42b095345412"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:46:23.828476 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.828406 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ec6147b-57ef-4ac3-a37e-42b095345412-kube-api-access-gcmx9" (OuterVolumeSpecName: "kube-api-access-gcmx9") pod "4ec6147b-57ef-4ac3-a37e-42b095345412" (UID: "4ec6147b-57ef-4ac3-a37e-42b095345412"). InnerVolumeSpecName "kube-api-access-gcmx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:46:23.828603 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.828493 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ec6147b-57ef-4ac3-a37e-42b095345412" (UID: "4ec6147b-57ef-4ac3-a37e-42b095345412"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:46:23.927058 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.927016 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-token\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:46:23.927058 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.927051 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ec6147b-57ef-4ac3-a37e-42b095345412-istiod-ca-cert\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:46:23.927058 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.927062 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-data\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:46:23.927338 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.927069 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-podinfo\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:46:23.927338 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.927078 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcmx9\" (UniqueName: \"kubernetes.io/projected/4ec6147b-57ef-4ac3-a37e-42b095345412-kube-api-access-gcmx9\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:46:23.927338 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:23.927087 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ec6147b-57ef-4ac3-a37e-42b095345412-istio-envoy\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:46:24.528679 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:24.528646 2576 generic.go:356] "Generic (PLEG): container finished" podID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerID="3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa" exitCode=0 Jul 07 23:46:24.528859 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:24.528699 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" Jul 07 23:46:24.528859 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:24.528735 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" event={"ID":"4ec6147b-57ef-4ac3-a37e-42b095345412","Type":"ContainerDied","Data":"3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa"} Jul 07 23:46:24.528859 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:24.528795 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84" event={"ID":"4ec6147b-57ef-4ac3-a37e-42b095345412","Type":"ContainerDied","Data":"68692e8d201a13297fc2fd160ee429db107ddaa009700370527418b615bbd0da"} Jul 07 23:46:24.528859 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:24.528825 2576 scope.go:117] "RemoveContainer" containerID="3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa" Jul 07 23:46:24.538390 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:24.538371 2576 scope.go:117] "RemoveContainer" containerID="8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85" Jul 07 23:46:24.546613 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:24.546594 2576 scope.go:117] "RemoveContainer" containerID="3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa" Jul 07 23:46:24.546892 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:46:24.546871 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa\": container with ID starting with 3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa not found: ID does not exist" containerID="3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa" Jul 07 23:46:24.546952 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:24.546901 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa"} err="failed to get container status \"3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa\": rpc error: code = NotFound desc = could not find container \"3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa\": container with ID starting with 3674f53aca25022e2b446d1cd62db65bca519bd666a8ca0f0e4bbf29c84fa4aa not found: ID does not exist" Jul 07 23:46:24.546952 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:24.546920 2576 scope.go:117] "RemoveContainer" containerID="8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85" Jul 07 23:46:24.547160 ip-10-0-130-40 kubenswrapper[2576]: E0707 23:46:24.547146 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85\": container with ID starting with 8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85 not found: ID does not exist" containerID="8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85" Jul 07 23:46:24.547206 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:24.547162 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85"} err="failed to get container status \"8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85\": rpc error: code = NotFound desc = could not find container \"8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85\": container with ID starting with 8a3601681416ea78e7a7f0bc221649f31c3ba27522bee683542c27e2c6b4ec85 not found: ID does not exist" Jul 07 23:46:24.551260 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:24.551237 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84"] Jul 07 23:46:24.555009 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:24.554989 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0746a7-openshift-default-566b864d55-42p84"] Jul 07 23:46:25.307261 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:25.307228 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ec6147b-57ef-4ac3-a37e-42b095345412" path="/var/lib/kubelet/pods/4ec6147b-57ef-4ac3-a37e-42b095345412/volumes" Jul 07 23:46:26.635374 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.635343 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm"] Jul 07 23:46:26.635740 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.635670 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerName="istio-proxy" Jul 07 23:46:26.635740 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.635682 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3f8660-0f6d-4166-8b39-7de096c39a83" containerName="istio-proxy" Jul 07 23:46:26.635740 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.635699 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerName="istio-proxy" Jul 07 23:46:26.635740 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.635704 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerName="istio-proxy" Jul 07 23:46:26.635740 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.635711 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerName="istio-proxy" Jul 07 23:46:26.635740 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.635716 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerName="istio-proxy" Jul 07 23:46:26.635921 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.635770 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerName="istio-proxy" Jul 07 23:46:26.635921 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.635776 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec6147b-57ef-4ac3-a37e-42b095345412" containerName="istio-proxy" Jul 07 23:46:26.640216 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.640195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.642794 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.642776 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c03c4f-openshift-default-dockercfg-4zhgg\"" Jul 07 23:46:26.658156 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.658131 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm"] Jul 07 23:46:26.751292 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.751255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-workload-socket\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.751292 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.751298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-envoy\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.751569 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.751324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-data\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.751569 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.751377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cthj\" (UniqueName: \"kubernetes.io/projected/77d8ea47-e734-462f-8ef1-cd9a903dab21-kube-api-access-4cthj\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.751569 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.751414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-credential-socket\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.751569 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.751431 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-workload-certs\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.751569 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.751452 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-podinfo\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.751569 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.751481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77d8ea47-e734-462f-8ef1-cd9a903dab21-istiod-ca-cert\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.751806 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.751597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-token\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.852696 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.852662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-token\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.852873 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.852724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-workload-socket\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.852873 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.852751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-envoy\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.852873 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.852780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-data\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.852873 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.852810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cthj\" (UniqueName: \"kubernetes.io/projected/77d8ea47-e734-462f-8ef1-cd9a903dab21-kube-api-access-4cthj\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.852873 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.852851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-credential-socket\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.853204 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.852877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-workload-certs\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.853204 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.852908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-podinfo\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.853204 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.852940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77d8ea47-e734-462f-8ef1-cd9a903dab21-istiod-ca-cert\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.853352 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.853226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-workload-socket\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.853352 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.853292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-credential-socket\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.853452 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.853368 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-data\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.853503 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.853455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-workload-certs\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.853667 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.853650 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77d8ea47-e734-462f-8ef1-cd9a903dab21-istiod-ca-cert\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.855488 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.855462 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-envoy\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.855616 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.855596 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-podinfo\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.860714 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.860688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-token\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.860820 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.860750 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cthj\" (UniqueName: \"kubernetes.io/projected/77d8ea47-e734-462f-8ef1-cd9a903dab21-kube-api-access-4cthj\") pod \"e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:26.950512 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:26.950432 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:27.094393 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:27.094366 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm"] Jul 07 23:46:27.096190 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:46:27.096159 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d8ea47_e734_462f_8ef1_cd9a903dab21.slice/crio-0daf47404e84291bd3d1bb595724f895c31556449e063a1b0bc0bbba02c45f6c WatchSource:0}: Error finding container 0daf47404e84291bd3d1bb595724f895c31556449e063a1b0bc0bbba02c45f6c: Status 404 returned error can't find the container with id 0daf47404e84291bd3d1bb595724f895c31556449e063a1b0bc0bbba02c45f6c Jul 07 23:46:27.098572 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:27.098542 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:46:27.098670 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:27.098614 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:46:27.098670 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:27.098646 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:46:27.545459 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:27.545418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" event={"ID":"77d8ea47-e734-462f-8ef1-cd9a903dab21","Type":"ContainerStarted","Data":"74563fa4884fb08746dca030cb61ad2f00acdd8930e2360b65f048fe8ea4f997"} Jul 07 23:46:27.545677 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:27.545474 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" event={"ID":"77d8ea47-e734-462f-8ef1-cd9a903dab21","Type":"ContainerStarted","Data":"0daf47404e84291bd3d1bb595724f895c31556449e063a1b0bc0bbba02c45f6c"} Jul 07 23:46:27.563690 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:27.563635 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" podStartSLOduration=1.5636157640000001 podStartE2EDuration="1.563615764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 23:46:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:46:27.563261012 +0000 UTC m=+2106.784695373" watchObservedRunningTime="2026-07-07 23:46:27.563615764 +0000 UTC m=+2106.785050116" Jul 07 23:46:27.951467 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:27.951378 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:28.956133 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:28.956097 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:29.554767 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:29.554735 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:29.555847 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:29.555829 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:45.017831 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:45.017775 2576 patch_prober.go:28] interesting pod/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": read tcp 10.134.0.2:54478->10.134.0.32:15021: read: connection reset by peer" start-of-body= Jul 07 23:46:45.018204 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:45.017849 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": read tcp 10.134.0.2:54478->10.134.0.32:15021: read: connection reset by peer" Jul 07 23:46:45.641626 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:45.641594 2576 generic.go:356] "Generic (PLEG): container finished" podID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerID="74563fa4884fb08746dca030cb61ad2f00acdd8930e2360b65f048fe8ea4f997" exitCode=0 Jul 07 23:46:45.641799 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:45.641666 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" event={"ID":"77d8ea47-e734-462f-8ef1-cd9a903dab21","Type":"ContainerDied","Data":"74563fa4884fb08746dca030cb61ad2f00acdd8930e2360b65f048fe8ea4f997"} Jul 07 23:46:45.642060 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:45.642047 2576 scope.go:117] "RemoveContainer" containerID="74563fa4884fb08746dca030cb61ad2f00acdd8930e2360b65f048fe8ea4f997" Jul 07 23:46:45.642999 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:45.642975 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:46:45.643063 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:45.643039 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:46:45.643097 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:45.643075 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 23:46:46.648151 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:46.648112 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" event={"ID":"77d8ea47-e734-462f-8ef1-cd9a903dab21","Type":"ContainerStarted","Data":"35f7104df32a0b25be91d9c6c78691ded6e0909e4a89fa60c41c9fd87072f279"} Jul 07 23:46:46.951455 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:46.951363 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:46.951640 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:46.951607 2576 patch_prober.go:28] interesting pod/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 07 23:46:46.951690 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:46.951660 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 07 23:46:47.951170 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:47.951128 2576 patch_prober.go:28] interesting pod/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 07 23:46:47.951671 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:47.951193 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 07 23:46:48.950839 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:48.950801 2576 patch_prober.go:28] interesting pod/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 07 23:46:48.951018 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:48.950856 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 07 23:46:49.951790 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:49.951755 2576 patch_prober.go:28] interesting pod/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 07 23:46:49.952154 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:49.951814 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 07 23:46:50.954389 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:50.954358 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:50.954788 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:50.954633 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:46:50.955350 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:46:50.955333 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:49:52.380780 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:52.380744 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm"] Jul 07 23:49:52.381368 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:52.380954 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerName="istio-proxy" containerID="cri-o://35f7104df32a0b25be91d9c6c78691ded6e0909e4a89fa60c41c9fd87072f279" gracePeriod=30 Jul 07 23:49:53.223588 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:53.223558 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-755dcf9586-4xz2t_a576abe0-19fd-4dac-8f0c-3bd008291cb7/authorino/0.log" Jul 07 23:49:57.519935 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.519893 2576 generic.go:356] "Generic (PLEG): container finished" podID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerID="35f7104df32a0b25be91d9c6c78691ded6e0909e4a89fa60c41c9fd87072f279" exitCode=0 Jul 07 23:49:57.520337 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.519962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" event={"ID":"77d8ea47-e734-462f-8ef1-cd9a903dab21","Type":"ContainerDied","Data":"35f7104df32a0b25be91d9c6c78691ded6e0909e4a89fa60c41c9fd87072f279"} Jul 07 23:49:57.520337 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.520026 2576 scope.go:117] "RemoveContainer" containerID="74563fa4884fb08746dca030cb61ad2f00acdd8930e2360b65f048fe8ea4f997" Jul 07 23:49:57.632028 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.632001 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:49:57.779485 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.779452 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77d8ea47-e734-462f-8ef1-cd9a903dab21-istiod-ca-cert\") pod \"77d8ea47-e734-462f-8ef1-cd9a903dab21\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " Jul 07 23:49:57.779668 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.779509 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-token\") pod \"77d8ea47-e734-462f-8ef1-cd9a903dab21\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " Jul 07 23:49:57.779668 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.779569 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-workload-socket\") pod \"77d8ea47-e734-462f-8ef1-cd9a903dab21\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " Jul 07 23:49:57.779668 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.779589 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-podinfo\") pod \"77d8ea47-e734-462f-8ef1-cd9a903dab21\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " Jul 07 23:49:57.779668 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.779624 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-data\") pod \"77d8ea47-e734-462f-8ef1-cd9a903dab21\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " Jul 07 23:49:57.779889 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.779681 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cthj\" (UniqueName: \"kubernetes.io/projected/77d8ea47-e734-462f-8ef1-cd9a903dab21-kube-api-access-4cthj\") pod \"77d8ea47-e734-462f-8ef1-cd9a903dab21\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " Jul 07 23:49:57.779889 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.779737 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-credential-socket\") pod \"77d8ea47-e734-462f-8ef1-cd9a903dab21\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " Jul 07 23:49:57.779889 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.779763 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-workload-certs\") pod \"77d8ea47-e734-462f-8ef1-cd9a903dab21\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " Jul 07 23:49:57.779889 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.779857 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-envoy\") pod \"77d8ea47-e734-462f-8ef1-cd9a903dab21\" (UID: \"77d8ea47-e734-462f-8ef1-cd9a903dab21\") " Jul 07 23:49:57.780079 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.780047 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77d8ea47-e734-462f-8ef1-cd9a903dab21-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "77d8ea47-e734-462f-8ef1-cd9a903dab21" (UID: "77d8ea47-e734-462f-8ef1-cd9a903dab21"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 23:49:57.780079 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.780047 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "77d8ea47-e734-462f-8ef1-cd9a903dab21" (UID: "77d8ea47-e734-462f-8ef1-cd9a903dab21"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:49:57.780180 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.780159 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77d8ea47-e734-462f-8ef1-cd9a903dab21-istiod-ca-cert\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:49:57.780180 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.780177 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-workload-socket\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:49:57.780284 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.780270 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "77d8ea47-e734-462f-8ef1-cd9a903dab21" (UID: "77d8ea47-e734-462f-8ef1-cd9a903dab21"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:49:57.780340 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.780296 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "77d8ea47-e734-462f-8ef1-cd9a903dab21" (UID: "77d8ea47-e734-462f-8ef1-cd9a903dab21"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:49:57.780653 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.780611 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-data" (OuterVolumeSpecName: "istio-data") pod "77d8ea47-e734-462f-8ef1-cd9a903dab21" (UID: "77d8ea47-e734-462f-8ef1-cd9a903dab21"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:49:57.781985 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.781964 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-token" (OuterVolumeSpecName: "istio-token") pod "77d8ea47-e734-462f-8ef1-cd9a903dab21" (UID: "77d8ea47-e734-462f-8ef1-cd9a903dab21"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:49:57.781985 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.781968 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "77d8ea47-e734-462f-8ef1-cd9a903dab21" (UID: "77d8ea47-e734-462f-8ef1-cd9a903dab21"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 23:49:57.782196 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.782180 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "77d8ea47-e734-462f-8ef1-cd9a903dab21" (UID: "77d8ea47-e734-462f-8ef1-cd9a903dab21"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 23:49:57.782366 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.782348 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77d8ea47-e734-462f-8ef1-cd9a903dab21-kube-api-access-4cthj" (OuterVolumeSpecName: "kube-api-access-4cthj") pod "77d8ea47-e734-462f-8ef1-cd9a903dab21" (UID: "77d8ea47-e734-462f-8ef1-cd9a903dab21"). InnerVolumeSpecName "kube-api-access-4cthj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 23:49:57.880849 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.880822 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-podinfo\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:49:57.880849 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.880847 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-data\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:49:57.880849 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.880856 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cthj\" (UniqueName: \"kubernetes.io/projected/77d8ea47-e734-462f-8ef1-cd9a903dab21-kube-api-access-4cthj\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:49:57.880849 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.880864 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-credential-socket\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:49:57.880849 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.880873 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-workload-certs\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:49:57.881472 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.880887 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-envoy\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:49:57.881472 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:57.880899 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77d8ea47-e734-462f-8ef1-cd9a903dab21-istio-token\") on node \"ip-10-0-130-40.ec2.internal\" DevicePath \"\"" Jul 07 23:49:58.360887 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:58.360855 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-g725l_7108ffb6-2f47-428d-b676-c86d6b61fbbd/manager/0.log" Jul 07 23:49:58.526176 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:58.526146 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" Jul 07 23:49:58.526176 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:58.526170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm" event={"ID":"77d8ea47-e734-462f-8ef1-cd9a903dab21","Type":"ContainerDied","Data":"0daf47404e84291bd3d1bb595724f895c31556449e063a1b0bc0bbba02c45f6c"} Jul 07 23:49:58.526668 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:58.526233 2576 scope.go:117] "RemoveContainer" containerID="35f7104df32a0b25be91d9c6c78691ded6e0909e4a89fa60c41c9fd87072f279" Jul 07 23:49:58.549369 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:58.549343 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm"] Jul 07 23:49:58.554964 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:58.554940 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c03c4f-openshift-default-7995bc4f9f-q5tfm"] Jul 07 23:49:58.732028 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:58.732005 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-855c64c48d-vkfvk_d1d03444-9971-47d9-9920-a9d8dabb2fb8/copy-manifests/0.log" Jul 07 23:49:58.739477 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:58.739460 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-855c64c48d-vkfvk_d1d03444-9971-47d9-9920-a9d8dabb2fb8/manager/0.log" Jul 07 23:49:59.312030 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:49:59.311995 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" path="/var/lib/kubelet/pods/77d8ea47-e734-462f-8ef1-cd9a903dab21/volumes" Jul 07 23:50:00.034482 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:00.034449 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-755dcf9586-4xz2t_a576abe0-19fd-4dac-8f0c-3bd008291cb7/authorino/0.log" Jul 07 23:50:01.234554 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:01.234510 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ngkwd_1a5641ed-355b-402f-9140-b93c40fc7274/istio-proxy/0.log" Jul 07 23:50:01.467425 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:01.467397 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67dd9c547-fc4rc_86e10322-7624-47e1-86a0-4e86406be7cd/kube-auth-proxy/0.log" Jul 07 23:50:01.703292 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:01.703204 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-226gt_7c5d8d83-571b-434b-9215-1257953433b7/istio-proxy/1.log" Jul 07 23:50:02.544231 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:02.544203 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-ld52v_79bae112-d16d-4c50-b760-66518437e374/main/0.log" Jul 07 23:50:02.883583 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:02.883488 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dvxjr_401149b6-1600-4d60-aa1e-a83d2d236b56/main/0.log" Jul 07 23:50:02.997506 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:02.997478 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-fzzrr_d4d8b752-114e-4959-9b2e-8cfef9a4be83/main/0.log" Jul 07 23:50:09.752306 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:09.752272 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dxqh9_a0f28df4-16eb-4de1-ac26-a54f20a2f998/global-pull-secret-syncer/0.log" Jul 07 23:50:09.922675 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:09.922611 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s2dzv_7c54f1e0-13db-419a-842f-bc32ca77bea3/konnectivity-agent/0.log" Jul 07 23:50:09.939843 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:09.939813 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-40.ec2.internal_702fecf07f3eb2502132a6413ffba9f0/haproxy/0.log" Jul 07 23:50:14.719947 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:14.719865 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-755dcf9586-4xz2t_a576abe0-19fd-4dac-8f0c-3bd008291cb7/authorino/0.log" Jul 07 23:50:16.801905 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:16.801868 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-4l4sl_428587b3-b08e-4b12-8e18-40e2869d4f51/kube-state-metrics/0.log" Jul 07 23:50:16.835363 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:16.835295 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-4l4sl_428587b3-b08e-4b12-8e18-40e2869d4f51/kube-rbac-proxy-main/0.log" Jul 07 23:50:16.864607 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:16.864578 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-4l4sl_428587b3-b08e-4b12-8e18-40e2869d4f51/kube-rbac-proxy-self/0.log" Jul 07 23:50:17.023157 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:17.023132 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rr2qg_9ffc2c93-5b5c-4e8a-a291-13763ac9aee1/node-exporter/0.log" Jul 07 23:50:17.041995 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:17.041974 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rr2qg_9ffc2c93-5b5c-4e8a-a291-13763ac9aee1/kube-rbac-proxy/0.log" Jul 07 23:50:17.060682 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:17.060664 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rr2qg_9ffc2c93-5b5c-4e8a-a291-13763ac9aee1/init-textfile/0.log" Jul 07 23:50:17.156440 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:17.156370 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5w4b4_eb97b6f5-9428-4303-b584-8d6377ef5ef3/kube-rbac-proxy-main/0.log" Jul 07 23:50:17.182141 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:17.182122 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5w4b4_eb97b6f5-9428-4303-b584-8d6377ef5ef3/kube-rbac-proxy-self/0.log" Jul 07 23:50:17.199716 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:17.199698 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5w4b4_eb97b6f5-9428-4303-b584-8d6377ef5ef3/openshift-state-metrics/0.log" Jul 07 23:50:20.048672 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.048636 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh"] Jul 07 23:50:20.049086 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.048979 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerName="istio-proxy" Jul 07 23:50:20.049086 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.048990 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerName="istio-proxy" Jul 07 23:50:20.049086 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.049004 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerName="istio-proxy" Jul 07 23:50:20.049086 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.049011 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerName="istio-proxy" Jul 07 23:50:20.049250 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.049096 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerName="istio-proxy" Jul 07 23:50:20.049250 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.049111 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="77d8ea47-e734-462f-8ef1-cd9a903dab21" containerName="istio-proxy" Jul 07 23:50:20.053768 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.053745 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.056494 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.056467 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6rh9f\"/\"kube-root-ca.crt\"" Jul 07 23:50:20.056494 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.056465 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6rh9f\"/\"default-dockercfg-kv9vp\"" Jul 07 23:50:20.057316 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.057301 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6rh9f\"/\"openshift-service-ca.crt\"" Jul 07 23:50:20.062503 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.062482 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh"] Jul 07 23:50:20.171315 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.171280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-sys\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.171315 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.171315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhcb9\" (UniqueName: \"kubernetes.io/projected/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-kube-api-access-nhcb9\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.171509 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.171390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-lib-modules\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.171509 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.171421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-proc\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.171509 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.171457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-podres\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.272536 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.272484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-lib-modules\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.272536 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.272534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-proc\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.272815 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.272573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-podres\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.272815 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.272603 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-proc\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.272815 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.272620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-sys\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.272815 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.272637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhcb9\" (UniqueName: \"kubernetes.io/projected/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-kube-api-access-nhcb9\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.272815 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.272656 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-lib-modules\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.272815 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.272668 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-sys\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.272815 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.272753 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-podres\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.280774 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.280756 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhcb9\" (UniqueName: \"kubernetes.io/projected/5254c118-4fd3-4dc5-acc1-d7fd26f2bef9-kube-api-access-nhcb9\") pod \"perf-node-gather-daemonset-zwjzh\" (UID: \"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9\") " pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.364390 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.364296 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.497959 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.497934 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh"] Jul 07 23:50:20.502462 ip-10-0-130-40 kubenswrapper[2576]: W0707 23:50:20.502433 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5254c118_4fd3_4dc5_acc1_d7fd26f2bef9.slice/crio-7b0a579ece704f1d2b0f6b5891ba2b70534cc4627018bb15b95a1caf3087ba7a WatchSource:0}: Error finding container 7b0a579ece704f1d2b0f6b5891ba2b70534cc4627018bb15b95a1caf3087ba7a: Status 404 returned error can't find the container with id 7b0a579ece704f1d2b0f6b5891ba2b70534cc4627018bb15b95a1caf3087ba7a Jul 07 23:50:20.624066 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.623989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" event={"ID":"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9","Type":"ContainerStarted","Data":"61b76053843f32695694c62fdcf09455e6166cd9b7e6efe0db74cec03d5cf3b9"} Jul 07 23:50:20.624066 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.624050 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" event={"ID":"5254c118-4fd3-4dc5-acc1-d7fd26f2bef9","Type":"ContainerStarted","Data":"7b0a579ece704f1d2b0f6b5891ba2b70534cc4627018bb15b95a1caf3087ba7a"} Jul 07 23:50:20.624222 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.624075 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:20.640165 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:20.640119 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" podStartSLOduration=0.640106426 podStartE2EDuration="640.106426ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 23:50:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 23:50:20.638092802 +0000 UTC m=+2339.859527150" watchObservedRunningTime="2026-07-07 23:50:20.640106426 +0000 UTC m=+2339.861540780" Jul 07 23:50:21.793716 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:21.793684 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6qlq4_17f959f2-af03-410e-b53a-4a2a7a1e970d/dns/0.log" Jul 07 23:50:21.810819 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:21.810790 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6qlq4_17f959f2-af03-410e-b53a-4a2a7a1e970d/kube-rbac-proxy/0.log" Jul 07 23:50:21.906435 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:21.906404 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5zw6t_fbb464bf-fb7f-4337-9e4d-60369b88912a/dns-node-resolver/0.log" Jul 07 23:50:22.482594 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:22.482567 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4nkdt_b24fbe48-6f49-4103-b35a-846f722f2eca/node-ca/0.log" Jul 07 23:50:23.409378 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:23.409346 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ngkwd_1a5641ed-355b-402f-9140-b93c40fc7274/istio-proxy/0.log" Jul 07 23:50:23.532309 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:23.532284 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67dd9c547-fc4rc_86e10322-7624-47e1-86a0-4e86406be7cd/kube-auth-proxy/0.log" Jul 07 23:50:23.583536 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:23.583483 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-226gt_7c5d8d83-571b-434b-9215-1257953433b7/istio-proxy/0.log" Jul 07 23:50:23.612095 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:23.612062 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-226gt_7c5d8d83-571b-434b-9215-1257953433b7/istio-proxy/1.log" Jul 07 23:50:24.373464 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:24.373433 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-66x6d_c2cf53bc-8567-4b09-bb6a-378dbd919666/serve-healthcheck-canary/0.log" Jul 07 23:50:25.118782 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:25.118753 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rmsnx_887a34a3-e940-4e2e-963b-e4f06cd969d2/kube-rbac-proxy/0.log" Jul 07 23:50:25.135770 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:25.135743 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rmsnx_887a34a3-e940-4e2e-963b-e4f06cd969d2/exporter/0.log" Jul 07 23:50:25.156050 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:25.156021 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rmsnx_887a34a3-e940-4e2e-963b-e4f06cd969d2/extractor/0.log" Jul 07 23:50:26.640035 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:26.640003 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6rh9f/perf-node-gather-daemonset-zwjzh" Jul 07 23:50:27.538659 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:27.538623 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-g725l_7108ffb6-2f47-428d-b676-c86d6b61fbbd/manager/0.log" Jul 07 23:50:27.698656 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:27.698627 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-855c64c48d-vkfvk_d1d03444-9971-47d9-9920-a9d8dabb2fb8/manager/0.log" Jul 07 23:50:27.718055 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:27.718034 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-855c64c48d-vkfvk_d1d03444-9971-47d9-9920-a9d8dabb2fb8/copy-manifests/0.log" Jul 07 23:50:28.969795 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:28.969765 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55b8865445-c7jqw_74dc86af-14dd-4eac-8af9-7491505036b6/manager/0.log" Jul 07 23:50:28.989954 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:28.989931 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-mzdk2_c4faa3bd-f0cf-4502-8744-2e55a2061a6d/openshift-lws-operator/0.log" Jul 07 23:50:30.255220 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:30.255189 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ngkwd_1a5641ed-355b-402f-9140-b93c40fc7274/istio-proxy/0.log" Jul 07 23:50:30.357390 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:30.357362 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67dd9c547-fc4rc_86e10322-7624-47e1-86a0-4e86406be7cd/kube-auth-proxy/0.log" Jul 07 23:50:30.391639 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:30.391559 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-226gt_7c5d8d83-571b-434b-9215-1257953433b7/istio-proxy/0.log" Jul 07 23:50:30.418138 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:30.418106 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-226gt_7c5d8d83-571b-434b-9215-1257953433b7/istio-proxy/1.log" Jul 07 23:50:31.720096 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:31.720055 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ngkwd_1a5641ed-355b-402f-9140-b93c40fc7274/istio-proxy/0.log" Jul 07 23:50:31.823497 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:31.823467 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67dd9c547-fc4rc_86e10322-7624-47e1-86a0-4e86406be7cd/kube-auth-proxy/0.log" Jul 07 23:50:31.853931 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:31.853899 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-226gt_7c5d8d83-571b-434b-9215-1257953433b7/istio-proxy/0.log" Jul 07 23:50:31.881993 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:31.881959 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-226gt_7c5d8d83-571b-434b-9215-1257953433b7/istio-proxy/1.log" Jul 07 23:50:34.029391 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:34.029364 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-7nfnc_a5cbd424-dd05-4dd7-b5d7-e308ac5d7b0b/migrator/0.log" Jul 07 23:50:34.048309 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:34.048286 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-7nfnc_a5cbd424-dd05-4dd7-b5d7-e308ac5d7b0b/graceful-termination/0.log" Jul 07 23:50:35.564239 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:35.564215 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvk6j_9583ff81-a722-44f2-8cce-11ad80ef4ca5/kube-multus-additional-cni-plugins/0.log" Jul 07 23:50:35.584095 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:35.584072 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvk6j_9583ff81-a722-44f2-8cce-11ad80ef4ca5/egress-router-binary-copy/0.log" Jul 07 23:50:35.599960 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:35.599935 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvk6j_9583ff81-a722-44f2-8cce-11ad80ef4ca5/cni-plugins/0.log" Jul 07 23:50:35.615742 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:35.615723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvk6j_9583ff81-a722-44f2-8cce-11ad80ef4ca5/bond-cni-plugin/0.log" Jul 07 23:50:35.631910 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:35.631888 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvk6j_9583ff81-a722-44f2-8cce-11ad80ef4ca5/routeoverride-cni/0.log" Jul 07 23:50:35.647362 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:35.647343 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvk6j_9583ff81-a722-44f2-8cce-11ad80ef4ca5/whereabouts-cni-bincopy/0.log" Jul 07 23:50:35.663077 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:35.663057 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvk6j_9583ff81-a722-44f2-8cce-11ad80ef4ca5/whereabouts-cni/0.log" Jul 07 23:50:35.690009 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:35.689980 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n9tht_adbd9ef4-de60-4f88-9401-af3e65c1ba58/kube-multus/0.log" Jul 07 23:50:35.795326 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:35.795291 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q9d2t_e0e9befa-834d-41aa-9c87-b573c269b87f/network-metrics-daemon/0.log" Jul 07 23:50:35.810486 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:35.810459 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q9d2t_e0e9befa-834d-41aa-9c87-b573c269b87f/kube-rbac-proxy/0.log" Jul 07 23:50:36.726491 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:36.726458 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7f2fb_7bf265b5-1ef8-45c0-9c2e-44429614e8f4/ovn-controller/0.log" Jul 07 23:50:36.742226 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:36.742199 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7f2fb_7bf265b5-1ef8-45c0-9c2e-44429614e8f4/ovn-acl-logging/0.log" Jul 07 23:50:36.761142 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:36.761109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7f2fb_7bf265b5-1ef8-45c0-9c2e-44429614e8f4/kube-rbac-proxy-node/0.log" Jul 07 23:50:36.778948 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:36.778922 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7f2fb_7bf265b5-1ef8-45c0-9c2e-44429614e8f4/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 23:50:36.795611 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:36.795589 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7f2fb_7bf265b5-1ef8-45c0-9c2e-44429614e8f4/northd/0.log" Jul 07 23:50:36.813376 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:36.813350 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7f2fb_7bf265b5-1ef8-45c0-9c2e-44429614e8f4/nbdb/0.log" Jul 07 23:50:36.834974 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:36.834952 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7f2fb_7bf265b5-1ef8-45c0-9c2e-44429614e8f4/sbdb/0.log" Jul 07 23:50:36.875654 ip-10-0-130-40 kubenswrapper[2576]: I0707 23:50:36.875628 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7f2fb_7bf265b5-1ef8-45c0-9c2e-44429614e8f4/ovnkube-controller/0.log"