Jul 06 22:23:52.503761 ip-10-0-130-224 systemd[1]: Starting Kubernetes Kubelet... Jul 06 22:23:52.851603 ip-10-0-130-224 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:23:52.851603 ip-10-0-130-224 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 22:23:52.851603 ip-10-0-130-224 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:23:52.851603 ip-10-0-130-224 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 22:23:52.851603 ip-10-0-130-224 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:23:52.853616 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.853539 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 22:23:52.858028 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858014 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:23:52.858028 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858028 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858032 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858035 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858038 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858041 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858043 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858047 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858050 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858053 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858057 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858062 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858067 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858070 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858073 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858083 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858086 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858089 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858091 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858094 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:23:52.858097 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858097 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858099 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858102 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858107 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858111 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858114 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858117 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858119 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858123 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858125 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858128 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858131 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858133 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858136 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858138 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858141 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858143 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858146 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858148 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858150 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:23:52.858569 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858153 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858155 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858157 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858160 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858163 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858165 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858168 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858170 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858172 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858175 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858177 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858180 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858182 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858185 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858188 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858190 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858194 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858196 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858199 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858202 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:23:52.859065 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858204 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858207 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858210 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858212 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858214 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858217 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858219 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858222 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858224 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858228 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858231 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858234 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858236 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858239 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858241 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858244 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858247 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858249 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858252 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858254 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:23:52.859538 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858257 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858259 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858262 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858264 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858266 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858269 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858273 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858275 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858278 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858280 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858283 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858306 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858310 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858314 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858317 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858319 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858322 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858325 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.858328 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:23:52.860032 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859622 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859629 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859632 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859635 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859638 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859641 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859644 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859646 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859649 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859652 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859655 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859657 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859660 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859662 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859665 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859667 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859670 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859673 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859676 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859679 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:23:52.860465 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859681 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859684 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859686 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859689 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859691 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859695 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859699 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859703 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859706 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859708 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859711 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859713 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859716 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859719 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859721 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859724 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859726 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859729 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859731 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:23:52.860991 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859733 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859737 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859739 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859742 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859745 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859747 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859750 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859752 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859755 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859758 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859760 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859763 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859765 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859768 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859771 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859773 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859776 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859778 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859781 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859784 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:23:52.861438 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859786 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859789 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859791 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859794 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859796 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859799 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859801 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859804 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859806 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859809 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859811 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859814 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859817 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859820 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859822 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859825 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859829 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859831 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859835 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859838 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:23:52.861917 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859841 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859844 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859846 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859849 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859851 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859854 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859856 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859860 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859864 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859867 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859872 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859874 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859877 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859879 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859882 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859885 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859887 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859889 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859892 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:23:52.862406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.859895 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860254 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860259 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860261 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860264 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860268 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860271 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860273 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860276 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860279 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860281 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860284 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860287 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860289 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860293 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860297 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860299 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860302 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860305 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:23:52.862886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860307 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860310 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860313 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860315 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860318 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860320 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860323 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860325 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860328 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860331 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860333 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860336 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860338 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860341 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860343 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860346 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860348 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860351 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860353 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860356 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:23:52.863324 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860359 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860362 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860364 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860368 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860370 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860373 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860375 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860378 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860381 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860383 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860386 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860388 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860390 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860393 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860395 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860398 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860401 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860403 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860406 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:23:52.863803 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860408 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860412 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860415 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860417 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860420 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860423 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860427 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860430 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860432 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860435 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860438 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860441 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860444 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860446 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860449 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860452 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860454 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860457 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860460 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:23:52.864246 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860462 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860465 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860467 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860470 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860473 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860476 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860478 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860481 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860496 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860499 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860502 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860504 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860507 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860509 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860511 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860515 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860517 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860520 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860522 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860525 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:23:52.864700 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860528 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860530 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.860533 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860608 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860615 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860620 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860625 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860629 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860632 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860636 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860639 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860643 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860646 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860650 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860653 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860656 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860659 2564 flags.go:64] FLAG: --cgroup-root="" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860662 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860665 2564 flags.go:64] FLAG: --client-ca-file="" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860667 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860670 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860674 2564 flags.go:64] FLAG: --cluster-domain="" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860676 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 22:23:52.865167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860680 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860683 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860686 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860690 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860694 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860698 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860701 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860704 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860707 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860709 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860713 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860715 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860722 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860728 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860731 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860734 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860737 2564 flags.go:64] FLAG: --enable-server="true" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860740 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860744 2564 flags.go:64] FLAG: --event-burst="100" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860747 2564 flags.go:64] FLAG: --event-qps="50" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860751 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860755 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860758 2564 flags.go:64] FLAG: --eviction-hard="" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860761 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 22:23:52.865724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860764 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860767 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860770 2564 flags.go:64] FLAG: --eviction-soft="" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860773 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860775 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860778 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860781 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860784 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860786 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860789 2564 flags.go:64] FLAG: --feature-gates="" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860792 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860795 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860800 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860803 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860805 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860808 2564 flags.go:64] FLAG: --help="false" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860811 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-130-224.ec2.internal" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860814 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860817 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860820 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860823 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860828 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860830 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 22:23:52.866321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860833 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860836 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860838 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860841 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860844 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860847 2564 flags.go:64] FLAG: --kube-reserved="" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860849 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860853 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860855 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860858 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860861 2564 flags.go:64] FLAG: --lock-file="" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860864 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860866 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860869 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860874 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860877 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860879 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860882 2564 flags.go:64] FLAG: --logging-format="text" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860885 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860888 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860891 2564 flags.go:64] FLAG: --manifest-url="" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860898 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860902 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860904 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860908 2564 flags.go:64] FLAG: --max-pods="110" Jul 06 22:23:52.866907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860911 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860914 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860917 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860920 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860923 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860927 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860930 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860937 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860940 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860943 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860946 2564 flags.go:64] FLAG: --pod-cidr="" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860948 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860954 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860956 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860959 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860962 2564 flags.go:64] FLAG: --port="10250" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860965 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860968 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08f640de5f7b0e652" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860971 2564 flags.go:64] FLAG: --qos-reserved="" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860974 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860977 2564 flags.go:64] FLAG: --register-node="true" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860980 2564 flags.go:64] FLAG: --register-with-taints="" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860983 2564 flags.go:64] FLAG: --registry-burst="10" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860986 2564 flags.go:64] FLAG: --registry-qps="5" Jul 06 22:23:52.867516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860989 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860992 2564 flags.go:64] FLAG: --reserved-memory="" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860995 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.860998 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861003 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861006 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861008 2564 flags.go:64] FLAG: --runonce="false" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861011 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861014 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861017 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861019 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861022 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861025 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861028 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861032 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861035 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861037 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861040 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861043 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861046 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861048 2564 flags.go:64] FLAG: --system-cgroups="" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861051 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861056 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861059 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861062 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 22:23:52.868083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861066 2564 flags.go:64] FLAG: --tls-min-version="" Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861068 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861071 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861074 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861076 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861079 2564 flags.go:64] FLAG: --v="2" Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861083 2564 flags.go:64] FLAG: --version="false" Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861086 2564 flags.go:64] FLAG: --vmodule="" Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861089 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.861092 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861199 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861205 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861208 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861212 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861216 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861219 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861222 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861224 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861227 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861229 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861232 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:23:52.868682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861235 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861239 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861243 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861246 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861248 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861251 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861254 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861256 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861259 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861261 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861264 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861267 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861270 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861272 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861275 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861277 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861279 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861282 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861285 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:23:52.869170 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861287 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861290 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861292 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861296 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861299 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861301 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861304 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861306 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861309 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861311 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861314 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861317 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861319 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861323 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861325 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861328 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861330 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861333 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861335 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861338 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:23:52.869659 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861340 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861343 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861346 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861348 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861351 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861354 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861356 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861359 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861361 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861364 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861366 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861369 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861371 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861374 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861376 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861380 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861382 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861385 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861388 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:23:52.870149 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861392 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861395 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861398 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861401 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861404 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861407 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861411 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861413 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861416 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861419 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861421 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861424 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861426 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861429 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861431 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861434 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861437 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861440 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861442 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861445 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:23:52.870614 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861449 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861451 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861454 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861456 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861459 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861461 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861464 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861466 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861470 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.861473 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.862314 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.868668 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.868682 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.868700 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.868706 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 22:23:52.871082 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868759 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868764 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868767 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868770 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868773 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868776 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868779 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868781 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868784 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868787 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868790 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868793 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868796 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868798 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868801 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868803 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868806 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868809 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868811 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868814 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:23:52.871444 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868816 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868819 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868821 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868824 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868827 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868829 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868831 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868834 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868837 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868840 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868843 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868846 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868849 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868851 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868855 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868858 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868860 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868863 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868865 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868868 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:23:52.871916 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868871 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868873 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868876 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868878 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868881 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868883 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868886 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868888 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868890 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868894 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868896 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868899 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868901 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868904 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868906 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868909 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868911 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868914 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868916 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868919 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:23:52.872389 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868922 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868925 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868927 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868932 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868935 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868938 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868941 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868943 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868946 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868949 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868951 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868954 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868958 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868961 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868966 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868968 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868971 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868974 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:23:52.872867 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868977 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868979 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868982 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868984 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868987 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868990 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868992 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868995 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.868998 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869000 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869002 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869005 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869008 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869010 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869013 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869016 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869018 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869021 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869023 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869025 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:23:52.873406 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869028 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.869033 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869136 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869140 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869143 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869146 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869149 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869151 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869154 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869157 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869159 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869162 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869165 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869167 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869170 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:23:52.874031 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869172 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869175 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869178 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869181 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869183 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869186 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869188 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869191 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869194 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869198 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869201 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869203 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869206 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869208 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869211 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869213 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869216 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869218 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869221 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869223 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:23:52.874422 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869226 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869228 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869230 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869233 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869237 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869240 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869243 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869245 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869248 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869251 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869254 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869256 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869259 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869262 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869264 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869267 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869271 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869273 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869276 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869279 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:23:52.874897 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869281 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869284 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869287 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869290 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869293 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869295 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869297 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869300 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869302 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869305 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869307 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869310 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869312 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869315 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869317 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869320 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869322 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869324 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869328 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:23:52.875367 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869332 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869335 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869337 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869340 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869343 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869345 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869348 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869350 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869353 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869356 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869358 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869360 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869363 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869365 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869368 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869370 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869373 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869376 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869378 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869381 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:23:52.875842 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869384 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869386 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869389 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869391 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869394 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869396 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:52.869398 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.869403 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.869512 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.871410 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.872612 2564 server.go:1019] "Starting client certificate rotation" Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.872709 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.872737 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 22:23:52.876326 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.874845 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 22:23:52.879605 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.879580 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 22:23:52.892416 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.892395 2564 log.go:25] "Validated CRI v1 runtime API" Jul 06 22:23:52.894398 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.894382 2564 log.go:25] "Validated CRI v1 image API" Jul 06 22:23:52.895854 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.895837 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 22:23:52.900019 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.899992 2564 fs.go:135] Filesystem UUIDs: map[19c154d0-7a51-44eb-ba01-6ca5d00e4be4:/dev/nvme0n1p3 1f6f7c69-b622-49ac-9ffb-0c3cf00bbfe2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 06 22:23:52.900095 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.900016 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 22:23:52.900180 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.900165 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 22:23:52.904884 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.904771 2564 manager.go:216] Machine: {Timestamp:2026-07-06 22:23:52.903673564 +0000 UTC m=+0.297267368 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2994734 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2df0b7bc32220dc538698b091d2876 SystemUUID:ec2df0b7-bc32-220d-c538-698b091d2876 BootID:e57bce30-7b7d-4391-9f47-48512c5e0c5f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:2d:87:dd:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:2d:87:dd:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:70:7c:6e:e4:10 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 22:23:52.904884 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.904877 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 22:23:52.905006 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.904955 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 22:23:52.907899 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.907877 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 22:23:52.908029 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.907902 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-224.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 22:23:52.909067 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.909057 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 22:23:52.909105 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.909068 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 22:23:52.909105 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.909075 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 22:23:52.909641 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.909631 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 22:23:52.910846 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.910837 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 22:23:52.913607 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.913596 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 06 22:23:52.913730 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.913721 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 22:23:52.913759 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.913750 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 06 22:23:52.913792 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.913761 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 22:23:52.913792 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.913777 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 22:23:52.913792 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.913791 2564 kubelet.go:398] "Adding apiserver pod source" Jul 06 22:23:52.913885 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.913801 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 22:23:52.914167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.914155 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 22:23:52.914258 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.914173 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 22:23:52.916252 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.916236 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 22:23:52.918017 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.918004 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 22:23:52.918056 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.918034 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 22:23:52.919109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919098 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 22:23:52.919157 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919114 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 22:23:52.919157 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919120 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 22:23:52.919157 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919127 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 22:23:52.919157 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919136 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 22:23:52.919157 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919141 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 22:23:52.919157 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919149 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 22:23:52.919157 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919154 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 22:23:52.919341 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919171 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 22:23:52.919341 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919177 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 22:23:52.919341 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919199 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 22:23:52.919341 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919206 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 22:23:52.919341 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919228 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 22:23:52.919341 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.919233 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 22:23:52.922301 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.922289 2564 server.go:1268] "Started kubelet" Jul 06 22:23:52.922435 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.922406 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 22:23:52.922903 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.922723 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 22:23:52.923161 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.923143 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 22:23:52.923231 ip-10-0-130-224 systemd[1]: Started Kubernetes Kubelet. Jul 06 22:23:52.926759 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.926697 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 22:23:52.927278 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.926953 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-224.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 22:23:52.927278 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:52.927257 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 22:23:52.929054 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:52.929026 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 22:23:52.929150 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.929043 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 06 22:23:52.930671 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:52.929010 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-224.ec2.internal.18bfd399521050f3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-224.ec2.internal,UID:ip-10-0-130-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-224.ec2.internal,},FirstTimestamp:2026-07-06 22:23:52.922263795 +0000 UTC m=+0.315857597,LastTimestamp:2026-07-06 22:23:52.922263795 +0000 UTC m=+0.315857597,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-224.ec2.internal,}" Jul 06 22:23:52.930860 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:52.930836 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 22:23:52.931879 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.931862 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 22:23:52.931949 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:52.931937 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:52.932007 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.931958 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 22:23:52.932437 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.932408 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 22:23:52.932437 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.932431 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 22:23:52.932602 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.932412 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 22:23:52.932602 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.932573 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 06 22:23:52.932602 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.932583 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 06 22:23:52.932727 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.932614 2564 factory.go:55] Registering systemd factory Jul 06 22:23:52.932727 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.932629 2564 factory.go:223] Registration of the systemd container factory successfully Jul 06 22:23:52.932877 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.932862 2564 factory.go:153] Registering CRI-O factory Jul 06 22:23:52.932877 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.932877 2564 factory.go:223] Registration of the crio container factory successfully Jul 06 22:23:52.932978 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.932936 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 22:23:52.932978 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.932958 2564 factory.go:103] Registering Raw factory Jul 06 22:23:52.932978 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.932978 2564 manager.go:1196] Started watching for new ooms in manager Jul 06 22:23:52.933380 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.933368 2564 manager.go:349] Starting recovery of all containers Jul 06 22:23:52.933874 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:52.933854 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 22:23:52.933967 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:52.933951 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 22:23:52.941690 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.941668 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zhx6n" Jul 06 22:23:52.942948 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.942931 2564 manager.go:354] Recovery completed Jul 06 22:23:52.947663 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.947651 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:52.949443 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.949427 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zhx6n" Jul 06 22:23:52.949597 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.949578 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:52.949681 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.949616 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:52.949681 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.949632 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:52.950215 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.950202 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 22:23:52.950215 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.950214 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 22:23:52.950321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.950228 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 06 22:23:52.950321 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.950206 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:52.950943 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.950925 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:52.951041 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.950952 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:52.951041 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.950961 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:52.951345 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.951334 2564 policy_none.go:49] "None policy: Start" Jul 06 22:23:52.951423 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.951349 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 22:23:52.951423 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.951360 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 22:23:52.952376 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.952357 2564 policy_none.go:47] "Start" Jul 06 22:23:52.989035 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.989021 2564 manager.go:337] "Starting Device Plugin manager" Jul 06 22:23:52.989109 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:52.989052 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 22:23:52.989109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.989061 2564 server.go:87] "Starting device plugin registration server" Jul 06 22:23:52.989304 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.989287 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 22:23:52.989391 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.989302 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 22:23:52.989435 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.989404 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 22:23:52.989525 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.989507 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 22:23:52.989525 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:52.989522 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 22:23:52.989985 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:52.989964 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 22:23:52.990063 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:52.990019 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:53.035252 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.035226 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 22:23:53.043464 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.036450 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 22:23:53.043464 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.036482 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 22:23:53.043464 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.036525 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 22:23:53.043464 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.036564 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 22:23:53.043464 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.038757 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:23:53.089555 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.089538 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:53.090294 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.090282 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:53.090341 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.090309 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:53.090341 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.090325 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:53.090399 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.090353 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.099329 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.099313 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.099377 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.099332 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-224.ec2.internal\": node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:53.126145 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.126102 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:53.137614 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.137597 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal"] Jul 06 22:23:53.137665 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.137650 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:53.138352 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.138338 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:53.138416 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.138363 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:53.138416 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.138372 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:53.140558 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.140545 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:53.140659 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.140646 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.140706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.140674 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:53.141225 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.141210 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:53.141290 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.141228 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:53.141290 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.141240 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:53.141290 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.141249 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:53.141290 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.141253 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:53.141290 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.141259 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:53.143391 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.143377 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.143456 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.143401 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:53.144092 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.144076 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:53.144160 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.144107 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:53.144160 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.144122 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:53.169124 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.169105 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-224.ec2.internal\" not found" node="ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.172572 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.172555 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-224.ec2.internal\" not found" node="ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.226967 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.226938 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:53.233911 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.233885 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/383433ceaa79369db179e04de0564c0f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal\" (UID: \"383433ceaa79369db179e04de0564c0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.234015 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.233916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/383433ceaa79369db179e04de0564c0f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal\" (UID: \"383433ceaa79369db179e04de0564c0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.234015 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.233935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7a0286b78fb561648d6188aef1e798d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-224.ec2.internal\" (UID: \"d7a0286b78fb561648d6188aef1e798d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.332876 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.332811 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:53.334089 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.334065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/383433ceaa79369db179e04de0564c0f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal\" (UID: \"383433ceaa79369db179e04de0564c0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.334159 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.334101 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/383433ceaa79369db179e04de0564c0f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal\" (UID: \"383433ceaa79369db179e04de0564c0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.334159 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.334123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7a0286b78fb561648d6188aef1e798d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-224.ec2.internal\" (UID: \"d7a0286b78fb561648d6188aef1e798d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.334265 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.334168 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7a0286b78fb561648d6188aef1e798d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-224.ec2.internal\" (UID: \"d7a0286b78fb561648d6188aef1e798d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.334265 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.334193 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/383433ceaa79369db179e04de0564c0f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal\" (UID: \"383433ceaa79369db179e04de0564c0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.334265 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.334198 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/383433ceaa79369db179e04de0564c0f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal\" (UID: \"383433ceaa79369db179e04de0564c0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.433060 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.432976 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:53.475448 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.475428 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.475448 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.475429 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" Jul 06 22:23:53.534186 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.534020 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:53.635410 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.635363 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:53.736203 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.736125 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:53.821161 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.821129 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:23:53.836795 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.836754 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:53.872573 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.872550 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 22:23:53.872982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.872674 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 22:23:53.872982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.872697 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 22:23:53.937449 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:53.937421 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:53.951332 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.951298 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 22:18:53 +0000 UTC" deadline="2027-12-03 23:08:05.949136815 +0000 UTC" Jul 06 22:23:53.951332 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:53.951327 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12360h44m11.99781289s" Jul 06 22:23:54.038383 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:54.038309 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found" Jul 06 22:23:54.119503 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.119466 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:23:54.132633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.132612 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" Jul 06 22:23:54.146995 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.146977 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 22:23:54.147701 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.147687 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:23:54.147880 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.147867 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal" Jul 06 22:23:54.156648 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.156631 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 22:23:54.176521 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:54.176492 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383433ceaa79369db179e04de0564c0f.slice/crio-f54d2e764cb3cbe460bac171963dea5ce56c59f4044b620b4737373c973741d4 WatchSource:0}: Error finding container f54d2e764cb3cbe460bac171963dea5ce56c59f4044b620b4737373c973741d4: Status 404 returned error can't find the container with id f54d2e764cb3cbe460bac171963dea5ce56c59f4044b620b4737373c973741d4 Jul 06 22:23:54.176886 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:54.176869 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a0286b78fb561648d6188aef1e798d.slice/crio-70cefb605b415c935159e2b968320514ce7a68f324e8f97ea2d561d71bb81116 WatchSource:0}: Error finding container 70cefb605b415c935159e2b968320514ce7a68f324e8f97ea2d561d71bb81116: Status 404 returned error can't find the container with id 70cefb605b415c935159e2b968320514ce7a68f324e8f97ea2d561d71bb81116 Jul 06 22:23:54.183409 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.183385 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:23:54.914683 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.914377 2564 apiserver.go:52] "Watching apiserver" Jul 06 22:23:54.924166 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.924137 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 22:23:54.926316 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.926104 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-fvftx","openshift-network-diagnostics/network-check-target-wwz95","kube-system/global-pull-secret-syncer-nfsqr","openshift-cluster-node-tuning-operator/tuned-f556g","openshift-image-registry/node-ca-xrgz2","openshift-multus/multus-additional-cni-plugins-gw9t5","openshift-multus/network-metrics-daemon-rl2l6","openshift-network-operator/iptables-alerter-fprcg","openshift-ovn-kubernetes/ovnkube-node-x264m","kube-system/konnectivity-agent-xsxb4","kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc","openshift-dns/node-resolver-lvssm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal"] Jul 06 22:23:54.929016 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.928991 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:54.932578 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.931338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lvssm" Jul 06 22:23:54.933635 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.932775 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 22:23:54.935402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.934397 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.935402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.934540 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 22:23:54.935402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.934800 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 22:23:54.935402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.934896 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 22:23:54.935402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.935020 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.935402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.935051 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.935402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.934894 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.935402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.935261 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m2klg\"" Jul 06 22:23:54.935402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.935272 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.935402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.935371 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cbd6w\"" Jul 06 22:23:54.936680 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.936658 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fvftx" Jul 06 22:23:54.938447 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.937358 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.938447 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.937408 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-52nh2\"" Jul 06 22:23:54.938447 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.938088 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.938798 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.938509 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 22:23:54.938871 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.938851 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 22:23:54.938976 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.938959 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 22:23:54.939048 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.939041 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 22:23:54.939294 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.939276 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 22:23:54.939653 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.939483 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rhmpk\"" Jul 06 22:23:54.940986 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.940465 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:23:54.940986 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:54.940585 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.942967 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-system-cni-dir\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943056 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-slash\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-run-netns\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nzps\" (UniqueName: \"kubernetes.io/projected/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-kube-api-access-2nzps\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943177 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxjdj\" (UniqueName: \"kubernetes.io/projected/f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05-kube-api-access-hxjdj\") pod \"node-resolver-lvssm\" (UID: \"f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05\") " pod="openshift-dns/node-resolver-lvssm" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-var-lib-openvswitch\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-cnibin\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-etc-openvswitch\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-log-socket\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-run-ovn-kubernetes\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943321 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-cni-bin\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-env-overrides\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.944780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943376 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-ovnkube-script-lib\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943418 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05-hosts-file\") pod \"node-resolver-lvssm\" (UID: \"f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05\") " pod="openshift-dns/node-resolver-lvssm" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943445 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-kubelet\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943469 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-run-ovn\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-node-log\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-cni-netd\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-ovnkube-config\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943624 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xqlj\" (UniqueName: \"kubernetes.io/projected/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-kube-api-access-8xqlj\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-run-openvswitch\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943693 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-ovn-node-metrics-cert\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-os-release\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05-tmp-dir\") pod \"node-resolver-lvssm\" (UID: \"f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05\") " pod="openshift-dns/node-resolver-lvssm" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-systemd-units\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.943825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-run-systemd\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.944166 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xrgz2" Jul 06 22:23:54.945633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.944629 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 22:23:54.947513 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.947089 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:54.949235 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.949217 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fprcg" Jul 06 22:23:54.949649 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.949630 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.950155 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.950132 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 22:23:54.950716 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.950690 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.950826 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.950804 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j7dvx\"" Jul 06 22:23:54.950883 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.950854 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.950968 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.950920 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kdvfk\"" Jul 06 22:23:54.951065 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.951048 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.951886 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.951786 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:54.951886 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:54.951846 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:23:54.955718 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.955227 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xsxb4" Jul 06 22:23:54.957227 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.957196 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.958460 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.957862 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:54.958957 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.958912 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 22:23:54.961478 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.961387 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:23:54.961478 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:54.961447 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:23:54.964978 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.964243 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ghpb2\"" Jul 06 22:23:54.964978 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.964417 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 22:23:54.964978 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.964467 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 22:23:54.964978 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.964686 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.964978 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.964757 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h7vc2\"" Jul 06 22:23:54.964978 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.964779 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.964978 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.964921 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rbsjk\"" Jul 06 22:23:54.965377 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.965174 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.965432 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:54.965421 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 22:23:55.004924 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.004900 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bpxwb" Jul 06 22:23:55.014676 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.014652 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bpxwb" Jul 06 22:23:55.034386 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.034298 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 22:23:55.042331 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.042280 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" event={"ID":"383433ceaa79369db179e04de0564c0f","Type":"ContainerStarted","Data":"f54d2e764cb3cbe460bac171963dea5ce56c59f4044b620b4737373c973741d4"} Jul 06 22:23:55.043897 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.043870 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal" event={"ID":"d7a0286b78fb561648d6188aef1e798d","Type":"ContainerStarted","Data":"70cefb605b415c935159e2b968320514ce7a68f324e8f97ea2d561d71bb81116"} Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-run-multus-certs\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044381 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scqjd\" (UniqueName: \"kubernetes.io/projected/f763ccf3-1087-434c-84de-0648fbe787aa-kube-api-access-scqjd\") pod \"iptables-alerter-fprcg\" (UID: \"f763ccf3-1087-434c-84de-0648fbe787aa\") " pod="openshift-network-operator/iptables-alerter-fprcg" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044413 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044438 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-kubernetes\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-systemd\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07d32136-31d7-4613-bef2-2d540719426b-kubelet-config\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-ovnkube-config\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xqlj\" (UniqueName: \"kubernetes.io/projected/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-kube-api-access-8xqlj\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m8x2\" (UniqueName: \"kubernetes.io/projected/84e85955-5b73-4405-b97a-0d5e3f1544bd-kube-api-access-5m8x2\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-sysctl-d\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044662 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-os-release\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-multus-conf-dir\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f763ccf3-1087-434c-84de-0648fbe787aa-iptables-alerter-script\") pod \"iptables-alerter-fprcg\" (UID: \"f763ccf3-1087-434c-84de-0648fbe787aa\") " pod="openshift-network-operator/iptables-alerter-fprcg" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-device-dir\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.045852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044801 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84e85955-5b73-4405-b97a-0d5e3f1544bd-cni-binary-copy\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044828 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-run-k8s-cni-cncf-io\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044853 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-var-lib-cni-bin\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-sys\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-registration-dir\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-slash\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.044953 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-run-netns\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045034 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-slash\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045066 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-os-release\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045080 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-run-netns\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/73daa614-7bd3-4e51-850f-600b4163b572-etc-tuned\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-var-lib-openvswitch\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045219 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-ovnkube-config\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-cnibin\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-log-socket\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-cni-bin\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.046706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045349 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-hostroot\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045409 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc96l\" (UniqueName: \"kubernetes.io/projected/8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8-kube-api-access-kc96l\") pod \"node-ca-xrgz2\" (UID: \"8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8\") " pod="openshift-image-registry/node-ca-xrgz2" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045413 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045434 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0939ff7-a0de-41ba-a2e0-4a5961c4fb99-agent-certs\") pod \"konnectivity-agent-xsxb4\" (UID: \"e0939ff7-a0de-41ba-a2e0-4a5961c4fb99\") " pod="kube-system/konnectivity-agent-xsxb4" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-run-ovn\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-node-log\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-var-lib-openvswitch\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-system-cni-dir\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045625 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-run\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045626 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-cni-bin\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045654 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045678 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-node-log\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045686 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-cnibin\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045723 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-log-socket\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-lib-modules\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045749 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-run-ovn\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-var-lib-kubelet\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.047669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045845 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07d32136-31d7-4613-bef2-2d540719426b-dbus\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045884 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-cni-netd\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8-host\") pod \"node-ca-xrgz2\" (UID: \"8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8\") " pod="openshift-image-registry/node-ca-xrgz2" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045972 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-cni-netd\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.045983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f763ccf3-1087-434c-84de-0648fbe787aa-host-slash\") pod \"iptables-alerter-fprcg\" (UID: \"f763ccf3-1087-434c-84de-0648fbe787aa\") " pod="openshift-network-operator/iptables-alerter-fprcg" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046095 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73daa614-7bd3-4e51-850f-600b4163b572-tmp\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6zgb\" (UniqueName: \"kubernetes.io/projected/73daa614-7bd3-4e51-850f-600b4163b572-kube-api-access-z6zgb\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046168 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-etc-selinux\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-run-openvswitch\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046306 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-ovn-node-metrics-cert\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05-tmp-dir\") pod \"node-resolver-lvssm\" (UID: \"f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05\") " pod="openshift-dns/node-resolver-lvssm" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-run-netns\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-etc-kubernetes\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8-serviceca\") pod \"node-ca-xrgz2\" (UID: \"8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8\") " pod="openshift-image-registry/node-ca-xrgz2" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-systemd-units\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.048477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046467 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-run-systemd\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-cnibin\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046628 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-run-systemd\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046649 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-run-openvswitch\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84e85955-5b73-4405-b97a-0d5e3f1544bd-multus-daemon-config\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046705 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-systemd-units\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046742 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-sys-fs\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046748 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7zv9\" (UniqueName: \"kubernetes.io/projected/86eeedf5-af61-4fb1-956a-c2c9892b850d-kube-api-access-k7zv9\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-system-cni-dir\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046860 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-system-cni-dir\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-multus-cni-dir\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-os-release\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046957 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whvv6\" (UniqueName: \"kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6\") pod \"network-check-target-wwz95\" (UID: \"5b90408c-e7fb-40a2-91cd-a2ed3c77d218\") " pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:23:55.049317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046949 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.046987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-socket-dir\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047039 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-var-lib-cni-multus\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nzps\" (UniqueName: \"kubernetes.io/projected/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-kube-api-access-2nzps\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047071 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05-tmp-dir\") pod \"node-resolver-lvssm\" (UID: \"f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05\") " pod="openshift-dns/node-resolver-lvssm" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxjdj\" (UniqueName: \"kubernetes.io/projected/f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05-kube-api-access-hxjdj\") pod \"node-resolver-lvssm\" (UID: \"f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05\") " pod="openshift-dns/node-resolver-lvssm" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047130 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-sysconfig\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047350 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047364 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-var-lib-kubelet\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0939ff7-a0de-41ba-a2e0-4a5961c4fb99-konnectivity-ca\") pod \"konnectivity-agent-xsxb4\" (UID: \"e0939ff7-a0de-41ba-a2e0-4a5961c4fb99\") " pod="kube-system/konnectivity-agent-xsxb4" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047466 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdhx7\" (UniqueName: \"kubernetes.io/projected/b3559859-d52e-4234-8521-b7d88e588f97-kube-api-access-rdhx7\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047516 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-etc-openvswitch\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-run-ovn-kubernetes\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-env-overrides\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047610 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-etc-openvswitch\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-ovnkube-script-lib\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.050109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047641 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05-hosts-file\") pod \"node-resolver-lvssm\" (UID: \"f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05\") " pod="openshift-dns/node-resolver-lvssm" Jul 06 22:23:55.050982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047650 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-run-ovn-kubernetes\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.050982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047688 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-modprobe-d\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.050982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047717 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-sysctl-conf\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.050982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047742 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-host\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.050982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-kubelet\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.050982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047814 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-multus-socket-dir-parent\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.050982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.047919 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05-hosts-file\") pod \"node-resolver-lvssm\" (UID: \"f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05\") " pod="openshift-dns/node-resolver-lvssm" Jul 06 22:23:55.050982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.048173 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-host-kubelet\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.050982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.048227 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-ovnkube-script-lib\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.050982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.048317 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-env-overrides\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.055400 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.053705 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-ovn-node-metrics-cert\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.055552 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.055486 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xqlj\" (UniqueName: \"kubernetes.io/projected/f68bc160-fd3d-40f8-98d1-f05505d4c7ef-kube-api-access-8xqlj\") pod \"multus-additional-cni-plugins-gw9t5\" (UID: \"f68bc160-fd3d-40f8-98d1-f05505d4c7ef\") " pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.057757 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.057733 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nzps\" (UniqueName: \"kubernetes.io/projected/2b989f2d-90f8-4c31-b5c8-48815d1bd60a-kube-api-access-2nzps\") pod \"ovnkube-node-x264m\" (UID: \"2b989f2d-90f8-4c31-b5c8-48815d1bd60a\") " pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.059331 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.059308 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxjdj\" (UniqueName: \"kubernetes.io/projected/f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05-kube-api-access-hxjdj\") pod \"node-resolver-lvssm\" (UID: \"f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05\") " pod="openshift-dns/node-resolver-lvssm" Jul 06 22:23:55.148721 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.148684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0939ff7-a0de-41ba-a2e0-4a5961c4fb99-konnectivity-ca\") pod \"konnectivity-agent-xsxb4\" (UID: \"e0939ff7-a0de-41ba-a2e0-4a5961c4fb99\") " pod="kube-system/konnectivity-agent-xsxb4" Jul 06 22:23:55.148922 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.148732 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdhx7\" (UniqueName: \"kubernetes.io/projected/b3559859-d52e-4234-8521-b7d88e588f97-kube-api-access-rdhx7\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:23:55.148922 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.148767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-modprobe-d\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.148922 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.148791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-sysctl-conf\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.148922 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.148807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-host\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.148922 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.148833 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-multus-socket-dir-parent\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.148922 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.148848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-run-multus-certs\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.148922 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.148888 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scqjd\" (UniqueName: \"kubernetes.io/projected/f763ccf3-1087-434c-84de-0648fbe787aa-kube-api-access-scqjd\") pod \"iptables-alerter-fprcg\" (UID: \"f763ccf3-1087-434c-84de-0648fbe787aa\") " pod="openshift-network-operator/iptables-alerter-fprcg" Jul 06 22:23:55.148922 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.148918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.148934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-kubernetes\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.148948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-systemd\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.148942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-modprobe-d\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149001 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-systemd\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149028 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-run-multus-certs\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149035 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-host\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149118 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-kubernetes\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.149141 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149170 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-sysctl-conf\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.149234 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs podName:b3559859-d52e-4234-8521-b7d88e588f97 nodeName:}" failed. No retries permitted until 2026-07-06 22:23:55.649209116 +0000 UTC m=+3.042802924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs") pod "network-metrics-daemon-rl2l6" (UID: "b3559859-d52e-4234-8521-b7d88e588f97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149250 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-multus-socket-dir-parent\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149268 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07d32136-31d7-4613-bef2-2d540719426b-kubelet-config\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8x2\" (UniqueName: \"kubernetes.io/projected/84e85955-5b73-4405-b97a-0d5e3f1544bd-kube-api-access-5m8x2\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149309 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07d32136-31d7-4613-bef2-2d540719426b-kubelet-config\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:55.149344 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-sysctl-d\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149359 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-multus-conf-dir\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f763ccf3-1087-434c-84de-0648fbe787aa-iptables-alerter-script\") pod \"iptables-alerter-fprcg\" (UID: \"f763ccf3-1087-434c-84de-0648fbe787aa\") " pod="openshift-network-operator/iptables-alerter-fprcg" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-device-dir\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149436 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-multus-conf-dir\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84e85955-5b73-4405-b97a-0d5e3f1544bd-cni-binary-copy\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-run-k8s-cni-cncf-io\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-var-lib-cni-bin\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149681 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-sysctl-d\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149681 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0939ff7-a0de-41ba-a2e0-4a5961c4fb99-konnectivity-ca\") pod \"konnectivity-agent-xsxb4\" (UID: \"e0939ff7-a0de-41ba-a2e0-4a5961c4fb99\") " pod="kube-system/konnectivity-agent-xsxb4" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149717 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-sys\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149717 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-run-k8s-cni-cncf-io\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-registration-dir\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149801 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-var-lib-cni-bin\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/73daa614-7bd3-4e51-850f-600b4163b572-etc-tuned\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149847 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-sys\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149836 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-registration-dir\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149957 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-device-dir\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.150100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.149993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-hostroot\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc96l\" (UniqueName: \"kubernetes.io/projected/8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8-kube-api-access-kc96l\") pod \"node-ca-xrgz2\" (UID: \"8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8\") " pod="openshift-image-registry/node-ca-xrgz2" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150087 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-hostroot\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0939ff7-a0de-41ba-a2e0-4a5961c4fb99-agent-certs\") pod \"konnectivity-agent-xsxb4\" (UID: \"e0939ff7-a0de-41ba-a2e0-4a5961c4fb99\") " pod="kube-system/konnectivity-agent-xsxb4" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150183 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84e85955-5b73-4405-b97a-0d5e3f1544bd-cni-binary-copy\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-system-cni-dir\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-run\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150357 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-system-cni-dir\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150362 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f763ccf3-1087-434c-84de-0648fbe787aa-iptables-alerter-script\") pod \"iptables-alerter-fprcg\" (UID: \"f763ccf3-1087-434c-84de-0648fbe787aa\") " pod="openshift-network-operator/iptables-alerter-fprcg" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150381 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-lib-modules\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150413 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-run\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-var-lib-kubelet\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150448 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07d32136-31d7-4613-bef2-2d540719426b-dbus\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8-host\") pod \"node-ca-xrgz2\" (UID: \"8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8\") " pod="openshift-image-registry/node-ca-xrgz2" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150519 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-lib-modules\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f763ccf3-1087-434c-84de-0648fbe787aa-host-slash\") pod \"iptables-alerter-fprcg\" (UID: \"f763ccf3-1087-434c-84de-0648fbe787aa\") " pod="openshift-network-operator/iptables-alerter-fprcg" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150549 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-var-lib-kubelet\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73daa614-7bd3-4e51-850f-600b4163b572-tmp\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.151009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150584 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8-host\") pod \"node-ca-xrgz2\" (UID: \"8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8\") " pod="openshift-image-registry/node-ca-xrgz2" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150600 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6zgb\" (UniqueName: \"kubernetes.io/projected/73daa614-7bd3-4e51-850f-600b4163b572-kube-api-access-z6zgb\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-etc-selinux\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-run-netns\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150682 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07d32136-31d7-4613-bef2-2d540719426b-dbus\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-etc-kubernetes\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8-serviceca\") pod \"node-ca-xrgz2\" (UID: \"8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8\") " pod="openshift-image-registry/node-ca-xrgz2" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150738 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-run-netns\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150760 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-etc-selinux\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150788 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-etc-kubernetes\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150601 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f763ccf3-1087-434c-84de-0648fbe787aa-host-slash\") pod \"iptables-alerter-fprcg\" (UID: \"f763ccf3-1087-434c-84de-0648fbe787aa\") " pod="openshift-network-operator/iptables-alerter-fprcg" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-cnibin\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84e85955-5b73-4405-b97a-0d5e3f1544bd-multus-daemon-config\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150884 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-cnibin\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.151704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.150936 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:55.152143 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.151953 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84e85955-5b73-4405-b97a-0d5e3f1544bd-multus-daemon-config\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.152143 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-sys-fs\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.152143 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7zv9\" (UniqueName: \"kubernetes.io/projected/86eeedf5-af61-4fb1-956a-c2c9892b850d-kube-api-access-k7zv9\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.152253 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-multus-cni-dir\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.152253 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152161 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-sys-fs\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.152253 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-os-release\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.152351 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvv6\" (UniqueName: \"kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6\") pod \"network-check-target-wwz95\" (UID: \"5b90408c-e7fb-40a2-91cd-a2ed3c77d218\") " pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:23:55.152351 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.152351 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-socket-dir\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.152443 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-var-lib-cni-multus\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.152443 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-sysconfig\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.152545 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-var-lib-kubelet\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.152604 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152546 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-var-lib-kubelet\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.153018 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152631 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.153018 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.152824 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:55.153018 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152919 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-host-var-lib-cni-multus\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.153018 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.152934 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86eeedf5-af61-4fb1-956a-c2c9892b850d-socket-dir\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.153018 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.152971 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret podName:07d32136-31d7-4613-bef2-2d540719426b nodeName:}" failed. No retries permitted until 2026-07-06 22:23:55.652903439 +0000 UTC m=+3.046497245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret") pod "global-pull-secret-syncer-nfsqr" (UID: "07d32136-31d7-4613-bef2-2d540719426b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:55.153018 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.153003 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-multus-cni-dir\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.153395 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.153064 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84e85955-5b73-4405-b97a-0d5e3f1544bd-os-release\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.153395 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.153310 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/73daa614-7bd3-4e51-850f-600b4163b572-etc-sysconfig\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.156118 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.156033 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8-serviceca\") pod \"node-ca-xrgz2\" (UID: \"8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8\") " pod="openshift-image-registry/node-ca-xrgz2" Jul 06 22:23:55.156869 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.156740 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0939ff7-a0de-41ba-a2e0-4a5961c4fb99-agent-certs\") pod \"konnectivity-agent-xsxb4\" (UID: \"e0939ff7-a0de-41ba-a2e0-4a5961c4fb99\") " pod="kube-system/konnectivity-agent-xsxb4" Jul 06 22:23:55.157946 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.157922 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/73daa614-7bd3-4e51-850f-600b4163b572-etc-tuned\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.158412 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.158362 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73daa614-7bd3-4e51-850f-600b4163b572-tmp\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.161851 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.161761 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scqjd\" (UniqueName: \"kubernetes.io/projected/f763ccf3-1087-434c-84de-0648fbe787aa-kube-api-access-scqjd\") pod \"iptables-alerter-fprcg\" (UID: \"f763ccf3-1087-434c-84de-0648fbe787aa\") " pod="openshift-network-operator/iptables-alerter-fprcg" Jul 06 22:23:55.161851 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.161834 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdhx7\" (UniqueName: \"kubernetes.io/projected/b3559859-d52e-4234-8521-b7d88e588f97-kube-api-access-rdhx7\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:23:55.162012 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.161996 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:23:55.162074 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.162021 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:23:55.162074 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.162036 2564 projected.go:196] Error preparing data for projected volume kube-api-access-whvv6 for pod openshift-network-diagnostics/network-check-target-wwz95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:55.162189 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.162108 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6 podName:5b90408c-e7fb-40a2-91cd-a2ed3c77d218 nodeName:}" failed. No retries permitted until 2026-07-06 22:23:55.66208954 +0000 UTC m=+3.055683347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-whvv6" (UniqueName: "kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6") pod "network-check-target-wwz95" (UID: "5b90408c-e7fb-40a2-91cd-a2ed3c77d218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:55.163892 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.163866 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m8x2\" (UniqueName: \"kubernetes.io/projected/84e85955-5b73-4405-b97a-0d5e3f1544bd-kube-api-access-5m8x2\") pod \"multus-fvftx\" (UID: \"84e85955-5b73-4405-b97a-0d5e3f1544bd\") " pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.164123 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.164102 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6zgb\" (UniqueName: \"kubernetes.io/projected/73daa614-7bd3-4e51-850f-600b4163b572-kube-api-access-z6zgb\") pod \"tuned-f556g\" (UID: \"73daa614-7bd3-4e51-850f-600b4163b572\") " pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.164974 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.164883 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7zv9\" (UniqueName: \"kubernetes.io/projected/86eeedf5-af61-4fb1-956a-c2c9892b850d-kube-api-access-k7zv9\") pod \"aws-ebs-csi-driver-node-znxjc\" (UID: \"86eeedf5-af61-4fb1-956a-c2c9892b850d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.165497 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.165450 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc96l\" (UniqueName: \"kubernetes.io/projected/8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8-kube-api-access-kc96l\") pod \"node-ca-xrgz2\" (UID: \"8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8\") " pod="openshift-image-registry/node-ca-xrgz2" Jul 06 22:23:55.248062 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.248027 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gw9t5" Jul 06 22:23:55.255763 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.255576 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lvssm" Jul 06 22:23:55.264198 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:55.263362 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf68bc160_fd3d_40f8_98d1_f05505d4c7ef.slice/crio-008656f2969f7221f821de9513638d748050fc5e1424a523d3050b5ccf3b5974 WatchSource:0}: Error finding container 008656f2969f7221f821de9513638d748050fc5e1424a523d3050b5ccf3b5974: Status 404 returned error can't find the container with id 008656f2969f7221f821de9513638d748050fc5e1424a523d3050b5ccf3b5974 Jul 06 22:23:55.264370 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.264278 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:23:55.267179 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:55.267154 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b1dbbd_9d6a_4745_a6c7_3bb0da589a05.slice/crio-0353ff9ba21ad204f3545da6d9a4e5af3f5c4370fa7158c60cd6ce79e0f488cb WatchSource:0}: Error finding container 0353ff9ba21ad204f3545da6d9a4e5af3f5c4370fa7158c60cd6ce79e0f488cb: Status 404 returned error can't find the container with id 0353ff9ba21ad204f3545da6d9a4e5af3f5c4370fa7158c60cd6ce79e0f488cb Jul 06 22:23:55.268454 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.268435 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:23:55.274940 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.274892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fvftx" Jul 06 22:23:55.284262 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:55.284231 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b989f2d_90f8_4c31_b5c8_48815d1bd60a.slice/crio-c37232e7a46abed828a7f6e12362cc7af9ed3b8cecc5c6e79f3e5d4d3a06d97a WatchSource:0}: Error finding container c37232e7a46abed828a7f6e12362cc7af9ed3b8cecc5c6e79f3e5d4d3a06d97a: Status 404 returned error can't find the container with id c37232e7a46abed828a7f6e12362cc7af9ed3b8cecc5c6e79f3e5d4d3a06d97a Jul 06 22:23:55.285500 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.285433 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xrgz2" Jul 06 22:23:55.289132 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:55.289104 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e85955_5b73_4405_b97a_0d5e3f1544bd.slice/crio-b8ce075d8ef12b6dc7f067baeb6ef292a647e219b48aa0f6647b7ab34eabea69 WatchSource:0}: Error finding container b8ce075d8ef12b6dc7f067baeb6ef292a647e219b48aa0f6647b7ab34eabea69: Status 404 returned error can't find the container with id b8ce075d8ef12b6dc7f067baeb6ef292a647e219b48aa0f6647b7ab34eabea69 Jul 06 22:23:55.295088 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.295065 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f556g" Jul 06 22:23:55.300546 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:55.300406 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d87f6ba_b8cc_4b54_8aa8_dd695ae097a8.slice/crio-bea7fec50bbe70c154c934ff47926761835dccfb8e0610278267617fc0b22536 WatchSource:0}: Error finding container bea7fec50bbe70c154c934ff47926761835dccfb8e0610278267617fc0b22536: Status 404 returned error can't find the container with id bea7fec50bbe70c154c934ff47926761835dccfb8e0610278267617fc0b22536 Jul 06 22:23:55.305057 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.303697 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fprcg" Jul 06 22:23:55.307373 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:55.307348 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73daa614_7bd3_4e51_850f_600b4163b572.slice/crio-68b30101948306f8c5e93a4a30bcc5080cf0c88e503c2296887e8dacb2de494d WatchSource:0}: Error finding container 68b30101948306f8c5e93a4a30bcc5080cf0c88e503c2296887e8dacb2de494d: Status 404 returned error can't find the container with id 68b30101948306f8c5e93a4a30bcc5080cf0c88e503c2296887e8dacb2de494d Jul 06 22:23:55.316010 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:55.315978 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf763ccf3_1087_434c_84de_0648fbe787aa.slice/crio-e890d7601acf8ea19e82194712fc19e4cefbeada4d0042dbf1dc9d49bee91eb6 WatchSource:0}: Error finding container e890d7601acf8ea19e82194712fc19e4cefbeada4d0042dbf1dc9d49bee91eb6: Status 404 returned error can't find the container with id e890d7601acf8ea19e82194712fc19e4cefbeada4d0042dbf1dc9d49bee91eb6 Jul 06 22:23:55.319778 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.319737 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xsxb4" Jul 06 22:23:55.327015 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.326995 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" Jul 06 22:23:55.656070 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.655983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:55.656070 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.656057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:23:55.656280 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.656177 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:55.656280 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.656251 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret podName:07d32136-31d7-4613-bef2-2d540719426b nodeName:}" failed. No retries permitted until 2026-07-06 22:23:56.656234934 +0000 UTC m=+4.049828749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret") pod "global-pull-secret-syncer-nfsqr" (UID: "07d32136-31d7-4613-bef2-2d540719426b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:55.656386 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.656177 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:55.656386 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.656324 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs podName:b3559859-d52e-4234-8521-b7d88e588f97 nodeName:}" failed. No retries permitted until 2026-07-06 22:23:56.656309098 +0000 UTC m=+4.049902910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs") pod "network-metrics-daemon-rl2l6" (UID: "b3559859-d52e-4234-8521-b7d88e588f97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:55.756855 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:55.756816 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvv6\" (UniqueName: \"kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6\") pod \"network-check-target-wwz95\" (UID: \"5b90408c-e7fb-40a2-91cd-a2ed3c77d218\") " pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:23:55.757020 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.756991 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:23:55.757020 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.757014 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:23:55.757147 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.757028 2564 projected.go:196] Error preparing data for projected volume kube-api-access-whvv6 for pod openshift-network-diagnostics/network-check-target-wwz95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:55.757147 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:55.757098 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6 podName:5b90408c-e7fb-40a2-91cd-a2ed3c77d218 nodeName:}" failed. No retries permitted until 2026-07-06 22:23:56.757078396 +0000 UTC m=+4.150672190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-whvv6" (UniqueName: "kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6") pod "network-check-target-wwz95" (UID: "5b90408c-e7fb-40a2-91cd-a2ed3c77d218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:56.018576 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.018491 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:18:55 +0000 UTC" deadline="2027-12-10 05:31:59.245481768 +0000 UTC" Jul 06 22:23:56.018576 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.018529 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12511h8m3.226957616s" Jul 06 22:23:56.046790 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.046750 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fprcg" event={"ID":"f763ccf3-1087-434c-84de-0648fbe787aa","Type":"ContainerStarted","Data":"e890d7601acf8ea19e82194712fc19e4cefbeada4d0042dbf1dc9d49bee91eb6"} Jul 06 22:23:56.048173 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.048125 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f556g" event={"ID":"73daa614-7bd3-4e51-850f-600b4163b572","Type":"ContainerStarted","Data":"68b30101948306f8c5e93a4a30bcc5080cf0c88e503c2296887e8dacb2de494d"} Jul 06 22:23:56.049559 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.049533 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" event={"ID":"2b989f2d-90f8-4c31-b5c8-48815d1bd60a","Type":"ContainerStarted","Data":"c37232e7a46abed828a7f6e12362cc7af9ed3b8cecc5c6e79f3e5d4d3a06d97a"} Jul 06 22:23:56.051187 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.051157 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xrgz2" event={"ID":"8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8","Type":"ContainerStarted","Data":"bea7fec50bbe70c154c934ff47926761835dccfb8e0610278267617fc0b22536"} Jul 06 22:23:56.052404 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.052381 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fvftx" event={"ID":"84e85955-5b73-4405-b97a-0d5e3f1544bd","Type":"ContainerStarted","Data":"b8ce075d8ef12b6dc7f067baeb6ef292a647e219b48aa0f6647b7ab34eabea69"} Jul 06 22:23:56.053839 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.053807 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lvssm" event={"ID":"f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05","Type":"ContainerStarted","Data":"0353ff9ba21ad204f3545da6d9a4e5af3f5c4370fa7158c60cd6ce79e0f488cb"} Jul 06 22:23:56.055329 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.055309 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gw9t5" event={"ID":"f68bc160-fd3d-40f8-98d1-f05505d4c7ef","Type":"ContainerStarted","Data":"008656f2969f7221f821de9513638d748050fc5e1424a523d3050b5ccf3b5974"} Jul 06 22:23:56.297054 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.296976 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:23:56.467434 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:23:56.467393 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86eeedf5_af61_4fb1_956a_c2c9892b850d.slice/crio-6da2ed94c9ca52114d42b0dce5a9d00c111879341a5eaff2e9dc450a92bdbc69 WatchSource:0}: Error finding container 6da2ed94c9ca52114d42b0dce5a9d00c111879341a5eaff2e9dc450a92bdbc69: Status 404 returned error can't find the container with id 6da2ed94c9ca52114d42b0dce5a9d00c111879341a5eaff2e9dc450a92bdbc69 Jul 06 22:23:56.664960 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.664914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:56.665131 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.664999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:23:56.665131 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:56.665124 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:56.665262 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:56.665195 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs podName:b3559859-d52e-4234-8521-b7d88e588f97 nodeName:}" failed. No retries permitted until 2026-07-06 22:23:58.665172443 +0000 UTC m=+6.058766239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs") pod "network-metrics-daemon-rl2l6" (UID: "b3559859-d52e-4234-8521-b7d88e588f97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:56.665651 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:56.665629 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:56.665760 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:56.665684 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret podName:07d32136-31d7-4613-bef2-2d540719426b nodeName:}" failed. No retries permitted until 2026-07-06 22:23:58.66566999 +0000 UTC m=+6.059263800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret") pod "global-pull-secret-syncer-nfsqr" (UID: "07d32136-31d7-4613-bef2-2d540719426b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:56.766456 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:56.765772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvv6\" (UniqueName: \"kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6\") pod \"network-check-target-wwz95\" (UID: \"5b90408c-e7fb-40a2-91cd-a2ed3c77d218\") " pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:23:56.766456 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:56.766000 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:23:56.766456 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:56.766025 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:23:56.766456 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:56.766039 2564 projected.go:196] Error preparing data for projected volume kube-api-access-whvv6 for pod openshift-network-diagnostics/network-check-target-wwz95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:56.766456 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:56.766101 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6 podName:5b90408c-e7fb-40a2-91cd-a2ed3c77d218 nodeName:}" failed. No retries permitted until 2026-07-06 22:23:58.766081268 +0000 UTC m=+6.159675075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-whvv6" (UniqueName: "kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6") pod "network-check-target-wwz95" (UID: "5b90408c-e7fb-40a2-91cd-a2ed3c77d218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:57.019663 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:57.019545 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:18:55 +0000 UTC" deadline="2028-02-05 18:36:12.046060377 +0000 UTC" Jul 06 22:23:57.019663 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:57.019609 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13892h12m15.026454947s" Jul 06 22:23:57.037294 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:57.037266 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:23:57.037438 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:57.037395 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:23:57.037888 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:57.037863 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:23:57.037999 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:57.037973 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:23:57.038060 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:57.038044 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:57.038185 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:57.038119 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:23:57.067472 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:57.067428 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" event={"ID":"86eeedf5-af61-4fb1-956a-c2c9892b850d","Type":"ContainerStarted","Data":"6da2ed94c9ca52114d42b0dce5a9d00c111879341a5eaff2e9dc450a92bdbc69"} Jul 06 22:23:57.086072 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:57.085992 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xsxb4" event={"ID":"e0939ff7-a0de-41ba-a2e0-4a5961c4fb99","Type":"ContainerStarted","Data":"f61f7c93d41ddeb4605b0aa9dc01bfc5b3ebce8bfdbe57a3b70f83e59c0df804"} Jul 06 22:23:57.099164 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:57.098413 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal" event={"ID":"d7a0286b78fb561648d6188aef1e798d","Type":"ContainerStarted","Data":"cff46f996257d2589efb658bae2e7a993c6c6e34362dd671f2f8b71dce587b4c"} Jul 06 22:23:58.118813 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:58.118538 2564 generic.go:356] "Generic (PLEG): container finished" podID="383433ceaa79369db179e04de0564c0f" containerID="4642295fcddd2133b38b41ea992ad5e1f55733665c033251e1b0e490d8f2df5f" exitCode=0 Jul 06 22:23:58.119362 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:58.119337 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" event={"ID":"383433ceaa79369db179e04de0564c0f","Type":"ContainerDied","Data":"4642295fcddd2133b38b41ea992ad5e1f55733665c033251e1b0e490d8f2df5f"} Jul 06 22:23:58.138019 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:58.137927 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal" podStartSLOduration=4.137904309 podStartE2EDuration="4.137904309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:23:57.115832415 +0000 UTC m=+4.509426232" watchObservedRunningTime="2026-07-06 22:23:58.137904309 +0000 UTC m=+5.531498125" Jul 06 22:23:58.687634 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:58.687532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:58.687634 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:58.687616 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:23:58.687910 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:58.687747 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:58.687910 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:58.687812 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs podName:b3559859-d52e-4234-8521-b7d88e588f97 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:02.687793119 +0000 UTC m=+10.081386914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs") pod "network-metrics-daemon-rl2l6" (UID: "b3559859-d52e-4234-8521-b7d88e588f97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:58.688226 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:58.688208 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:58.688296 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:58.688257 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret podName:07d32136-31d7-4613-bef2-2d540719426b nodeName:}" failed. No retries permitted until 2026-07-06 22:24:02.688242191 +0000 UTC m=+10.081835986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret") pod "global-pull-secret-syncer-nfsqr" (UID: "07d32136-31d7-4613-bef2-2d540719426b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:58.789102 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:58.789030 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvv6\" (UniqueName: \"kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6\") pod \"network-check-target-wwz95\" (UID: \"5b90408c-e7fb-40a2-91cd-a2ed3c77d218\") " pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:23:58.789320 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:58.789208 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:23:58.789320 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:58.789234 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:23:58.789320 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:58.789248 2564 projected.go:196] Error preparing data for projected volume kube-api-access-whvv6 for pod openshift-network-diagnostics/network-check-target-wwz95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:58.789320 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:58.789311 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6 podName:5b90408c-e7fb-40a2-91cd-a2ed3c77d218 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:02.789291758 +0000 UTC m=+10.182885566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-whvv6" (UniqueName: "kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6") pod "network-check-target-wwz95" (UID: "5b90408c-e7fb-40a2-91cd-a2ed3c77d218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:59.037100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:59.037013 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:23:59.037262 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:59.037160 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:23:59.037342 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:59.037301 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:23:59.037501 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:59.037419 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:23:59.037501 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:23:59.037309 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:23:59.037717 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:23:59.037551 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:01.038378 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:01.037655 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:01.038378 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:01.037797 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:01.038378 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:01.038230 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:01.038378 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:01.038330 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:01.039227 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:01.039091 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:01.039227 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:01.039190 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:02.722850 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:02.722703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:02.722850 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:02.722797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:02.723379 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:02.722894 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:24:02.723379 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:02.722972 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret podName:07d32136-31d7-4613-bef2-2d540719426b nodeName:}" failed. No retries permitted until 2026-07-06 22:24:10.722951797 +0000 UTC m=+18.116545594 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret") pod "global-pull-secret-syncer-nfsqr" (UID: "07d32136-31d7-4613-bef2-2d540719426b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:24:02.723379 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:02.722903 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:24:02.723379 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:02.723070 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs podName:b3559859-d52e-4234-8521-b7d88e588f97 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:10.723044951 +0000 UTC m=+18.116638768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs") pod "network-metrics-daemon-rl2l6" (UID: "b3559859-d52e-4234-8521-b7d88e588f97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:24:02.824046 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:02.823905 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvv6\" (UniqueName: \"kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6\") pod \"network-check-target-wwz95\" (UID: \"5b90408c-e7fb-40a2-91cd-a2ed3c77d218\") " pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:02.824243 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:02.824118 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:24:02.824243 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:02.824150 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:24:02.824243 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:02.824165 2564 projected.go:196] Error preparing data for projected volume kube-api-access-whvv6 for pod openshift-network-diagnostics/network-check-target-wwz95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:24:02.824243 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:02.824230 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6 podName:5b90408c-e7fb-40a2-91cd-a2ed3c77d218 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:10.824210956 +0000 UTC m=+18.217804763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-whvv6" (UniqueName: "kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6") pod "network-check-target-wwz95" (UID: "5b90408c-e7fb-40a2-91cd-a2ed3c77d218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:24:03.037732 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:03.037462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:03.037732 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:03.037623 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:03.037732 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:03.037637 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:03.038023 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:03.037750 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:03.038023 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:03.037803 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:03.038023 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:03.037888 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:05.040633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:05.040570 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:05.041088 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:05.040749 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:05.041169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:05.041098 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:05.041218 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:05.041188 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:05.041272 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:05.041249 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:05.041352 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:05.041330 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:07.037776 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:07.037658 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:07.037776 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:07.037703 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:07.038263 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:07.037794 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:07.038263 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:07.037669 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:07.038263 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:07.037883 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:07.038263 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:07.038035 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:09.037371 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:09.037339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:09.037769 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:09.037354 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:09.037769 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:09.037457 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:09.037769 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:09.037586 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:09.037769 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:09.037624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:09.037769 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:09.037703 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:10.792167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:10.792085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:10.792167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:10.792166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:10.792701 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:10.792269 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:24:10.792701 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:10.792285 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:24:10.792701 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:10.792350 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret podName:07d32136-31d7-4613-bef2-2d540719426b nodeName:}" failed. No retries permitted until 2026-07-06 22:24:26.792328739 +0000 UTC m=+34.185922553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret") pod "global-pull-secret-syncer-nfsqr" (UID: "07d32136-31d7-4613-bef2-2d540719426b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:24:10.792701 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:10.792371 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs podName:b3559859-d52e-4234-8521-b7d88e588f97 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:26.792361458 +0000 UTC m=+34.185955261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs") pod "network-metrics-daemon-rl2l6" (UID: "b3559859-d52e-4234-8521-b7d88e588f97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:24:10.892946 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:10.892905 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvv6\" (UniqueName: \"kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6\") pod \"network-check-target-wwz95\" (UID: \"5b90408c-e7fb-40a2-91cd-a2ed3c77d218\") " pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:10.893143 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:10.893051 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:24:10.893143 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:10.893073 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:24:10.893143 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:10.893082 2564 projected.go:196] Error preparing data for projected volume kube-api-access-whvv6 for pod openshift-network-diagnostics/network-check-target-wwz95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:24:10.893143 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:10.893138 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6 podName:5b90408c-e7fb-40a2-91cd-a2ed3c77d218 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:26.893122896 +0000 UTC m=+34.286716686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-whvv6" (UniqueName: "kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6") pod "network-check-target-wwz95" (UID: "5b90408c-e7fb-40a2-91cd-a2ed3c77d218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:24:11.037522 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:11.037474 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:11.037719 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:11.037482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:11.037719 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:11.037615 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:11.037719 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:11.037697 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:11.037883 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:11.037482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:11.037883 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:11.037814 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:13.038673 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:13.038635 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:13.039138 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:13.038730 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:13.039138 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:13.039079 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:13.039244 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:13.039147 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:13.039297 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:13.039235 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:13.039297 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:13.038767 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:15.036968 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:15.036923 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:15.037407 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:15.036923 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:15.037407 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:15.037041 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:15.037407 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:15.037055 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:15.037407 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:15.037186 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:15.037407 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:15.037265 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:15.174592 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:15.174551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gw9t5" event={"ID":"f68bc160-fd3d-40f8-98d1-f05505d4c7ef","Type":"ContainerStarted","Data":"73a89c81f6bb0af127658ceb6cf0deb736ec49a4687ac7fad1d267ba8b4edfd5"} Jul 06 22:24:15.177714 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:15.177642 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" event={"ID":"383433ceaa79369db179e04de0564c0f","Type":"ContainerStarted","Data":"cd0cbf76896bdd757790706babb9ca7a945a5278786166cdab35718dc9975abf"} Jul 06 22:24:16.182479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.182229 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lvssm" event={"ID":"f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05","Type":"ContainerStarted","Data":"444fff43010afed105ce6ce3bfa8e55c916818c3fbeca0335c73c4b73f2e585f"} Jul 06 22:24:16.184421 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.184393 2564 generic.go:356] "Generic (PLEG): container finished" podID="f68bc160-fd3d-40f8-98d1-f05505d4c7ef" containerID="73a89c81f6bb0af127658ceb6cf0deb736ec49a4687ac7fad1d267ba8b4edfd5" exitCode=0 Jul 06 22:24:16.184561 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.184530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gw9t5" event={"ID":"f68bc160-fd3d-40f8-98d1-f05505d4c7ef","Type":"ContainerDied","Data":"73a89c81f6bb0af127658ceb6cf0deb736ec49a4687ac7fad1d267ba8b4edfd5"} Jul 06 22:24:16.186205 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.186127 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f556g" event={"ID":"73daa614-7bd3-4e51-850f-600b4163b572","Type":"ContainerStarted","Data":"adea8b6784cf3c238b8e4cd4158cb166cc51cba175079e86cd01e2dd502e543a"} Jul 06 22:24:16.189464 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.189445 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:24:16.189867 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.189844 2564 generic.go:356] "Generic (PLEG): container finished" podID="2b989f2d-90f8-4c31-b5c8-48815d1bd60a" containerID="83eb8dd3108ac41a8069b32ac38891810097ac7c3c312f41f1b178b5ef68f487" exitCode=1 Jul 06 22:24:16.189967 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.189925 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" event={"ID":"2b989f2d-90f8-4c31-b5c8-48815d1bd60a","Type":"ContainerStarted","Data":"da13841b00b51e9641e209f88a590fe1cc8a7d9a0960a0b3770ead3f1b5eb698"} Jul 06 22:24:16.190033 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.190004 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" event={"ID":"2b989f2d-90f8-4c31-b5c8-48815d1bd60a","Type":"ContainerStarted","Data":"a6cfdbb84844f25ebc23296a22de569096283d1bed8bd3e455d61acc700cec83"} Jul 06 22:24:16.190093 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.190054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" event={"ID":"2b989f2d-90f8-4c31-b5c8-48815d1bd60a","Type":"ContainerStarted","Data":"e1b7cd855357cf35a873025016781595214e1e0c7f6417db172cdef7dc95c227"} Jul 06 22:24:16.190146 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.190106 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" event={"ID":"2b989f2d-90f8-4c31-b5c8-48815d1bd60a","Type":"ContainerStarted","Data":"8b90ee4473ecbbc2dffd6355a6f8b9574aeb075eab24837641532b9305f8d0a7"} Jul 06 22:24:16.190199 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.190155 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" event={"ID":"2b989f2d-90f8-4c31-b5c8-48815d1bd60a","Type":"ContainerDied","Data":"83eb8dd3108ac41a8069b32ac38891810097ac7c3c312f41f1b178b5ef68f487"} Jul 06 22:24:16.190252 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.190208 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" event={"ID":"2b989f2d-90f8-4c31-b5c8-48815d1bd60a","Type":"ContainerStarted","Data":"53089376fee275dac9ad093be8e65b7aec4426c5e17c9eae902845e97476eaed"} Jul 06 22:24:16.191530 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.191471 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" event={"ID":"86eeedf5-af61-4fb1-956a-c2c9892b850d","Type":"ContainerStarted","Data":"acf7ef6d9e586d18c26e8002ab56311ae09c725a0d23ec3ce693b313ab8e4483"} Jul 06 22:24:16.193026 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.193007 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xsxb4" event={"ID":"e0939ff7-a0de-41ba-a2e0-4a5961c4fb99","Type":"ContainerStarted","Data":"456a12a6f56b36a71643eba91e111bede34bfdbd0967b7e34f052032f04ec5e2"} Jul 06 22:24:16.194734 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.194709 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xrgz2" event={"ID":"8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8","Type":"ContainerStarted","Data":"8e9796489a5b32f34258960fb5e0a6e45b7ddaabfe7dec97d3c631b357bada9d"} Jul 06 22:24:16.196270 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.196247 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fvftx" event={"ID":"84e85955-5b73-4405-b97a-0d5e3f1544bd","Type":"ContainerStarted","Data":"aa41cb27e83b483a0578270f755870bad048fef27149d5551ecaaeeab6d5286d"} Jul 06 22:24:16.214839 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.214799 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lvssm" podStartSLOduration=3.512590295 podStartE2EDuration="23.214786782s" totalImagesPullingTime="19.702196487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:16.197378671 +0000 UTC m=+23.590972485" watchObservedRunningTime="2026-07-06 22:24:16.214786782 +0000 UTC m=+23.608380594" Jul 06 22:24:16.214957 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.214888 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fvftx" podStartSLOduration=3.4998499020000002 podStartE2EDuration="23.214883599s" totalImagesPullingTime="19.715033697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:16.214621668 +0000 UTC m=+23.608215480" watchObservedRunningTime="2026-07-06 22:24:16.214883599 +0000 UTC m=+23.608477410" Jul 06 22:24:16.228627 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.228585 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xrgz2" podStartSLOduration=2.559896988 podStartE2EDuration="22.228574557s" totalImagesPullingTime="19.668677569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:16.228373796 +0000 UTC m=+23.621967602" watchObservedRunningTime="2026-07-06 22:24:16.228574557 +0000 UTC m=+23.622168368" Jul 06 22:24:16.244987 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.244944 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f556g" podStartSLOduration=2.565345707 podStartE2EDuration="22.244932867s" totalImagesPullingTime="19.67958716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:16.244751279 +0000 UTC m=+23.638345092" watchObservedRunningTime="2026-07-06 22:24:16.244932867 +0000 UTC m=+23.638526678" Jul 06 22:24:16.262717 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.262645 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" podStartSLOduration=22.262637951 podStartE2EDuration="22.262637951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:16.262623122 +0000 UTC m=+23.656216945" watchObservedRunningTime="2026-07-06 22:24:16.262637951 +0000 UTC m=+23.656231762" Jul 06 22:24:16.322439 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.322395 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xsxb4" podStartSLOduration=3.78443883 podStartE2EDuration="22.322381808s" totalImagesPullingTime="18.537942978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:16.322093443 +0000 UTC m=+23.715687256" watchObservedRunningTime="2026-07-06 22:24:16.322381808 +0000 UTC m=+23.715975620" Jul 06 22:24:16.591895 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:16.591872 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 22:24:17.002838 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:17.002698 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T22:24:16.591891261Z","UUID":"04e4b74b-29fe-4eda-adac-dc038e0c9ab0","Handler":null,"Name":"","Endpoint":""} Jul 06 22:24:17.004156 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:17.004137 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 22:24:17.004257 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:17.004171 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 22:24:17.037354 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:17.037307 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:17.037354 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:17.037339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:17.037601 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:17.037315 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:17.037601 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:17.037434 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:17.037601 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:17.037552 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:17.037748 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:17.037632 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:17.200505 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:17.200443 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fprcg" event={"ID":"f763ccf3-1087-434c-84de-0648fbe787aa","Type":"ContainerStarted","Data":"10178bb3b610880ffb0b69204af55f40db76fdef33eb0998e164dc89e52b432e"} Jul 06 22:24:17.202393 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:17.202353 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" event={"ID":"86eeedf5-af61-4fb1-956a-c2c9892b850d","Type":"ContainerStarted","Data":"8a620e1cd2deba84d87135dae67b4eea227380a72d307023f4ce010f0c6d6d57"} Jul 06 22:24:18.208839 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:18.208605 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:24:18.209247 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:18.209212 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" event={"ID":"2b989f2d-90f8-4c31-b5c8-48815d1bd60a","Type":"ContainerStarted","Data":"b7bbefa3446f6f25585b96de0b0d844b5c19b2a39f826e6af376194b00cd63c3"} Jul 06 22:24:18.211645 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:18.211618 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" event={"ID":"86eeedf5-af61-4fb1-956a-c2c9892b850d","Type":"ContainerStarted","Data":"e4eec19de7cefaf71f44e051ff54a7b906781b28d6a30d033eba25b6cd165169"} Jul 06 22:24:18.230774 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:18.230723 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fprcg" podStartSLOduration=4.588917896 podStartE2EDuration="24.230706243s" totalImagesPullingTime="19.641788347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:17.214382381 +0000 UTC m=+24.607976193" watchObservedRunningTime="2026-07-06 22:24:18.230706243 +0000 UTC m=+25.624300057" Jul 06 22:24:19.037910 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:19.037872 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:19.038126 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:19.038001 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:19.038126 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:19.037887 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:19.038126 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:19.037875 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:19.038126 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:19.038096 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:19.038339 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:19.038156 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:20.179414 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:20.179376 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xsxb4" Jul 06 22:24:20.180145 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:20.180116 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xsxb4" Jul 06 22:24:20.195075 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:20.195032 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znxjc" podStartSLOduration=5.042135043 podStartE2EDuration="26.1950132s" totalImagesPullingTime="21.152878157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:18.23024937 +0000 UTC m=+25.623843181" watchObservedRunningTime="2026-07-06 22:24:20.1950132 +0000 UTC m=+27.588607019" Jul 06 22:24:20.215704 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:20.215683 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xsxb4" Jul 06 22:24:20.216077 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:20.216059 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xsxb4" Jul 06 22:24:21.037053 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:21.036830 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:21.037179 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:21.036852 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:21.037179 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:21.037072 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:21.037303 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:21.037185 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:21.037303 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:21.036852 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:21.037303 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:21.037292 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:21.220912 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:21.220887 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:24:21.221567 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:21.221235 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" event={"ID":"2b989f2d-90f8-4c31-b5c8-48815d1bd60a","Type":"ContainerStarted","Data":"297303e44ef3304712ac4cd613dce852088730f6060ef633c578afc6d8fe8707"} Jul 06 22:24:21.221567 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:21.221467 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:24:21.221689 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:21.221662 2564 scope.go:117] "RemoveContainer" containerID="83eb8dd3108ac41a8069b32ac38891810097ac7c3c312f41f1b178b5ef68f487" Jul 06 22:24:21.223823 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:21.223789 2564 generic.go:356] "Generic (PLEG): container finished" podID="f68bc160-fd3d-40f8-98d1-f05505d4c7ef" containerID="df34052173a75bd2c03398e074c63afe306a747f189620dbe49dd0e2c1226011" exitCode=0 Jul 06 22:24:21.223937 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:21.223835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gw9t5" event={"ID":"f68bc160-fd3d-40f8-98d1-f05505d4c7ef","Type":"ContainerDied","Data":"df34052173a75bd2c03398e074c63afe306a747f189620dbe49dd0e2c1226011"} Jul 06 22:24:21.237615 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:21.237594 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:24:22.229813 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:22.229790 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:24:22.230387 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:22.230141 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" event={"ID":"2b989f2d-90f8-4c31-b5c8-48815d1bd60a","Type":"ContainerStarted","Data":"1d05b67fae2d9256a2cda2d6875440142cf4161db6809fa73397f8d9aed69759"} Jul 06 22:24:22.230387 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:22.230255 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 22:24:22.230515 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:22.230430 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:24:22.244932 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:22.244910 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:24:22.312948 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:22.312887 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" podStartSLOduration=9.352559147000001 podStartE2EDuration="29.312867052s" totalImagesPullingTime="19.960307905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:22.284216178 +0000 UTC m=+29.677809990" watchObservedRunningTime="2026-07-06 22:24:22.312867052 +0000 UTC m=+29.706460865" Jul 06 22:24:22.530018 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:22.529950 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nfsqr"] Jul 06 22:24:22.530137 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:22.530081 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:22.530189 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:22.530166 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:22.533744 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:22.533718 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wwz95"] Jul 06 22:24:22.533899 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:22.533829 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:22.533966 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:22.533917 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:22.534318 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:22.534294 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rl2l6"] Jul 06 22:24:22.534427 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:22.534389 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:22.534502 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:22.534468 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:23.234534 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:23.234482 2564 generic.go:356] "Generic (PLEG): container finished" podID="f68bc160-fd3d-40f8-98d1-f05505d4c7ef" containerID="d189dfbc9e0ac24ef70d798746472d8f19c0cf30ed99c74b421748b321725abc" exitCode=0 Jul 06 22:24:23.234534 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:23.234519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gw9t5" event={"ID":"f68bc160-fd3d-40f8-98d1-f05505d4c7ef","Type":"ContainerDied","Data":"d189dfbc9e0ac24ef70d798746472d8f19c0cf30ed99c74b421748b321725abc"} Jul 06 22:24:23.234930 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:23.234638 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 22:24:24.036746 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:24.036710 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:24.036931 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:24.036853 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:24.036931 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:24.036892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:24.037037 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:24.036854 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:24.037037 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:24.036979 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:24.037127 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:24.037076 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:24.096116 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:24.096083 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:24:25.241961 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:25.241930 2564 generic.go:356] "Generic (PLEG): container finished" podID="f68bc160-fd3d-40f8-98d1-f05505d4c7ef" containerID="54da0ad8bce937ccf13237307c6d6bcf171535a95590867306c7b9242b17c0f8" exitCode=0 Jul 06 22:24:25.242448 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:25.241970 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gw9t5" event={"ID":"f68bc160-fd3d-40f8-98d1-f05505d4c7ef","Type":"ContainerDied","Data":"54da0ad8bce937ccf13237307c6d6bcf171535a95590867306c7b9242b17c0f8"} Jul 06 22:24:25.255846 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:25.255814 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" podUID="2b989f2d-90f8-4c31-b5c8-48815d1bd60a" containerName="ovnkube-controller" probeResult="failure" output="" Jul 06 22:24:26.036846 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:26.036813 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:26.037021 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:26.036823 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:26.037021 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:26.036944 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:26.037021 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:26.036937 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwz95" podUID="5b90408c-e7fb-40a2-91cd-a2ed3c77d218" Jul 06 22:24:26.037219 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:26.037106 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rl2l6" podUID="b3559859-d52e-4234-8521-b7d88e588f97" Jul 06 22:24:26.037401 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:26.037287 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nfsqr" podUID="07d32136-31d7-4613-bef2-2d540719426b" Jul 06 22:24:26.815402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:26.815367 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:26.815852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:26.815430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:26.815852 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:26.815541 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:24:26.815852 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:26.815544 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:24:26.815852 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:26.815614 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs podName:b3559859-d52e-4234-8521-b7d88e588f97 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:58.8155915 +0000 UTC m=+66.209185305 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs") pod "network-metrics-daemon-rl2l6" (UID: "b3559859-d52e-4234-8521-b7d88e588f97") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:24:26.815852 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:26.815650 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret podName:07d32136-31d7-4613-bef2-2d540719426b nodeName:}" failed. No retries permitted until 2026-07-06 22:24:58.815629329 +0000 UTC m=+66.209223136 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret") pod "global-pull-secret-syncer-nfsqr" (UID: "07d32136-31d7-4613-bef2-2d540719426b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:24:26.915876 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:26.915840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvv6\" (UniqueName: \"kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6\") pod \"network-check-target-wwz95\" (UID: \"5b90408c-e7fb-40a2-91cd-a2ed3c77d218\") " pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:26.916060 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:26.916017 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:24:26.916060 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:26.916040 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:24:26.916060 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:26.916052 2564 projected.go:196] Error preparing data for projected volume kube-api-access-whvv6 for pod openshift-network-diagnostics/network-check-target-wwz95: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:24:26.916222 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:26.916114 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6 podName:5b90408c-e7fb-40a2-91cd-a2ed3c77d218 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:58.916092541 +0000 UTC m=+66.309686350 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-whvv6" (UniqueName: "kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6") pod "network-check-target-wwz95" (UID: "5b90408c-e7fb-40a2-91cd-a2ed3c77d218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:24:27.905698 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.905667 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeReady" Jul 06 22:24:27.906358 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.905793 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 22:24:27.957148 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.957117 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b5dfbb746-l26xr"] Jul 06 22:24:27.959162 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.959141 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:27.962972 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.962951 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 22:24:27.963079 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.963018 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 22:24:27.963079 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.963060 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 22:24:27.963510 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.963480 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-62ptd\"" Jul 06 22:24:27.968959 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.968943 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 22:24:27.982117 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.981788 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b5dfbb746-l26xr"] Jul 06 22:24:27.982423 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.982403 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s66th"] Jul 06 22:24:27.984086 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.984062 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w7ps6"] Jul 06 22:24:27.984239 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.984223 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s66th" Jul 06 22:24:27.985772 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.985755 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w7ps6" Jul 06 22:24:27.986875 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.986856 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 22:24:27.987656 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.987641 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 22:24:27.987725 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.987710 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mrg4w\"" Jul 06 22:24:27.988172 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.988156 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 22:24:27.988341 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.988328 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zvrrt\"" Jul 06 22:24:27.988469 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.988454 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 22:24:27.988762 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:27.988749 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 22:24:28.002315 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.002292 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w7ps6"] Jul 06 22:24:28.004926 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.004907 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s66th"] Jul 06 22:24:28.037540 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.037499 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:28.037540 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.037535 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:28.037770 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.037502 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:28.043841 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.043823 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 22:24:28.043935 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.043869 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 22:24:28.043935 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.043825 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 22:24:28.044603 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.044563 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 22:24:28.044700 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.044610 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-czcdn\"" Jul 06 22:24:28.044700 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.044648 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wdmk\"" Jul 06 22:24:28.125175 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125144 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3559f127-6a66-4abe-a961-a3da19ef7568-tmp-dir\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:28.125175 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125177 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnxms\" (UniqueName: \"kubernetes.io/projected/7a500ff8-c870-462b-b137-4eeaa777a1db-kube-api-access-xnxms\") pod \"ingress-canary-w7ps6\" (UID: \"7a500ff8-c870-462b-b137-4eeaa777a1db\") " pod="openshift-ingress-canary/ingress-canary-w7ps6" Jul 06 22:24:28.125332 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:28.125332 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.125332 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-trusted-ca\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.125441 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm5d4\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-kube-api-access-tm5d4\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.125441 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-bound-sa-token\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.125441 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3559f127-6a66-4abe-a961-a3da19ef7568-config-volume\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:28.125441 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-image-registry-private-configuration\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.125620 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125447 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a500ff8-c870-462b-b137-4eeaa777a1db-cert\") pod \"ingress-canary-w7ps6\" (UID: \"7a500ff8-c870-462b-b137-4eeaa777a1db\") " pod="openshift-ingress-canary/ingress-canary-w7ps6" Jul 06 22:24:28.125620 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbfdc\" (UniqueName: \"kubernetes.io/projected/3559f127-6a66-4abe-a961-a3da19ef7568-kube-api-access-fbfdc\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:28.125620 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125481 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-certificates\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.125620 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-ca-trust-extracted\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.125620 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.125563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-installation-pull-secrets\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.226609 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-bound-sa-token\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.226609 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3559f127-6a66-4abe-a961-a3da19ef7568-config-volume\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:28.226609 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-image-registry-private-configuration\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.226609 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226600 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a500ff8-c870-462b-b137-4eeaa777a1db-cert\") pod \"ingress-canary-w7ps6\" (UID: \"7a500ff8-c870-462b-b137-4eeaa777a1db\") " pod="openshift-ingress-canary/ingress-canary-w7ps6" Jul 06 22:24:28.226907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbfdc\" (UniqueName: \"kubernetes.io/projected/3559f127-6a66-4abe-a961-a3da19ef7568-kube-api-access-fbfdc\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:28.226907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226691 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-certificates\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.226907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-ca-trust-extracted\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.226907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226766 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-installation-pull-secrets\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.226907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3559f127-6a66-4abe-a961-a3da19ef7568-tmp-dir\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:28.226907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226826 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnxms\" (UniqueName: \"kubernetes.io/projected/7a500ff8-c870-462b-b137-4eeaa777a1db-kube-api-access-xnxms\") pod \"ingress-canary-w7ps6\" (UID: \"7a500ff8-c870-462b-b137-4eeaa777a1db\") " pod="openshift-ingress-canary/ingress-canary-w7ps6" Jul 06 22:24:28.226907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:28.226907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.227356 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226942 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-trusted-ca\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.227356 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.226961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm5d4\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-kube-api-access-tm5d4\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.227356 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.227135 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3559f127-6a66-4abe-a961-a3da19ef7568-config-volume\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:28.227356 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:28.227207 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:24:28.227356 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:28.227218 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5dfbb746-l26xr: secret "image-registry-tls" not found Jul 06 22:24:28.227356 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.227251 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3559f127-6a66-4abe-a961-a3da19ef7568-tmp-dir\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:28.227356 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:28.227272 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls podName:d415ddbe-a70d-4d3e-8574-6d29e7c61ee3 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:28.727257241 +0000 UTC m=+36.120851047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls") pod "image-registry-7b5dfbb746-l26xr" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3") : secret "image-registry-tls" not found Jul 06 22:24:28.228119 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:28.227608 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:24:28.228119 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:28.227674 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls podName:3559f127-6a66-4abe-a961-a3da19ef7568 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:28.727656878 +0000 UTC m=+36.121250685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls") pod "dns-default-s66th" (UID: "3559f127-6a66-4abe-a961-a3da19ef7568") : secret "dns-default-metrics-tls" not found Jul 06 22:24:28.228119 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.227913 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-ca-trust-extracted\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.228119 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.227930 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-certificates\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.228301 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.228229 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-trusted-ca\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.231556 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.231382 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-installation-pull-secrets\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.231672 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.231528 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-image-registry-private-configuration\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.231672 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.231571 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a500ff8-c870-462b-b137-4eeaa777a1db-cert\") pod \"ingress-canary-w7ps6\" (UID: \"7a500ff8-c870-462b-b137-4eeaa777a1db\") " pod="openshift-ingress-canary/ingress-canary-w7ps6" Jul 06 22:24:28.236509 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.236463 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-bound-sa-token\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.239649 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.239629 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbfdc\" (UniqueName: \"kubernetes.io/projected/3559f127-6a66-4abe-a961-a3da19ef7568-kube-api-access-fbfdc\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:28.242839 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.242816 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnxms\" (UniqueName: \"kubernetes.io/projected/7a500ff8-c870-462b-b137-4eeaa777a1db-kube-api-access-xnxms\") pod \"ingress-canary-w7ps6\" (UID: \"7a500ff8-c870-462b-b137-4eeaa777a1db\") " pod="openshift-ingress-canary/ingress-canary-w7ps6" Jul 06 22:24:28.242953 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.242939 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm5d4\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-kube-api-access-tm5d4\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.298167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.298138 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w7ps6" Jul 06 22:24:28.437304 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.437276 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w7ps6"] Jul 06 22:24:28.440634 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:24:28.440609 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a500ff8_c870_462b_b137_4eeaa777a1db.slice/crio-e23194499fd660af9a4c11cce3dda7f97de2b9cec3d52b12cc265632ba51d93c WatchSource:0}: Error finding container e23194499fd660af9a4c11cce3dda7f97de2b9cec3d52b12cc265632ba51d93c: Status 404 returned error can't find the container with id e23194499fd660af9a4c11cce3dda7f97de2b9cec3d52b12cc265632ba51d93c Jul 06 22:24:28.731079 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.731043 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:28.731249 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:28.731096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:28.731249 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:28.731202 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:24:28.731249 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:28.731223 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:24:28.731249 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:28.731236 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5dfbb746-l26xr: secret "image-registry-tls" not found Jul 06 22:24:28.731408 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:28.731271 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls podName:3559f127-6a66-4abe-a961-a3da19ef7568 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:29.731256044 +0000 UTC m=+37.124849834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls") pod "dns-default-s66th" (UID: "3559f127-6a66-4abe-a961-a3da19ef7568") : secret "dns-default-metrics-tls" not found Jul 06 22:24:28.731408 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:28.731296 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls podName:d415ddbe-a70d-4d3e-8574-6d29e7c61ee3 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:29.731280266 +0000 UTC m=+37.124874081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls") pod "image-registry-7b5dfbb746-l26xr" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3") : secret "image-registry-tls" not found Jul 06 22:24:29.255544 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:29.255506 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w7ps6" event={"ID":"7a500ff8-c870-462b-b137-4eeaa777a1db","Type":"ContainerStarted","Data":"e23194499fd660af9a4c11cce3dda7f97de2b9cec3d52b12cc265632ba51d93c"} Jul 06 22:24:29.739676 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:29.739641 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:29.739838 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:29.739692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:29.739838 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:29.739803 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:24:29.739838 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:29.739821 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5dfbb746-l26xr: secret "image-registry-tls" not found Jul 06 22:24:29.739996 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:29.739802 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:24:29.739996 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:29.739897 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls podName:d415ddbe-a70d-4d3e-8574-6d29e7c61ee3 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:31.73987918 +0000 UTC m=+39.133472976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls") pod "image-registry-7b5dfbb746-l26xr" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3") : secret "image-registry-tls" not found Jul 06 22:24:29.739996 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:29.739964 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls podName:3559f127-6a66-4abe-a961-a3da19ef7568 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:31.73994445 +0000 UTC m=+39.133538247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls") pod "dns-default-s66th" (UID: "3559f127-6a66-4abe-a961-a3da19ef7568") : secret "dns-default-metrics-tls" not found Jul 06 22:24:31.264335 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:31.264303 2564 generic.go:356] "Generic (PLEG): container finished" podID="f68bc160-fd3d-40f8-98d1-f05505d4c7ef" containerID="bfd40f5e444cb06718bdce182738ff9ee07e95c70fc73e409801a6a3fd0a714c" exitCode=0 Jul 06 22:24:31.264774 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:31.264374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gw9t5" event={"ID":"f68bc160-fd3d-40f8-98d1-f05505d4c7ef","Type":"ContainerDied","Data":"bfd40f5e444cb06718bdce182738ff9ee07e95c70fc73e409801a6a3fd0a714c"} Jul 06 22:24:31.754522 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:31.754332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:31.754698 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:31.754557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:31.754698 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:31.754499 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:24:31.754698 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:31.754660 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls podName:3559f127-6a66-4abe-a961-a3da19ef7568 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:35.754642252 +0000 UTC m=+43.148236046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls") pod "dns-default-s66th" (UID: "3559f127-6a66-4abe-a961-a3da19ef7568") : secret "dns-default-metrics-tls" not found Jul 06 22:24:31.754857 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:31.754720 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:24:31.754857 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:31.754734 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5dfbb746-l26xr: secret "image-registry-tls" not found Jul 06 22:24:31.754857 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:31.754782 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls podName:d415ddbe-a70d-4d3e-8574-6d29e7c61ee3 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:35.754766835 +0000 UTC m=+43.148360627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls") pod "image-registry-7b5dfbb746-l26xr" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3") : secret "image-registry-tls" not found Jul 06 22:24:32.269594 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:32.269562 2564 generic.go:356] "Generic (PLEG): container finished" podID="f68bc160-fd3d-40f8-98d1-f05505d4c7ef" containerID="f72dd4987a1c63afa54b76ff3938bd3632be2ad46ce5029bda6ba3785ea0e466" exitCode=0 Jul 06 22:24:32.269942 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:32.269615 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gw9t5" event={"ID":"f68bc160-fd3d-40f8-98d1-f05505d4c7ef","Type":"ContainerDied","Data":"f72dd4987a1c63afa54b76ff3938bd3632be2ad46ce5029bda6ba3785ea0e466"} Jul 06 22:24:33.273554 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:33.273522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w7ps6" event={"ID":"7a500ff8-c870-462b-b137-4eeaa777a1db","Type":"ContainerStarted","Data":"add98780c3d17416214f301a161751429749efbf3907d5682543fb5755383e94"} Jul 06 22:24:33.276733 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:33.276706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gw9t5" event={"ID":"f68bc160-fd3d-40f8-98d1-f05505d4c7ef","Type":"ContainerStarted","Data":"22286c3c201a489778481e7da6dd8ba396bb214aa823a6369ffe29e6b23150c1"} Jul 06 22:24:33.291610 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:33.291570 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w7ps6" podStartSLOduration=2.218084395 podStartE2EDuration="6.291557526s" totalImagesPullingTime="4.073473131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:33.291065121 +0000 UTC m=+40.684658932" watchObservedRunningTime="2026-07-06 22:24:33.291557526 +0000 UTC m=+40.685151346" Jul 06 22:24:33.312075 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:33.312029 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gw9t5" podStartSLOduration=13.076463602 podStartE2EDuration="40.312017454s" totalImagesPullingTime="27.235553852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:33.310337144 +0000 UTC m=+40.703930956" watchObservedRunningTime="2026-07-06 22:24:33.312017454 +0000 UTC m=+40.705611266" Jul 06 22:24:35.787066 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:35.787022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:35.787451 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:35.787175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:35.787451 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:35.787178 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:24:35.787451 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:35.787199 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5dfbb746-l26xr: secret "image-registry-tls" not found Jul 06 22:24:35.787451 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:35.787249 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls podName:d415ddbe-a70d-4d3e-8574-6d29e7c61ee3 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:43.787233177 +0000 UTC m=+51.180826966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls") pod "image-registry-7b5dfbb746-l26xr" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3") : secret "image-registry-tls" not found Jul 06 22:24:35.787451 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:35.787255 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:24:35.787451 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:35.787293 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls podName:3559f127-6a66-4abe-a961-a3da19ef7568 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:43.787281451 +0000 UTC m=+51.180875241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls") pod "dns-default-s66th" (UID: "3559f127-6a66-4abe-a961-a3da19ef7568") : secret "dns-default-metrics-tls" not found Jul 06 22:24:41.504151 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.504119 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6npjm"] Jul 06 22:24:41.548348 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.548319 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-zqfpb"] Jul 06 22:24:41.548504 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.548432 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:24:41.554821 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.554797 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 22:24:41.554943 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.554843 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 22:24:41.555391 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.555362 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cs7gv\"" Jul 06 22:24:41.561977 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.561957 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-zqfpb"] Jul 06 22:24:41.562063 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.561985 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6npjm"] Jul 06 22:24:41.562063 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.562047 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.566757 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.566734 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 22:24:41.566859 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.566775 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 22:24:41.566859 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.566800 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 22:24:41.568731 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.568714 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 22:24:41.568819 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.568769 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-29q65\"" Jul 06 22:24:41.580630 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.580613 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 22:24:41.613307 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.613281 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-4gsbp"] Jul 06 22:24:41.629528 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.629479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqx64\" (UniqueName: \"kubernetes.io/projected/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-kube-api-access-bqx64\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.629604 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.629590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6npjm\" (UID: \"478ad560-6302-497f-980d-8e920eebab4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:24:41.629642 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.629627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-tmp\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.629675 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.629649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-snapshots\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.629717 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.629689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.629768 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.629717 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.629768 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.629738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/478ad560-6302-497f-980d-8e920eebab4e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6npjm\" (UID: \"478ad560-6302-497f-980d-8e920eebab4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:24:41.629885 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.629792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-serving-cert\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.633780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.633763 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426"] Jul 06 22:24:41.633892 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.633878 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.646702 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.646684 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8fj8b\"" Jul 06 22:24:41.646867 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.646856 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:24:41.646922 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.646892 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 22:24:41.647200 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.647187 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 22:24:41.647345 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.647333 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 22:24:41.650759 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.650741 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 22:24:41.657569 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.657547 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-4gsbp"] Jul 06 22:24:41.657569 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.657573 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426"] Jul 06 22:24:41.657680 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.657641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:41.660709 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.660689 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 22:24:41.661718 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.661702 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 22:24:41.662424 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.662407 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 22:24:41.664585 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.664559 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qwr62\"" Jul 06 22:24:41.664585 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.664579 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 22:24:41.714932 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.714906 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6"] Jul 06 22:24:41.727196 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.727180 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" Jul 06 22:24:41.730016 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.729988 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 22:24:41.730016 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.729992 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:24:41.730146 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-snapshots\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.730146 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730084 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad820355-d3fd-40bc-9cfc-ecf47498df29-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:41.730146 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b83d6b8c-5f51-4021-b340-da7ae99d4a46-config\") pod \"console-operator-68b757fb67-4gsbp\" (UID: \"b83d6b8c-5f51-4021-b340-da7ae99d4a46\") " pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.730298 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.730298 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.730298 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/478ad560-6302-497f-980d-8e920eebab4e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6npjm\" (UID: \"478ad560-6302-497f-980d-8e920eebab4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:24:41.730298 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh57s\" (UniqueName: \"kubernetes.io/projected/ad820355-d3fd-40bc-9cfc-ecf47498df29-kube-api-access-jh57s\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:41.730298 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730263 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b83d6b8c-5f51-4021-b340-da7ae99d4a46-serving-cert\") pod \"console-operator-68b757fb67-4gsbp\" (UID: \"b83d6b8c-5f51-4021-b340-da7ae99d4a46\") " pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.730298 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730289 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqx64\" (UniqueName: \"kubernetes.io/projected/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-kube-api-access-bqx64\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.730609 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-tmp\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.730609 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b83d6b8c-5f51-4021-b340-da7ae99d4a46-trusted-ca\") pod \"console-operator-68b757fb67-4gsbp\" (UID: \"b83d6b8c-5f51-4021-b340-da7ae99d4a46\") " pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.730609 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730405 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:41.730609 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730455 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6npjm\" (UID: \"478ad560-6302-497f-980d-8e920eebab4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:24:41.730609 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-serving-cert\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.730609 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2pg2\" (UniqueName: \"kubernetes.io/projected/b83d6b8c-5f51-4021-b340-da7ae99d4a46-kube-api-access-x2pg2\") pod \"console-operator-68b757fb67-4gsbp\" (UID: \"b83d6b8c-5f51-4021-b340-da7ae99d4a46\") " pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.730609 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730582 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 22:24:41.730943 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:41.730690 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:24:41.730943 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730735 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-tmp\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.730943 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:41.730747 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert podName:478ad560-6302-497f-980d-8e920eebab4e nodeName:}" failed. No retries permitted until 2026-07-06 22:24:42.230730917 +0000 UTC m=+49.624324721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6npjm" (UID: "478ad560-6302-497f-980d-8e920eebab4e") : secret "networking-console-plugin-cert" not found Jul 06 22:24:41.730943 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730754 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.730943 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730753 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-snapshots\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.730943 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.730777 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 22:24:41.731203 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.731057 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/478ad560-6302-497f-980d-8e920eebab4e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6npjm\" (UID: \"478ad560-6302-497f-980d-8e920eebab4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:24:41.731203 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.731084 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rmb8f\"" Jul 06 22:24:41.731480 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.731464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.734935 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.734912 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-serving-cert\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.738362 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.738339 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6"] Jul 06 22:24:41.754762 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.754710 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqx64\" (UniqueName: \"kubernetes.io/projected/fa5ba8dd-b8b9-411b-b61b-eefe3718030e-kube-api-access-bqx64\") pod \"insights-operator-5c847dcfc4-zqfpb\" (UID: \"fa5ba8dd-b8b9-411b-b61b-eefe3718030e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.831767 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.831737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh57s\" (UniqueName: \"kubernetes.io/projected/ad820355-d3fd-40bc-9cfc-ecf47498df29-kube-api-access-jh57s\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:41.831902 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.831772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b83d6b8c-5f51-4021-b340-da7ae99d4a46-serving-cert\") pod \"console-operator-68b757fb67-4gsbp\" (UID: \"b83d6b8c-5f51-4021-b340-da7ae99d4a46\") " pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.831902 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.831811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52941bfe-7acf-49aa-8678-07377455f1a7-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-bk9q6\" (UID: \"52941bfe-7acf-49aa-8678-07377455f1a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" Jul 06 22:24:41.831902 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.831832 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52941bfe-7acf-49aa-8678-07377455f1a7-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-bk9q6\" (UID: \"52941bfe-7acf-49aa-8678-07377455f1a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" Jul 06 22:24:41.831902 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.831850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b83d6b8c-5f51-4021-b340-da7ae99d4a46-trusted-ca\") pod \"console-operator-68b757fb67-4gsbp\" (UID: \"b83d6b8c-5f51-4021-b340-da7ae99d4a46\") " pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.832108 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.831896 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:41.832108 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.831998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2pg2\" (UniqueName: \"kubernetes.io/projected/b83d6b8c-5f51-4021-b340-da7ae99d4a46-kube-api-access-x2pg2\") pod \"console-operator-68b757fb67-4gsbp\" (UID: \"b83d6b8c-5f51-4021-b340-da7ae99d4a46\") " pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.832108 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.832052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad820355-d3fd-40bc-9cfc-ecf47498df29-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:41.832108 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:41.832059 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:41.832108 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.832083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm8jq\" (UniqueName: \"kubernetes.io/projected/52941bfe-7acf-49aa-8678-07377455f1a7-kube-api-access-nm8jq\") pod \"kube-storage-version-migrator-operator-846bf668f7-bk9q6\" (UID: \"52941bfe-7acf-49aa-8678-07377455f1a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" Jul 06 22:24:41.832367 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:41.832122 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls podName:ad820355-d3fd-40bc-9cfc-ecf47498df29 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:42.332104209 +0000 UTC m=+49.725698019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qm426" (UID: "ad820355-d3fd-40bc-9cfc-ecf47498df29") : secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:41.832367 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.832153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b83d6b8c-5f51-4021-b340-da7ae99d4a46-config\") pod \"console-operator-68b757fb67-4gsbp\" (UID: \"b83d6b8c-5f51-4021-b340-da7ae99d4a46\") " pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.832777 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.832758 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b83d6b8c-5f51-4021-b340-da7ae99d4a46-trusted-ca\") pod \"console-operator-68b757fb67-4gsbp\" (UID: \"b83d6b8c-5f51-4021-b340-da7ae99d4a46\") " pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.832822 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.832802 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b83d6b8c-5f51-4021-b340-da7ae99d4a46-config\") pod \"console-operator-68b757fb67-4gsbp\" (UID: \"b83d6b8c-5f51-4021-b340-da7ae99d4a46\") " pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.832859 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.832812 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad820355-d3fd-40bc-9cfc-ecf47498df29-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:41.833989 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.833972 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b83d6b8c-5f51-4021-b340-da7ae99d4a46-serving-cert\") pod \"console-operator-68b757fb67-4gsbp\" (UID: \"b83d6b8c-5f51-4021-b340-da7ae99d4a46\") " pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.840104 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.840078 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2pg2\" (UniqueName: \"kubernetes.io/projected/b83d6b8c-5f51-4021-b340-da7ae99d4a46-kube-api-access-x2pg2\") pod \"console-operator-68b757fb67-4gsbp\" (UID: \"b83d6b8c-5f51-4021-b340-da7ae99d4a46\") " pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:41.840241 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.840226 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh57s\" (UniqueName: \"kubernetes.io/projected/ad820355-d3fd-40bc-9cfc-ecf47498df29-kube-api-access-jh57s\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:41.870402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.870374 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" Jul 06 22:24:41.933391 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.933362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm8jq\" (UniqueName: \"kubernetes.io/projected/52941bfe-7acf-49aa-8678-07377455f1a7-kube-api-access-nm8jq\") pod \"kube-storage-version-migrator-operator-846bf668f7-bk9q6\" (UID: \"52941bfe-7acf-49aa-8678-07377455f1a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" Jul 06 22:24:41.933542 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.933422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52941bfe-7acf-49aa-8678-07377455f1a7-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-bk9q6\" (UID: \"52941bfe-7acf-49aa-8678-07377455f1a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" Jul 06 22:24:41.933542 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.933446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52941bfe-7acf-49aa-8678-07377455f1a7-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-bk9q6\" (UID: \"52941bfe-7acf-49aa-8678-07377455f1a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" Jul 06 22:24:41.933958 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.933936 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52941bfe-7acf-49aa-8678-07377455f1a7-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-bk9q6\" (UID: \"52941bfe-7acf-49aa-8678-07377455f1a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" Jul 06 22:24:41.935497 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.935464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52941bfe-7acf-49aa-8678-07377455f1a7-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-bk9q6\" (UID: \"52941bfe-7acf-49aa-8678-07377455f1a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" Jul 06 22:24:41.941594 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.941571 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm8jq\" (UniqueName: \"kubernetes.io/projected/52941bfe-7acf-49aa-8678-07377455f1a7-kube-api-access-nm8jq\") pod \"kube-storage-version-migrator-operator-846bf668f7-bk9q6\" (UID: \"52941bfe-7acf-49aa-8678-07377455f1a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" Jul 06 22:24:41.942313 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:41.942297 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:42.036396 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:42.036369 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" Jul 06 22:24:42.037873 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:42.037844 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-zqfpb"] Jul 06 22:24:42.040824 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:24:42.040789 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5ba8dd_b8b9_411b_b61b_eefe3718030e.slice/crio-6c6902bf8f95ab8a8f8b033f5c8b0f48ab143385a5f89a1fa9cfc1d217c44e58 WatchSource:0}: Error finding container 6c6902bf8f95ab8a8f8b033f5c8b0f48ab143385a5f89a1fa9cfc1d217c44e58: Status 404 returned error can't find the container with id 6c6902bf8f95ab8a8f8b033f5c8b0f48ab143385a5f89a1fa9cfc1d217c44e58 Jul 06 22:24:42.100335 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:42.100255 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-4gsbp"] Jul 06 22:24:42.104365 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:24:42.104342 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83d6b8c_5f51_4021_b340_da7ae99d4a46.slice/crio-a8e540df364fda3e7bc933949937989eb7529d08167d1c351cacd1537473fd50 WatchSource:0}: Error finding container a8e540df364fda3e7bc933949937989eb7529d08167d1c351cacd1537473fd50: Status 404 returned error can't find the container with id a8e540df364fda3e7bc933949937989eb7529d08167d1c351cacd1537473fd50 Jul 06 22:24:42.186405 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:42.186378 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6"] Jul 06 22:24:42.189168 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:24:42.189147 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52941bfe_7acf_49aa_8678_07377455f1a7.slice/crio-2f1db11579a27c214336059830f862225bd78c5207f76c5aec9a1fbf663aaef4 WatchSource:0}: Error finding container 2f1db11579a27c214336059830f862225bd78c5207f76c5aec9a1fbf663aaef4: Status 404 returned error can't find the container with id 2f1db11579a27c214336059830f862225bd78c5207f76c5aec9a1fbf663aaef4 Jul 06 22:24:42.236274 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:42.236232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6npjm\" (UID: \"478ad560-6302-497f-980d-8e920eebab4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:24:42.236360 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:42.236348 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:24:42.236411 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:42.236401 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert podName:478ad560-6302-497f-980d-8e920eebab4e nodeName:}" failed. No retries permitted until 2026-07-06 22:24:43.236386733 +0000 UTC m=+50.629980524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6npjm" (UID: "478ad560-6302-497f-980d-8e920eebab4e") : secret "networking-console-plugin-cert" not found Jul 06 22:24:42.297885 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:42.297804 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" event={"ID":"52941bfe-7acf-49aa-8678-07377455f1a7","Type":"ContainerStarted","Data":"2f1db11579a27c214336059830f862225bd78c5207f76c5aec9a1fbf663aaef4"} Jul 06 22:24:42.298819 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:42.298797 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" event={"ID":"b83d6b8c-5f51-4021-b340-da7ae99d4a46","Type":"ContainerStarted","Data":"a8e540df364fda3e7bc933949937989eb7529d08167d1c351cacd1537473fd50"} Jul 06 22:24:42.299828 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:42.299811 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" event={"ID":"fa5ba8dd-b8b9-411b-b61b-eefe3718030e","Type":"ContainerStarted","Data":"6c6902bf8f95ab8a8f8b033f5c8b0f48ab143385a5f89a1fa9cfc1d217c44e58"} Jul 06 22:24:42.337363 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:42.337341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:42.337461 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:42.337440 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:42.337524 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:42.337511 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls podName:ad820355-d3fd-40bc-9cfc-ecf47498df29 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:43.337474803 +0000 UTC m=+50.731068592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qm426" (UID: "ad820355-d3fd-40bc-9cfc-ecf47498df29") : secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:43.244273 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:43.244235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6npjm\" (UID: \"478ad560-6302-497f-980d-8e920eebab4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:24:43.244739 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:43.244475 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:24:43.244739 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:43.244562 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert podName:478ad560-6302-497f-980d-8e920eebab4e nodeName:}" failed. No retries permitted until 2026-07-06 22:24:45.244540881 +0000 UTC m=+52.638134674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6npjm" (UID: "478ad560-6302-497f-980d-8e920eebab4e") : secret "networking-console-plugin-cert" not found Jul 06 22:24:43.345004 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:43.344971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:43.345175 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:43.345145 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:43.345225 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:43.345215 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls podName:ad820355-d3fd-40bc-9cfc-ecf47498df29 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:45.345193108 +0000 UTC m=+52.738786919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qm426" (UID: "ad820355-d3fd-40bc-9cfc-ecf47498df29") : secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:43.849160 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:43.849123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:43.849354 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:43.849240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:43.849354 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:43.849300 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:24:43.849354 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:43.849325 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5dfbb746-l26xr: secret "image-registry-tls" not found Jul 06 22:24:43.849533 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:43.849387 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls podName:d415ddbe-a70d-4d3e-8574-6d29e7c61ee3 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:59.849368096 +0000 UTC m=+67.242961900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls") pod "image-registry-7b5dfbb746-l26xr" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3") : secret "image-registry-tls" not found Jul 06 22:24:43.849533 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:43.849411 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:24:43.849533 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:43.849467 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls podName:3559f127-6a66-4abe-a961-a3da19ef7568 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:59.849453633 +0000 UTC m=+67.243047440 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls") pod "dns-default-s66th" (UID: "3559f127-6a66-4abe-a961-a3da19ef7568") : secret "dns-default-metrics-tls" not found Jul 06 22:24:45.263431 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:45.263390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6npjm\" (UID: \"478ad560-6302-497f-980d-8e920eebab4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:24:45.263817 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:45.263572 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:24:45.263817 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:45.263636 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert podName:478ad560-6302-497f-980d-8e920eebab4e nodeName:}" failed. No retries permitted until 2026-07-06 22:24:49.263618547 +0000 UTC m=+56.657212359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6npjm" (UID: "478ad560-6302-497f-980d-8e920eebab4e") : secret "networking-console-plugin-cert" not found Jul 06 22:24:45.364350 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:45.364320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:45.364511 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:45.364459 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:45.364558 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:45.364528 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls podName:ad820355-d3fd-40bc-9cfc-ecf47498df29 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:49.364511144 +0000 UTC m=+56.758104953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qm426" (UID: "ad820355-d3fd-40bc-9cfc-ecf47498df29") : secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:46.311303 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:46.311264 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" event={"ID":"fa5ba8dd-b8b9-411b-b61b-eefe3718030e","Type":"ContainerStarted","Data":"53722110a3964c5deb71cbcf09b4e1103903708faaf7bcd3b6171f8d5cc05b39"} Jul 06 22:24:46.312844 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:46.312814 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" event={"ID":"52941bfe-7acf-49aa-8678-07377455f1a7","Type":"ContainerStarted","Data":"7dbf00df24f86be6d7053e6f5a01ee6457a574ce645bd44d7f3bdd2287a72fa4"} Jul 06 22:24:46.314428 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:46.314408 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/0.log" Jul 06 22:24:46.314563 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:46.314440 2564 generic.go:356] "Generic (PLEG): container finished" podID="b83d6b8c-5f51-4021-b340-da7ae99d4a46" containerID="2a0521ff61a609c877ec34d733d8edfae7f35d8f539a81a0d66504bd7dd403e1" exitCode=255 Jul 06 22:24:46.314563 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:46.314465 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" event={"ID":"b83d6b8c-5f51-4021-b340-da7ae99d4a46","Type":"ContainerDied","Data":"2a0521ff61a609c877ec34d733d8edfae7f35d8f539a81a0d66504bd7dd403e1"} Jul 06 22:24:46.314673 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:46.314660 2564 scope.go:117] "RemoveContainer" containerID="2a0521ff61a609c877ec34d733d8edfae7f35d8f539a81a0d66504bd7dd403e1" Jul 06 22:24:46.331226 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:46.331190 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" podStartSLOduration=1.722311066 podStartE2EDuration="5.331177745s" totalImagesPullingTime="3.608866679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:46.329669044 +0000 UTC m=+53.723262876" watchObservedRunningTime="2026-07-06 22:24:46.331177745 +0000 UTC m=+53.724771556" Jul 06 22:24:46.364010 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:46.363962 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" podStartSLOduration=1.903083798 podStartE2EDuration="5.363943076s" totalImagesPullingTime="3.460859278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:46.362647542 +0000 UTC m=+53.756241355" watchObservedRunningTime="2026-07-06 22:24:46.363943076 +0000 UTC m=+53.757536889" Jul 06 22:24:47.043646 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.043563 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cjtvh"] Jul 06 22:24:47.061324 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.061275 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cjtvh"] Jul 06 22:24:47.061477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.061416 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.064044 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.064018 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 22:24:47.064044 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.064040 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bgz5b\"" Jul 06 22:24:47.064240 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.064058 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 22:24:47.181025 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.180993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.181194 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.181035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spkjv\" (UniqueName: \"kubernetes.io/projected/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-api-access-spkjv\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.181194 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.181118 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/49a462cf-b293-4f41-bb42-a3ed6f6366d8-data-volume\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.181194 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.181157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/49a462cf-b293-4f41-bb42-a3ed6f6366d8-crio-socket\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.181194 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.181184 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.282314 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.282282 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/49a462cf-b293-4f41-bb42-a3ed6f6366d8-crio-socket\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.282314 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.282319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.282554 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:47.282442 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:24:47.282554 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.282505 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/49a462cf-b293-4f41-bb42-a3ed6f6366d8-crio-socket\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.282554 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.282524 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.282651 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:47.282567 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:24:47.282651 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.282574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spkjv\" (UniqueName: \"kubernetes.io/projected/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-api-access-spkjv\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.282651 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:47.282607 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls podName:49a462cf-b293-4f41-bb42-a3ed6f6366d8 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:47.782579645 +0000 UTC m=+55.176173442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjtvh" (UID: "49a462cf-b293-4f41-bb42-a3ed6f6366d8") : secret "insights-runtime-extractor-tls" not found Jul 06 22:24:47.282651 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:47.282636 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm podName:49a462cf-b293-4f41-bb42-a3ed6f6366d8 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:47.782625612 +0000 UTC m=+55.176219444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjtvh" (UID: "49a462cf-b293-4f41-bb42-a3ed6f6366d8") : configmap "kube-rbac-proxy" not found Jul 06 22:24:47.282780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.282702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/49a462cf-b293-4f41-bb42-a3ed6f6366d8-data-volume\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.283020 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.283005 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/49a462cf-b293-4f41-bb42-a3ed6f6366d8-data-volume\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.293588 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.293555 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spkjv\" (UniqueName: \"kubernetes.io/projected/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-api-access-spkjv\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.321988 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.321931 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:24:47.322333 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.322319 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/0.log" Jul 06 22:24:47.322377 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.322351 2564 generic.go:356] "Generic (PLEG): container finished" podID="b83d6b8c-5f51-4021-b340-da7ae99d4a46" containerID="6d1f30bca36aa8430ec47c4b8a866ff75ae430632f1c2a88d73f8900e199f968" exitCode=255 Jul 06 22:24:47.322433 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.322419 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" event={"ID":"b83d6b8c-5f51-4021-b340-da7ae99d4a46","Type":"ContainerDied","Data":"6d1f30bca36aa8430ec47c4b8a866ff75ae430632f1c2a88d73f8900e199f968"} Jul 06 22:24:47.333143 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.333121 2564 scope.go:117] "RemoveContainer" containerID="2a0521ff61a609c877ec34d733d8edfae7f35d8f539a81a0d66504bd7dd403e1" Jul 06 22:24:47.333244 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.333210 2564 scope.go:117] "RemoveContainer" containerID="6d1f30bca36aa8430ec47c4b8a866ff75ae430632f1c2a88d73f8900e199f968" Jul 06 22:24:47.333365 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:47.333348 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-4gsbp_openshift-console-operator(b83d6b8c-5f51-4021-b340-da7ae99d4a46)\"" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" podUID="b83d6b8c-5f51-4021-b340-da7ae99d4a46" Jul 06 22:24:47.786959 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.786919 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.787123 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.787036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:47.787123 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:47.787076 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:24:47.787196 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:47.787155 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls podName:49a462cf-b293-4f41-bb42-a3ed6f6366d8 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:48.787140125 +0000 UTC m=+56.180733926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjtvh" (UID: "49a462cf-b293-4f41-bb42-a3ed6f6366d8") : secret "insights-runtime-extractor-tls" not found Jul 06 22:24:47.787196 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:47.787162 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:24:47.787267 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:47.787227 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm podName:49a462cf-b293-4f41-bb42-a3ed6f6366d8 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:48.787212624 +0000 UTC m=+56.180806430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjtvh" (UID: "49a462cf-b293-4f41-bb42-a3ed6f6366d8") : configmap "kube-rbac-proxy" not found Jul 06 22:24:47.840102 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.840069 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-pb59v"] Jul 06 22:24:47.867894 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.867869 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-pb59v"] Jul 06 22:24:47.868044 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.867972 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pb59v" Jul 06 22:24:47.870651 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.870623 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 22:24:47.871895 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.871871 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8g6lw\"" Jul 06 22:24:47.871983 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.871879 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 22:24:47.988170 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:47.988137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw8zg\" (UniqueName: \"kubernetes.io/projected/366fbf4a-d6ce-48f7-be59-ac5e2a7e08dc-kube-api-access-mw8zg\") pod \"migrator-d57d58cc9-pb59v\" (UID: \"366fbf4a-d6ce-48f7-be59-ac5e2a7e08dc\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pb59v" Jul 06 22:24:48.088824 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:48.088801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8zg\" (UniqueName: \"kubernetes.io/projected/366fbf4a-d6ce-48f7-be59-ac5e2a7e08dc-kube-api-access-mw8zg\") pod \"migrator-d57d58cc9-pb59v\" (UID: \"366fbf4a-d6ce-48f7-be59-ac5e2a7e08dc\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pb59v" Jul 06 22:24:48.096631 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:48.096608 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw8zg\" (UniqueName: \"kubernetes.io/projected/366fbf4a-d6ce-48f7-be59-ac5e2a7e08dc-kube-api-access-mw8zg\") pod \"migrator-d57d58cc9-pb59v\" (UID: \"366fbf4a-d6ce-48f7-be59-ac5e2a7e08dc\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pb59v" Jul 06 22:24:48.177130 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:48.177099 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pb59v" Jul 06 22:24:48.294222 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:48.294187 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-pb59v"] Jul 06 22:24:48.296964 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:24:48.296924 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366fbf4a_d6ce_48f7_be59_ac5e2a7e08dc.slice/crio-6847e9a5e0048a6a84c93864a0071582fa05a27f98346d7d2cff4809ebba2e79 WatchSource:0}: Error finding container 6847e9a5e0048a6a84c93864a0071582fa05a27f98346d7d2cff4809ebba2e79: Status 404 returned error can't find the container with id 6847e9a5e0048a6a84c93864a0071582fa05a27f98346d7d2cff4809ebba2e79 Jul 06 22:24:48.326230 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:48.326214 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:24:48.326615 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:48.326595 2564 scope.go:117] "RemoveContainer" containerID="6d1f30bca36aa8430ec47c4b8a866ff75ae430632f1c2a88d73f8900e199f968" Jul 06 22:24:48.326781 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:48.326757 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-4gsbp_openshift-console-operator(b83d6b8c-5f51-4021-b340-da7ae99d4a46)\"" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" podUID="b83d6b8c-5f51-4021-b340-da7ae99d4a46" Jul 06 22:24:48.327575 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:48.327547 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pb59v" event={"ID":"366fbf4a-d6ce-48f7-be59-ac5e2a7e08dc","Type":"ContainerStarted","Data":"6847e9a5e0048a6a84c93864a0071582fa05a27f98346d7d2cff4809ebba2e79"} Jul 06 22:24:48.436592 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:48.436514 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lvssm_f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05/dns-node-resolver/0.log" Jul 06 22:24:48.796525 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:48.796425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:48.796677 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:48.796576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:48.796677 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:48.796591 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:24:48.796677 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:48.796662 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:24:48.796823 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:48.796667 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls podName:49a462cf-b293-4f41-bb42-a3ed6f6366d8 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:50.796645061 +0000 UTC m=+58.190238863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjtvh" (UID: "49a462cf-b293-4f41-bb42-a3ed6f6366d8") : secret "insights-runtime-extractor-tls" not found Jul 06 22:24:48.796823 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:48.796721 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm podName:49a462cf-b293-4f41-bb42-a3ed6f6366d8 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:50.796706901 +0000 UTC m=+58.190300693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjtvh" (UID: "49a462cf-b293-4f41-bb42-a3ed6f6366d8") : configmap "kube-rbac-proxy" not found Jul 06 22:24:49.300711 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:49.300685 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6npjm\" (UID: \"478ad560-6302-497f-980d-8e920eebab4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:24:49.300863 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:49.300844 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:24:49.300929 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:49.300919 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert podName:478ad560-6302-497f-980d-8e920eebab4e nodeName:}" failed. No retries permitted until 2026-07-06 22:24:57.300898697 +0000 UTC m=+64.694492506 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6npjm" (UID: "478ad560-6302-497f-980d-8e920eebab4e") : secret "networking-console-plugin-cert" not found Jul 06 22:24:49.332857 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:49.332827 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pb59v" event={"ID":"366fbf4a-d6ce-48f7-be59-ac5e2a7e08dc","Type":"ContainerStarted","Data":"ead8a480522102d5c9cfa728d985a51221cf89661fa7b5f9c25f5195b626d756"} Jul 06 22:24:49.333148 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:49.332876 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pb59v" event={"ID":"366fbf4a-d6ce-48f7-be59-ac5e2a7e08dc","Type":"ContainerStarted","Data":"9157a249a594a33d083d2f5071165cb28a681d4b9b2639c6632f4309a033d76d"} Jul 06 22:24:49.349852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:49.349811 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pb59v" podStartSLOduration=1.450839449 podStartE2EDuration="2.349799013s" totalImagesPullingTime="898.959564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:49.348937164 +0000 UTC m=+56.742530976" watchObservedRunningTime="2026-07-06 22:24:49.349799013 +0000 UTC m=+56.743392825" Jul 06 22:24:49.402041 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:49.402012 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:49.402169 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:49.402149 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:49.402209 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:49.402199 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls podName:ad820355-d3fd-40bc-9cfc-ecf47498df29 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:57.402186563 +0000 UTC m=+64.795780352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qm426" (UID: "ad820355-d3fd-40bc-9cfc-ecf47498df29") : secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:49.835731 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:49.835702 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xrgz2_8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8/node-ca/0.log" Jul 06 22:24:50.437152 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:50.437118 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w7ps6_7a500ff8-c870-462b-b137-4eeaa777a1db/serve-healthcheck-canary/0.log" Jul 06 22:24:50.813777 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:50.813697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:50.813919 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:50.813818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:50.813919 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:50.813861 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:24:50.813983 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:50.813934 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls podName:49a462cf-b293-4f41-bb42-a3ed6f6366d8 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:54.813916426 +0000 UTC m=+62.207510236 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjtvh" (UID: "49a462cf-b293-4f41-bb42-a3ed6f6366d8") : secret "insights-runtime-extractor-tls" not found Jul 06 22:24:50.813983 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:50.813935 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:24:50.814057 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:50.813988 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm podName:49a462cf-b293-4f41-bb42-a3ed6f6366d8 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:54.813974375 +0000 UTC m=+62.207568181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjtvh" (UID: "49a462cf-b293-4f41-bb42-a3ed6f6366d8") : configmap "kube-rbac-proxy" not found Jul 06 22:24:51.942874 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:51.942833 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:51.943252 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:51.942894 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:24:51.943252 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:51.943220 2564 scope.go:117] "RemoveContainer" containerID="6d1f30bca36aa8430ec47c4b8a866ff75ae430632f1c2a88d73f8900e199f968" Jul 06 22:24:51.943376 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:51.943357 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-4gsbp_openshift-console-operator(b83d6b8c-5f51-4021-b340-da7ae99d4a46)\"" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" podUID="b83d6b8c-5f51-4021-b340-da7ae99d4a46" Jul 06 22:24:54.848075 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:54.848038 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:54.848507 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:54.848136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:24:54.848507 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:54.848160 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:24:54.848507 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:54.848223 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm podName:49a462cf-b293-4f41-bb42-a3ed6f6366d8 nodeName:}" failed. No retries permitted until 2026-07-06 22:25:02.848207824 +0000 UTC m=+70.241801617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cjtvh" (UID: "49a462cf-b293-4f41-bb42-a3ed6f6366d8") : configmap "kube-rbac-proxy" not found Jul 06 22:24:54.848507 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:54.848273 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:24:54.848507 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:54.848328 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls podName:49a462cf-b293-4f41-bb42-a3ed6f6366d8 nodeName:}" failed. No retries permitted until 2026-07-06 22:25:02.848312446 +0000 UTC m=+70.241906250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cjtvh" (UID: "49a462cf-b293-4f41-bb42-a3ed6f6366d8") : secret "insights-runtime-extractor-tls" not found Jul 06 22:24:55.252102 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:55.252030 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x264m" Jul 06 22:24:57.368811 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:57.368775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6npjm\" (UID: \"478ad560-6302-497f-980d-8e920eebab4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:24:57.369164 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:57.368922 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:24:57.369164 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:57.368994 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert podName:478ad560-6302-497f-980d-8e920eebab4e nodeName:}" failed. No retries permitted until 2026-07-06 22:25:13.36897715 +0000 UTC m=+80.762570957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6npjm" (UID: "478ad560-6302-497f-980d-8e920eebab4e") : secret "networking-console-plugin-cert" not found Jul 06 22:24:57.470264 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:57.470221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:24:57.470404 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:57.470375 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:57.470445 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:24:57.470434 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls podName:ad820355-d3fd-40bc-9cfc-ecf47498df29 nodeName:}" failed. No retries permitted until 2026-07-06 22:25:13.470417998 +0000 UTC m=+80.864011792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qm426" (UID: "ad820355-d3fd-40bc-9cfc-ecf47498df29") : secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:58.883004 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:58.882964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:58.883446 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:58.883043 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:58.885851 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:58.885831 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 22:24:58.886912 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:58.886897 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 22:24:58.895785 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:58.895761 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07d32136-31d7-4613-bef2-2d540719426b-original-pull-secret\") pod \"global-pull-secret-syncer-nfsqr\" (UID: \"07d32136-31d7-4613-bef2-2d540719426b\") " pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:58.895785 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:58.895778 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3559859-d52e-4234-8521-b7d88e588f97-metrics-certs\") pod \"network-metrics-daemon-rl2l6\" (UID: \"b3559859-d52e-4234-8521-b7d88e588f97\") " pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:58.958246 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:58.958215 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfsqr" Jul 06 22:24:58.965375 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:58.965350 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wdmk\"" Jul 06 22:24:58.973635 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:58.973612 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rl2l6" Jul 06 22:24:58.983893 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:58.983852 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvv6\" (UniqueName: \"kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6\") pod \"network-check-target-wwz95\" (UID: \"5b90408c-e7fb-40a2-91cd-a2ed3c77d218\") " pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:58.986716 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:58.986695 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 22:24:58.996882 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:58.996853 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 22:24:59.008211 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:59.008156 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whvv6\" (UniqueName: \"kubernetes.io/projected/5b90408c-e7fb-40a2-91cd-a2ed3c77d218-kube-api-access-whvv6\") pod \"network-check-target-wwz95\" (UID: \"5b90408c-e7fb-40a2-91cd-a2ed3c77d218\") " pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:59.084923 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:59.084891 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nfsqr"] Jul 06 22:24:59.088239 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:24:59.088214 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d32136_31d7_4613_bef2_2d540719426b.slice/crio-f5342e4c22526881d59b3c3dad454ef956563c672ae891b01cf1137e42d3dc37 WatchSource:0}: Error finding container f5342e4c22526881d59b3c3dad454ef956563c672ae891b01cf1137e42d3dc37: Status 404 returned error can't find the container with id f5342e4c22526881d59b3c3dad454ef956563c672ae891b01cf1137e42d3dc37 Jul 06 22:24:59.099002 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:59.098939 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rl2l6"] Jul 06 22:24:59.101165 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:24:59.101144 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3559859_d52e_4234_8521_b7d88e588f97.slice/crio-beea76a56c6e2057d208c100b6d0b131c03fff2910145eca16197d0add006a6d WatchSource:0}: Error finding container beea76a56c6e2057d208c100b6d0b131c03fff2910145eca16197d0add006a6d: Status 404 returned error can't find the container with id beea76a56c6e2057d208c100b6d0b131c03fff2910145eca16197d0add006a6d Jul 06 22:24:59.252845 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:59.252771 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-czcdn\"" Jul 06 22:24:59.260863 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:59.260838 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:24:59.364029 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:59.363994 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rl2l6" event={"ID":"b3559859-d52e-4234-8521-b7d88e588f97","Type":"ContainerStarted","Data":"beea76a56c6e2057d208c100b6d0b131c03fff2910145eca16197d0add006a6d"} Jul 06 22:24:59.365193 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:59.365168 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nfsqr" event={"ID":"07d32136-31d7-4613-bef2-2d540719426b","Type":"ContainerStarted","Data":"f5342e4c22526881d59b3c3dad454ef956563c672ae891b01cf1137e42d3dc37"} Jul 06 22:24:59.378819 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:59.378798 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wwz95"] Jul 06 22:24:59.381674 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:24:59.381654 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b90408c_e7fb_40a2_91cd_a2ed3c77d218.slice/crio-0eb927f9a84c25a519750174556cf5825868e6a70f5245caea3c281b92a1c925 WatchSource:0}: Error finding container 0eb927f9a84c25a519750174556cf5825868e6a70f5245caea3c281b92a1c925: Status 404 returned error can't find the container with id 0eb927f9a84c25a519750174556cf5825868e6a70f5245caea3c281b92a1c925 Jul 06 22:24:59.891021 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:59.890986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:59.891475 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:59.891061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:24:59.893592 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:59.893556 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3559f127-6a66-4abe-a961-a3da19ef7568-metrics-tls\") pod \"dns-default-s66th\" (UID: \"3559f127-6a66-4abe-a961-a3da19ef7568\") " pod="openshift-dns/dns-default-s66th" Jul 06 22:24:59.893697 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:24:59.893683 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls\") pod \"image-registry-7b5dfbb746-l26xr\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:25:00.073444 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:00.073410 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-62ptd\"" Jul 06 22:25:00.080842 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:00.080809 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:25:00.096962 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:00.096736 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mrg4w\"" Jul 06 22:25:00.104216 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:00.104101 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s66th" Jul 06 22:25:00.265467 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:00.265396 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b5dfbb746-l26xr"] Jul 06 22:25:00.287926 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:00.287868 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s66th"] Jul 06 22:25:00.370906 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:00.370868 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wwz95" event={"ID":"5b90408c-e7fb-40a2-91cd-a2ed3c77d218","Type":"ContainerStarted","Data":"0eb927f9a84c25a519750174556cf5825868e6a70f5245caea3c281b92a1c925"} Jul 06 22:25:00.449007 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:25:00.448933 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3559f127_6a66_4abe_a961_a3da19ef7568.slice/crio-adeeb87a9d854ea07579bf2758042cf81a9add6ef1ae22c62c2bda63ecd0f915 WatchSource:0}: Error finding container adeeb87a9d854ea07579bf2758042cf81a9add6ef1ae22c62c2bda63ecd0f915: Status 404 returned error can't find the container with id adeeb87a9d854ea07579bf2758042cf81a9add6ef1ae22c62c2bda63ecd0f915 Jul 06 22:25:00.449435 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:25:00.449409 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd415ddbe_a70d_4d3e_8574_6d29e7c61ee3.slice/crio-c056adf42644c4dd61a8d3abfd7eb2c5235cc30f8a14f0d4bdede3e33a6278ec WatchSource:0}: Error finding container c056adf42644c4dd61a8d3abfd7eb2c5235cc30f8a14f0d4bdede3e33a6278ec: Status 404 returned error can't find the container with id c056adf42644c4dd61a8d3abfd7eb2c5235cc30f8a14f0d4bdede3e33a6278ec Jul 06 22:25:01.376113 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:01.376075 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s66th" event={"ID":"3559f127-6a66-4abe-a961-a3da19ef7568","Type":"ContainerStarted","Data":"adeeb87a9d854ea07579bf2758042cf81a9add6ef1ae22c62c2bda63ecd0f915"} Jul 06 22:25:01.378111 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:01.378082 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rl2l6" event={"ID":"b3559859-d52e-4234-8521-b7d88e588f97","Type":"ContainerStarted","Data":"9d108b4709e0aba95152c8b76080e4232349c04babca25a3a7e4b86852d410ec"} Jul 06 22:25:01.378251 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:01.378138 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rl2l6" event={"ID":"b3559859-d52e-4234-8521-b7d88e588f97","Type":"ContainerStarted","Data":"77a172673f365f4a090647176170345707c5f03fc72ff9eb1b491086a656f928"} Jul 06 22:25:01.379886 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:01.379854 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" event={"ID":"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3","Type":"ContainerStarted","Data":"6a4b8d9c21144ad43b7cccafe32c2f2413be332f1d5aca051d8c38138a4589fb"} Jul 06 22:25:01.379991 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:01.379922 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:25:01.379991 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:01.379942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" event={"ID":"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3","Type":"ContainerStarted","Data":"c056adf42644c4dd61a8d3abfd7eb2c5235cc30f8a14f0d4bdede3e33a6278ec"} Jul 06 22:25:01.394671 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:01.394630 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rl2l6" podStartSLOduration=65.995875828 podStartE2EDuration="1m7.394616347s" totalImagesPullingTime="1.398740519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:01.393875833 +0000 UTC m=+68.787469643" watchObservedRunningTime="2026-07-06 22:25:01.394616347 +0000 UTC m=+68.788210157" Jul 06 22:25:01.419394 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:01.419040 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" podStartSLOduration=67.419021428 podStartE2EDuration="1m7.419021428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:01.418224004 +0000 UTC m=+68.811817818" watchObservedRunningTime="2026-07-06 22:25:01.419021428 +0000 UTC m=+68.812615245" Jul 06 22:25:02.921416 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:02.921363 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:25:02.921888 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:02.921464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:25:02.922118 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:02.922093 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49a462cf-b293-4f41-bb42-a3ed6f6366d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:25:02.924014 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:02.923987 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49a462cf-b293-4f41-bb42-a3ed6f6366d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cjtvh\" (UID: \"49a462cf-b293-4f41-bb42-a3ed6f6366d8\") " pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:25:02.973433 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:02.973402 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bgz5b\"" Jul 06 22:25:02.981868 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:02.981812 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cjtvh" Jul 06 22:25:04.037897 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:04.037868 2564 scope.go:117] "RemoveContainer" containerID="6d1f30bca36aa8430ec47c4b8a866ff75ae430632f1c2a88d73f8900e199f968" Jul 06 22:25:05.268246 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.268222 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cjtvh"] Jul 06 22:25:05.396341 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.396307 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nfsqr" event={"ID":"07d32136-31d7-4613-bef2-2d540719426b","Type":"ContainerStarted","Data":"b086a27e1225333a8afba25e9080361939d45adc084e516999ba478cb77629ae"} Jul 06 22:25:05.403378 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.403146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wwz95" event={"ID":"5b90408c-e7fb-40a2-91cd-a2ed3c77d218","Type":"ContainerStarted","Data":"85c42d778b6cd0f7576fc94106128e84f76df5541e9490a7585ffc46dabed118"} Jul 06 22:25:05.403378 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.403267 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:25:05.405187 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.405168 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:25:05.405302 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.405259 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" event={"ID":"b83d6b8c-5f51-4021-b340-da7ae99d4a46","Type":"ContainerStarted","Data":"861955c3d1661f288e4a39d9019137a0d5c564bc7134461fb7ceb4ce1b4d0195"} Jul 06 22:25:05.405572 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.405533 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:25:05.412294 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.412268 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s66th" event={"ID":"3559f127-6a66-4abe-a961-a3da19ef7568","Type":"ContainerStarted","Data":"2c56d8f176ec2f79c2b5093046d1fc4141a719a8859813e86c5f6b197acfb9f7"} Jul 06 22:25:05.412410 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.412336 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s66th" event={"ID":"3559f127-6a66-4abe-a961-a3da19ef7568","Type":"ContainerStarted","Data":"932a8ae09625cbcc2b7bfce0adcd9bb22a8adb061e09cb7494a3e2c0bf139aa2"} Jul 06 22:25:05.412410 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.412364 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s66th" Jul 06 22:25:05.414374 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.414349 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjtvh" event={"ID":"49a462cf-b293-4f41-bb42-a3ed6f6366d8","Type":"ContainerStarted","Data":"c55577770c3847ef3a2fca40777cf984ac1ea2d73e58962c2caa6dd25663891a"} Jul 06 22:25:05.414631 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.414585 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nfsqr" podStartSLOduration=65.384131482 podStartE2EDuration="1m11.414568631s" totalImagesPullingTime="6.030437149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:05.413330506 +0000 UTC m=+72.806924319" watchObservedRunningTime="2026-07-06 22:25:05.414568631 +0000 UTC m=+72.808162444" Jul 06 22:25:05.432305 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.432267 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wwz95" podStartSLOduration=65.704773555 podStartE2EDuration="1m11.432258963s" totalImagesPullingTime="5.727485408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:05.430983894 +0000 UTC m=+72.824577708" watchObservedRunningTime="2026-07-06 22:25:05.432258963 +0000 UTC m=+72.825852774" Jul 06 22:25:05.447107 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.447050 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s66th" podStartSLOduration=33.786234766 podStartE2EDuration="38.447034492s" totalImagesPullingTime="4.660799726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:05.446806464 +0000 UTC m=+72.840400275" watchObservedRunningTime="2026-07-06 22:25:05.447034492 +0000 UTC m=+72.840628306" Jul 06 22:25:05.463399 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:05.463361 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" podStartSLOduration=20.913351858 podStartE2EDuration="24.463350207s" totalImagesPullingTime="3.549998349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:05.462649773 +0000 UTC m=+72.856243587" watchObservedRunningTime="2026-07-06 22:25:05.463350207 +0000 UTC m=+72.856944027" Jul 06 22:25:06.007263 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:06.007228 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-4gsbp" Jul 06 22:25:09.433071 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.433038 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjtvh" event={"ID":"49a462cf-b293-4f41-bb42-a3ed6f6366d8","Type":"ContainerStarted","Data":"97584e6ccc86243cfe49bc312d10051aa1b3ad14efde2263aab95a13986c4b2b"} Jul 06 22:25:09.601416 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.601388 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf"] Jul 06 22:25:09.603168 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.603151 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf" Jul 06 22:25:09.606085 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.606062 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xdtjf\"" Jul 06 22:25:09.607566 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.607515 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 22:25:09.608174 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.607977 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 22:25:09.608174 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.607989 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 22:25:09.608319 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.608199 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 22:25:09.620496 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.620465 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf"] Jul 06 22:25:09.731367 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.731308 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-q7fbr"] Jul 06 22:25:09.733290 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.733272 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-q7fbr" Jul 06 22:25:09.735961 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.735939 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7mnqn\"" Jul 06 22:25:09.736199 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.736172 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 22:25:09.736421 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.736408 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 22:25:09.747789 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.747768 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-q7fbr"] Jul 06 22:25:09.776101 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.776076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c8095ba-ef0e-40cf-929c-fd9cf63660ee-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf\" (UID: \"0c8095ba-ef0e-40cf-929c-fd9cf63660ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf" Jul 06 22:25:09.776197 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.776105 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5tbq\" (UniqueName: \"kubernetes.io/projected/0c8095ba-ef0e-40cf-929c-fd9cf63660ee-kube-api-access-z5tbq\") pod \"managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf\" (UID: \"0c8095ba-ef0e-40cf-929c-fd9cf63660ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf" Jul 06 22:25:09.876399 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.876373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smmnk\" (UniqueName: \"kubernetes.io/projected/e7d80c93-4f99-459b-9532-4255c1a8edc0-kube-api-access-smmnk\") pod \"downloads-685bfb5f64-q7fbr\" (UID: \"e7d80c93-4f99-459b-9532-4255c1a8edc0\") " pod="openshift-console/downloads-685bfb5f64-q7fbr" Jul 06 22:25:09.876561 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.876510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c8095ba-ef0e-40cf-929c-fd9cf63660ee-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf\" (UID: \"0c8095ba-ef0e-40cf-929c-fd9cf63660ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf" Jul 06 22:25:09.876561 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.876540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5tbq\" (UniqueName: \"kubernetes.io/projected/0c8095ba-ef0e-40cf-929c-fd9cf63660ee-kube-api-access-z5tbq\") pod \"managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf\" (UID: \"0c8095ba-ef0e-40cf-929c-fd9cf63660ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf" Jul 06 22:25:09.878914 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.878890 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c8095ba-ef0e-40cf-929c-fd9cf63660ee-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf\" (UID: \"0c8095ba-ef0e-40cf-929c-fd9cf63660ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf" Jul 06 22:25:09.884722 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.884700 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5tbq\" (UniqueName: \"kubernetes.io/projected/0c8095ba-ef0e-40cf-929c-fd9cf63660ee-kube-api-access-z5tbq\") pod \"managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf\" (UID: \"0c8095ba-ef0e-40cf-929c-fd9cf63660ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf" Jul 06 22:25:09.922499 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.922467 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf" Jul 06 22:25:09.978453 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.978348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smmnk\" (UniqueName: \"kubernetes.io/projected/e7d80c93-4f99-459b-9532-4255c1a8edc0-kube-api-access-smmnk\") pod \"downloads-685bfb5f64-q7fbr\" (UID: \"e7d80c93-4f99-459b-9532-4255c1a8edc0\") " pod="openshift-console/downloads-685bfb5f64-q7fbr" Jul 06 22:25:09.992238 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:09.991153 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smmnk\" (UniqueName: \"kubernetes.io/projected/e7d80c93-4f99-459b-9532-4255c1a8edc0-kube-api-access-smmnk\") pod \"downloads-685bfb5f64-q7fbr\" (UID: \"e7d80c93-4f99-459b-9532-4255c1a8edc0\") " pod="openshift-console/downloads-685bfb5f64-q7fbr" Jul 06 22:25:10.041872 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:10.041842 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-q7fbr" Jul 06 22:25:10.074160 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:10.074094 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf"] Jul 06 22:25:10.079118 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:25:10.079093 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c8095ba_ef0e_40cf_929c_fd9cf63660ee.slice/crio-40cd46e8adda42707e77d1bd6f574de36b9a6c2e4d2bbeef6337e095feb91ec7 WatchSource:0}: Error finding container 40cd46e8adda42707e77d1bd6f574de36b9a6c2e4d2bbeef6337e095feb91ec7: Status 404 returned error can't find the container with id 40cd46e8adda42707e77d1bd6f574de36b9a6c2e4d2bbeef6337e095feb91ec7 Jul 06 22:25:10.185899 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:10.185866 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-q7fbr"] Jul 06 22:25:10.191093 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:25:10.191067 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d80c93_4f99_459b_9532_4255c1a8edc0.slice/crio-384c9edd0d72f9b633d176827f8a8a9273d28b0301d80d376d0e26310d0e8088 WatchSource:0}: Error finding container 384c9edd0d72f9b633d176827f8a8a9273d28b0301d80d376d0e26310d0e8088: Status 404 returned error can't find the container with id 384c9edd0d72f9b633d176827f8a8a9273d28b0301d80d376d0e26310d0e8088 Jul 06 22:25:10.438462 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:10.438420 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf" event={"ID":"0c8095ba-ef0e-40cf-929c-fd9cf63660ee","Type":"ContainerStarted","Data":"40cd46e8adda42707e77d1bd6f574de36b9a6c2e4d2bbeef6337e095feb91ec7"} Jul 06 22:25:10.440778 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:10.440748 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjtvh" event={"ID":"49a462cf-b293-4f41-bb42-a3ed6f6366d8","Type":"ContainerStarted","Data":"fea02c94479b52b7f07dc8340eed39a023ccb361e960985f565449e5dd2fb7de"} Jul 06 22:25:10.441963 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:10.441936 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-q7fbr" event={"ID":"e7d80c93-4f99-459b-9532-4255c1a8edc0","Type":"ContainerStarted","Data":"384c9edd0d72f9b633d176827f8a8a9273d28b0301d80d376d0e26310d0e8088"} Jul 06 22:25:13.412116 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:13.412078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6npjm\" (UID: \"478ad560-6302-497f-980d-8e920eebab4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:25:13.415050 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:13.414992 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/478ad560-6302-497f-980d-8e920eebab4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6npjm\" (UID: \"478ad560-6302-497f-980d-8e920eebab4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:25:13.513105 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:13.513000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:25:13.515944 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:13.515915 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad820355-d3fd-40bc-9cfc-ecf47498df29-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qm426\" (UID: \"ad820355-d3fd-40bc-9cfc-ecf47498df29\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:25:13.662820 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:13.662734 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cs7gv\"" Jul 06 22:25:13.668524 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:13.668457 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" Jul 06 22:25:13.768893 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:13.768862 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qwr62\"" Jul 06 22:25:13.778283 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:13.778062 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" Jul 06 22:25:13.881347 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:13.881238 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6npjm"] Jul 06 22:25:13.884674 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:25:13.884641 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478ad560_6302_497f_980d_8e920eebab4e.slice/crio-cbe9e7e5ca66335f833a180ff9e78f536e1f7d90976b963e4ed2fee0732dc478 WatchSource:0}: Error finding container cbe9e7e5ca66335f833a180ff9e78f536e1f7d90976b963e4ed2fee0732dc478: Status 404 returned error can't find the container with id cbe9e7e5ca66335f833a180ff9e78f536e1f7d90976b963e4ed2fee0732dc478 Jul 06 22:25:13.946359 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:13.946286 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426"] Jul 06 22:25:13.950480 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:25:13.950450 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad820355_d3fd_40bc_9cfc_ecf47498df29.slice/crio-09cfd11fae92f07b62b0264b6c1263deccf38a9ab221bfe60826b60734a779cd WatchSource:0}: Error finding container 09cfd11fae92f07b62b0264b6c1263deccf38a9ab221bfe60826b60734a779cd: Status 404 returned error can't find the container with id 09cfd11fae92f07b62b0264b6c1263deccf38a9ab221bfe60826b60734a779cd Jul 06 22:25:14.461860 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:14.461824 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cjtvh" event={"ID":"49a462cf-b293-4f41-bb42-a3ed6f6366d8","Type":"ContainerStarted","Data":"bf80d6065285d359688eb5dc0f30437e3b02b277ff4bb5c519069f093fcc4b95"} Jul 06 22:25:14.463630 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:14.463571 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" event={"ID":"478ad560-6302-497f-980d-8e920eebab4e","Type":"ContainerStarted","Data":"cbe9e7e5ca66335f833a180ff9e78f536e1f7d90976b963e4ed2fee0732dc478"} Jul 06 22:25:14.466287 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:14.465685 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf" event={"ID":"0c8095ba-ef0e-40cf-929c-fd9cf63660ee","Type":"ContainerStarted","Data":"510de2ecacb3f11a256b8e11bcb1686897cbec6783493083a887a0a8a76bf342"} Jul 06 22:25:14.467720 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:14.467688 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" event={"ID":"ad820355-d3fd-40bc-9cfc-ecf47498df29","Type":"ContainerStarted","Data":"09cfd11fae92f07b62b0264b6c1263deccf38a9ab221bfe60826b60734a779cd"} Jul 06 22:25:14.481765 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:14.481715 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cjtvh" podStartSLOduration=19.122969053 podStartE2EDuration="27.481695816s" totalImagesPullingTime="8.358726763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:24:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:14.479052458 +0000 UTC m=+81.872646273" watchObservedRunningTime="2026-07-06 22:25:14.481695816 +0000 UTC m=+81.875289629" Jul 06 22:25:14.493795 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:14.493199 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b9c47df9d-rdmzf" podStartSLOduration=1.771564828 podStartE2EDuration="5.493181295s" totalImagesPullingTime="3.721616467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:14.493094725 +0000 UTC m=+81.886688538" watchObservedRunningTime="2026-07-06 22:25:14.493181295 +0000 UTC m=+81.886775105" Jul 06 22:25:15.422686 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:15.422657 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s66th" Jul 06 22:25:16.479378 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:16.479279 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" event={"ID":"ad820355-d3fd-40bc-9cfc-ecf47498df29","Type":"ContainerStarted","Data":"7c1e7270f493ab1164506ac6717d7ee28f60ce364e66e4630802bc5b0b5b362f"} Jul 06 22:25:16.481303 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:16.481274 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" event={"ID":"478ad560-6302-497f-980d-8e920eebab4e","Type":"ContainerStarted","Data":"3dc39c94f104dbef0220730069020ff4763eb62ed662c61c55bfbcb16c6a2d30"} Jul 06 22:25:16.500950 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:16.500899 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qm426" podStartSLOduration=33.233606749 podStartE2EDuration="35.500881098s" totalImagesPullingTime="2.267274349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:16.499839262 +0000 UTC m=+83.893433071" watchObservedRunningTime="2026-07-06 22:25:16.500881098 +0000 UTC m=+83.894474910" Jul 06 22:25:16.529804 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:16.529752 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6npjm" podStartSLOduration=33.275288134 podStartE2EDuration="35.529740536s" totalImagesPullingTime="2.254452402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:16.528820221 +0000 UTC m=+83.922414034" watchObservedRunningTime="2026-07-06 22:25:16.529740536 +0000 UTC m=+83.923334350" Jul 06 22:25:20.085711 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:20.085668 2564 patch_prober.go:28] interesting pod/image-registry-7b5dfbb746-l26xr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 22:25:20.086097 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:20.085734 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" podUID="d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 22:25:22.389369 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:22.389325 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:25:28.534181 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:28.534137 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-q7fbr" event={"ID":"e7d80c93-4f99-459b-9532-4255c1a8edc0","Type":"ContainerStarted","Data":"6e263c1242f05f5c66c660f9edd3296e0e1debef04fab639118ddc6521dab4e2"} Jul 06 22:25:28.534729 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:28.534352 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-q7fbr" Jul 06 22:25:28.558620 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:28.558592 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-q7fbr" Jul 06 22:25:28.559900 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:28.559855 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-q7fbr" podStartSLOduration=2.287480584 podStartE2EDuration="19.559835926s" totalImagesPullingTime="17.272355342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:28.557470109 +0000 UTC m=+95.951063963" watchObservedRunningTime="2026-07-06 22:25:28.559835926 +0000 UTC m=+95.953429739" Jul 06 22:25:30.208176 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.208143 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mvthp"] Jul 06 22:25:30.229824 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.229793 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.232999 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.232976 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 22:25:30.233141 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.233103 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 22:25:30.233210 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.233154 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 22:25:30.234130 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.234107 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-svfcn\"" Jul 06 22:25:30.234248 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.234139 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 22:25:30.337892 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.337855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-metrics-client-ca\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.338079 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.337904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-sys\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.338079 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.337939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-root\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.338079 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.337965 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.338079 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.338015 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-textfile\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.338079 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.338038 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-wtmp\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.338079 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.338059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-accelerators-collector-config\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.338345 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.338087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8chw\" (UniqueName: \"kubernetes.io/projected/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-kube-api-access-x8chw\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.338345 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.338138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-tls\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439206 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-tls\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439377 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-metrics-client-ca\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439377 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439248 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-sys\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439377 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-root\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439377 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439377 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-textfile\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439676 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439371 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-sys\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439676 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-wtmp\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439676 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439408 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-root\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439676 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-accelerators-collector-config\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439676 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8chw\" (UniqueName: \"kubernetes.io/projected/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-kube-api-access-x8chw\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439676 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439517 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-wtmp\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439979 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439790 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-textfile\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.439979 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.439939 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-metrics-client-ca\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.440077 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.440009 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-accelerators-collector-config\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.442001 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.441980 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.442121 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.442099 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-node-exporter-tls\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.448700 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.448675 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8chw\" (UniqueName: \"kubernetes.io/projected/4ddf5def-02a2-4cfa-844a-94f7dfb3c624-kube-api-access-x8chw\") pod \"node-exporter-mvthp\" (UID: \"4ddf5def-02a2-4cfa-844a-94f7dfb3c624\") " pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.540347 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:30.540265 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mvthp" Jul 06 22:25:30.582355 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:25:30.582320 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ddf5def_02a2_4cfa_844a_94f7dfb3c624.slice/crio-d810a664e70af3a7a9b100e54e9cfab16b7f711f727d9707f1715e2c90142780 WatchSource:0}: Error finding container d810a664e70af3a7a9b100e54e9cfab16b7f711f727d9707f1715e2c90142780: Status 404 returned error can't find the container with id d810a664e70af3a7a9b100e54e9cfab16b7f711f727d9707f1715e2c90142780 Jul 06 22:25:31.410383 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:31.410317 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b5dfbb746-l26xr"] Jul 06 22:25:31.549656 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:31.549624 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mvthp" event={"ID":"4ddf5def-02a2-4cfa-844a-94f7dfb3c624","Type":"ContainerStarted","Data":"d810a664e70af3a7a9b100e54e9cfab16b7f711f727d9707f1715e2c90142780"} Jul 06 22:25:32.555976 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:32.555933 2564 generic.go:356] "Generic (PLEG): container finished" podID="4ddf5def-02a2-4cfa-844a-94f7dfb3c624" containerID="47b75b1b558950c93f407ec092c77a77642a32242e84419cd02eaa5a3e856b4a" exitCode=0 Jul 06 22:25:32.555976 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:32.555979 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mvthp" event={"ID":"4ddf5def-02a2-4cfa-844a-94f7dfb3c624","Type":"ContainerDied","Data":"47b75b1b558950c93f407ec092c77a77642a32242e84419cd02eaa5a3e856b4a"} Jul 06 22:25:33.562739 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:33.562699 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mvthp" event={"ID":"4ddf5def-02a2-4cfa-844a-94f7dfb3c624","Type":"ContainerStarted","Data":"4a1fd4f8163bda68d0d8bbd3a9fd9f5fd5ff8082c60bdba280337941a989f4ba"} Jul 06 22:25:33.563292 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:33.562760 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mvthp" event={"ID":"4ddf5def-02a2-4cfa-844a-94f7dfb3c624","Type":"ContainerStarted","Data":"12d29522c5ea32b969bc0fdffe844ae0e3e4bc1aed2a97503e94aa1dfa529a63"} Jul 06 22:25:33.584183 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:33.584124 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mvthp" podStartSLOduration=1.888631063 podStartE2EDuration="3.584105971s" totalImagesPullingTime="1.590871968s" totalInitContainerRuntime="104.60294ms" isStatefulPod=true podCreationTimestamp="2026-07-06 22:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:33.582381014 +0000 UTC m=+100.975974827" watchObservedRunningTime="2026-07-06 22:25:33.584105971 +0000 UTC m=+100.977699784" Jul 06 22:25:34.948286 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:34.948248 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7"] Jul 06 22:25:35.014370 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:35.014337 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7"] Jul 06 22:25:35.014560 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:35.014444 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" Jul 06 22:25:35.017232 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:35.017207 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tll58\"" Jul 06 22:25:35.017388 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:35.017244 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 22:25:35.077041 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:35.077008 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4wnv\" (UniqueName: \"kubernetes.io/projected/1c423f82-8cf7-433f-99fc-31db7a423594-kube-api-access-v4wnv\") pod \"monitoring-plugin-d5dcff7cf-5x4n7\" (UID: \"1c423f82-8cf7-433f-99fc-31db7a423594\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" Jul 06 22:25:35.077213 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:35.077084 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c423f82-8cf7-433f-99fc-31db7a423594-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5x4n7\" (UID: \"1c423f82-8cf7-433f-99fc-31db7a423594\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" Jul 06 22:25:35.178397 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:35.178358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4wnv\" (UniqueName: \"kubernetes.io/projected/1c423f82-8cf7-433f-99fc-31db7a423594-kube-api-access-v4wnv\") pod \"monitoring-plugin-d5dcff7cf-5x4n7\" (UID: \"1c423f82-8cf7-433f-99fc-31db7a423594\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" Jul 06 22:25:35.178609 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:35.178423 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c423f82-8cf7-433f-99fc-31db7a423594-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5x4n7\" (UID: \"1c423f82-8cf7-433f-99fc-31db7a423594\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" Jul 06 22:25:35.178609 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:25:35.178560 2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 06 22:25:35.178723 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:25:35.178624 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c423f82-8cf7-433f-99fc-31db7a423594-monitoring-plugin-cert podName:1c423f82-8cf7-433f-99fc-31db7a423594 nodeName:}" failed. No retries permitted until 2026-07-06 22:25:35.678604851 +0000 UTC m=+103.072198660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1c423f82-8cf7-433f-99fc-31db7a423594-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-5x4n7" (UID: "1c423f82-8cf7-433f-99fc-31db7a423594") : secret "monitoring-plugin-cert" not found Jul 06 22:25:35.188462 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:35.188434 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4wnv\" (UniqueName: \"kubernetes.io/projected/1c423f82-8cf7-433f-99fc-31db7a423594-kube-api-access-v4wnv\") pod \"monitoring-plugin-d5dcff7cf-5x4n7\" (UID: \"1c423f82-8cf7-433f-99fc-31db7a423594\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" Jul 06 22:25:35.682481 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:35.682441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c423f82-8cf7-433f-99fc-31db7a423594-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5x4n7\" (UID: \"1c423f82-8cf7-433f-99fc-31db7a423594\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" Jul 06 22:25:35.685364 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:35.685336 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c423f82-8cf7-433f-99fc-31db7a423594-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5x4n7\" (UID: \"1c423f82-8cf7-433f-99fc-31db7a423594\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" Jul 06 22:25:35.925825 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:35.925786 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" Jul 06 22:25:36.089024 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:36.088824 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7"] Jul 06 22:25:36.092157 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:25:36.092109 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c423f82_8cf7_433f_99fc_31db7a423594.slice/crio-066e0af9820015166ea3dbb24aa71973cce70a086f858f54f8d225dae0a0d6e4 WatchSource:0}: Error finding container 066e0af9820015166ea3dbb24aa71973cce70a086f858f54f8d225dae0a0d6e4: Status 404 returned error can't find the container with id 066e0af9820015166ea3dbb24aa71973cce70a086f858f54f8d225dae0a0d6e4 Jul 06 22:25:36.422831 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:36.422800 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wwz95" Jul 06 22:25:36.577695 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:36.577649 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" event={"ID":"1c423f82-8cf7-433f-99fc-31db7a423594","Type":"ContainerStarted","Data":"066e0af9820015166ea3dbb24aa71973cce70a086f858f54f8d225dae0a0d6e4"} Jul 06 22:25:38.586834 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:38.586800 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" event={"ID":"1c423f82-8cf7-433f-99fc-31db7a423594","Type":"ContainerStarted","Data":"140ac925449cdf48f8bcb0019d1c59c870186268a864c25cd53f7f6ccf34490a"} Jul 06 22:25:38.587205 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:38.587029 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" Jul 06 22:25:38.591889 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:38.591865 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" Jul 06 22:25:38.621874 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:38.621837 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x4n7" podStartSLOduration=2.925682074 podStartE2EDuration="4.621823926s" totalImagesPullingTime="1.696141852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:38.621477081 +0000 UTC m=+106.015070903" watchObservedRunningTime="2026-07-06 22:25:38.621823926 +0000 UTC m=+106.015417740" Jul 06 22:25:56.439428 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.439377 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" podUID="d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" containerName="registry" containerID="cri-o://6a4b8d9c21144ad43b7cccafe32c2f2413be332f1d5aca051d8c38138a4589fb" gracePeriod=30 Jul 06 22:25:56.657894 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.657864 2564 generic.go:356] "Generic (PLEG): container finished" podID="d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" containerID="6a4b8d9c21144ad43b7cccafe32c2f2413be332f1d5aca051d8c38138a4589fb" exitCode=0 Jul 06 22:25:56.658040 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.657913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" event={"ID":"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3","Type":"ContainerDied","Data":"6a4b8d9c21144ad43b7cccafe32c2f2413be332f1d5aca051d8c38138a4589fb"} Jul 06 22:25:56.709746 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.709681 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:25:56.853033 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.852998 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-certificates\") pod \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " Jul 06 22:25:56.853216 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.853054 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-bound-sa-token\") pod \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " Jul 06 22:25:56.853216 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.853078 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-image-registry-private-configuration\") pod \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " Jul 06 22:25:56.853216 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.853102 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-trusted-ca\") pod \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " Jul 06 22:25:56.853216 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.853128 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls\") pod \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " Jul 06 22:25:56.853216 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.853154 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm5d4\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-kube-api-access-tm5d4\") pod \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " Jul 06 22:25:56.853522 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.853349 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-installation-pull-secrets\") pod \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " Jul 06 22:25:56.853522 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.853411 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-ca-trust-extracted\") pod \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\" (UID: \"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3\") " Jul 06 22:25:56.853648 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.853610 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:25:56.853733 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.853678 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:25:56.855667 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.855639 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:25:56.855788 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.855685 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-kube-api-access-tm5d4" (OuterVolumeSpecName: "kube-api-access-tm5d4") pod "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3"). InnerVolumeSpecName "kube-api-access-tm5d4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:25:56.855788 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.855704 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:25:56.855897 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.855873 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:25:56.855983 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.855965 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:25:56.862303 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.862279 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" (UID: "d415ddbe-a70d-4d3e-8574-6d29e7c61ee3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:25:56.954550 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.954520 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-certificates\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:25:56.954550 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.954545 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-bound-sa-token\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:25:56.954550 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.954557 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-image-registry-private-configuration\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:25:56.954755 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.954566 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-trusted-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:25:56.954755 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.954575 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-registry-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:25:56.954755 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.954583 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm5d4\" (UniqueName: \"kubernetes.io/projected/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-kube-api-access-tm5d4\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:25:56.954755 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.954592 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-installation-pull-secrets\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:25:56.954755 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:56.954601 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3-ca-trust-extracted\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:25:57.662333 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:57.662303 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" Jul 06 22:25:57.662333 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:57.662316 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b5dfbb746-l26xr" event={"ID":"d415ddbe-a70d-4d3e-8574-6d29e7c61ee3","Type":"ContainerDied","Data":"c056adf42644c4dd61a8d3abfd7eb2c5235cc30f8a14f0d4bdede3e33a6278ec"} Jul 06 22:25:57.662845 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:57.662378 2564 scope.go:117] "RemoveContainer" containerID="6a4b8d9c21144ad43b7cccafe32c2f2413be332f1d5aca051d8c38138a4589fb" Jul 06 22:25:57.689725 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:57.689698 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b5dfbb746-l26xr"] Jul 06 22:25:57.693364 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:57.693341 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b5dfbb746-l26xr"] Jul 06 22:25:59.041937 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:25:59.041903 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" path="/var/lib/kubelet/pods/d415ddbe-a70d-4d3e-8574-6d29e7c61ee3/volumes" Jul 06 22:26:01.681654 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:26:01.681619 2564 generic.go:356] "Generic (PLEG): container finished" podID="52941bfe-7acf-49aa-8678-07377455f1a7" containerID="7dbf00df24f86be6d7053e6f5a01ee6457a574ce645bd44d7f3bdd2287a72fa4" exitCode=0 Jul 06 22:26:01.682164 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:26:01.681699 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" event={"ID":"52941bfe-7acf-49aa-8678-07377455f1a7","Type":"ContainerDied","Data":"7dbf00df24f86be6d7053e6f5a01ee6457a574ce645bd44d7f3bdd2287a72fa4"} Jul 06 22:26:01.682164 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:26:01.682092 2564 scope.go:117] "RemoveContainer" containerID="7dbf00df24f86be6d7053e6f5a01ee6457a574ce645bd44d7f3bdd2287a72fa4" Jul 06 22:26:01.683141 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:26:01.683123 2564 generic.go:356] "Generic (PLEG): container finished" podID="fa5ba8dd-b8b9-411b-b61b-eefe3718030e" containerID="53722110a3964c5deb71cbcf09b4e1103903708faaf7bcd3b6171f8d5cc05b39" exitCode=0 Jul 06 22:26:01.683220 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:26:01.683187 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" event={"ID":"fa5ba8dd-b8b9-411b-b61b-eefe3718030e","Type":"ContainerDied","Data":"53722110a3964c5deb71cbcf09b4e1103903708faaf7bcd3b6171f8d5cc05b39"} Jul 06 22:26:01.683437 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:26:01.683426 2564 scope.go:117] "RemoveContainer" containerID="53722110a3964c5deb71cbcf09b4e1103903708faaf7bcd3b6171f8d5cc05b39" Jul 06 22:26:02.688365 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:26:02.688328 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bk9q6" event={"ID":"52941bfe-7acf-49aa-8678-07377455f1a7","Type":"ContainerStarted","Data":"b8dd877013af5aca9c4160db3fce31e758d54ff0f245f4f2708dbad305f3bb7d"} Jul 06 22:26:02.690000 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:26:02.689979 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zqfpb" event={"ID":"fa5ba8dd-b8b9-411b-b61b-eefe3718030e","Type":"ContainerStarted","Data":"759b85893bf5d1d1f49f49e14aa2602274c7fc8c155ed95385358d450cf5dc42"} Jul 06 22:27:45.127679 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.127644 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr"] Jul 06 22:27:45.128106 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.127901 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" containerName="registry" Jul 06 22:27:45.128106 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.127912 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" containerName="registry" Jul 06 22:27:45.128106 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.127968 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d415ddbe-a70d-4d3e-8574-6d29e7c61ee3" containerName="registry" Jul 06 22:27:45.129735 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.129718 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:27:45.132452 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.132432 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 22:27:45.132593 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.132457 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-26tt4\"" Jul 06 22:27:45.133467 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.133441 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 22:27:45.139249 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.139227 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr"] Jul 06 22:27:45.216724 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.216696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2969378d-4e8f-4819-8678-8032160b9967-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr\" (UID: \"2969378d-4e8f-4819-8678-8032160b9967\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:27:45.216857 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.216729 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2969378d-4e8f-4819-8678-8032160b9967-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr\" (UID: \"2969378d-4e8f-4819-8678-8032160b9967\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:27:45.216857 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.216760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db886\" (UniqueName: \"kubernetes.io/projected/2969378d-4e8f-4819-8678-8032160b9967-kube-api-access-db886\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr\" (UID: \"2969378d-4e8f-4819-8678-8032160b9967\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:27:45.317187 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.317151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2969378d-4e8f-4819-8678-8032160b9967-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr\" (UID: \"2969378d-4e8f-4819-8678-8032160b9967\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:27:45.317346 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.317192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2969378d-4e8f-4819-8678-8032160b9967-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr\" (UID: \"2969378d-4e8f-4819-8678-8032160b9967\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:27:45.317346 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.317239 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db886\" (UniqueName: \"kubernetes.io/projected/2969378d-4e8f-4819-8678-8032160b9967-kube-api-access-db886\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr\" (UID: \"2969378d-4e8f-4819-8678-8032160b9967\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:27:45.317581 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.317559 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2969378d-4e8f-4819-8678-8032160b9967-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr\" (UID: \"2969378d-4e8f-4819-8678-8032160b9967\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:27:45.317648 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.317590 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2969378d-4e8f-4819-8678-8032160b9967-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr\" (UID: \"2969378d-4e8f-4819-8678-8032160b9967\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:27:45.325562 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.325545 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db886\" (UniqueName: \"kubernetes.io/projected/2969378d-4e8f-4819-8678-8032160b9967-kube-api-access-db886\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr\" (UID: \"2969378d-4e8f-4819-8678-8032160b9967\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:27:45.438187 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.438108 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:27:45.559963 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:45.559937 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr"] Jul 06 22:27:45.562171 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:27:45.562139 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2969378d_4e8f_4819_8678_8032160b9967.slice/crio-a5699f066e3ac21f34cd958fd96c77564ff53e34fc2bbdd4f1246b956e493187 WatchSource:0}: Error finding container a5699f066e3ac21f34cd958fd96c77564ff53e34fc2bbdd4f1246b956e493187: Status 404 returned error can't find the container with id a5699f066e3ac21f34cd958fd96c77564ff53e34fc2bbdd4f1246b956e493187 Jul 06 22:27:46.054885 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:46.054845 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" event={"ID":"2969378d-4e8f-4819-8678-8032160b9967","Type":"ContainerStarted","Data":"a5699f066e3ac21f34cd958fd96c77564ff53e34fc2bbdd4f1246b956e493187"} Jul 06 22:27:54.086498 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:54.086444 2564 generic.go:356] "Generic (PLEG): container finished" podID="2969378d-4e8f-4819-8678-8032160b9967" containerID="8e8485aafdb40e45d0181e335b6ca4a13b65bd1e60009aa43e0f7375731e61c6" exitCode=0 Jul 06 22:27:54.086872 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:54.086535 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" event={"ID":"2969378d-4e8f-4819-8678-8032160b9967","Type":"ContainerDied","Data":"8e8485aafdb40e45d0181e335b6ca4a13b65bd1e60009aa43e0f7375731e61c6"} Jul 06 22:27:57.100009 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:57.099978 2564 generic.go:356] "Generic (PLEG): container finished" podID="2969378d-4e8f-4819-8678-8032160b9967" containerID="c7e823bcf336566252981bca4d6201681c166342d7afa27c33444dd38a8a8d50" exitCode=0 Jul 06 22:27:57.100358 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:27:57.100039 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" event={"ID":"2969378d-4e8f-4819-8678-8032160b9967","Type":"ContainerDied","Data":"c7e823bcf336566252981bca4d6201681c166342d7afa27c33444dd38a8a8d50"} Jul 06 22:28:05.131818 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:05.131781 2564 generic.go:356] "Generic (PLEG): container finished" podID="2969378d-4e8f-4819-8678-8032160b9967" containerID="0c82f9d80857a22ba803b21e9339c0ad61d63af5ceee7715896973b5104c0afd" exitCode=0 Jul 06 22:28:05.131818 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:05.131824 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" event={"ID":"2969378d-4e8f-4819-8678-8032160b9967","Type":"ContainerDied","Data":"0c82f9d80857a22ba803b21e9339c0ad61d63af5ceee7715896973b5104c0afd"} Jul 06 22:28:06.253040 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:06.253012 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:28:06.384457 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:06.384420 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db886\" (UniqueName: \"kubernetes.io/projected/2969378d-4e8f-4819-8678-8032160b9967-kube-api-access-db886\") pod \"2969378d-4e8f-4819-8678-8032160b9967\" (UID: \"2969378d-4e8f-4819-8678-8032160b9967\") " Jul 06 22:28:06.384665 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:06.384480 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2969378d-4e8f-4819-8678-8032160b9967-bundle\") pod \"2969378d-4e8f-4819-8678-8032160b9967\" (UID: \"2969378d-4e8f-4819-8678-8032160b9967\") " Jul 06 22:28:06.384665 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:06.384531 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2969378d-4e8f-4819-8678-8032160b9967-util\") pod \"2969378d-4e8f-4819-8678-8032160b9967\" (UID: \"2969378d-4e8f-4819-8678-8032160b9967\") " Jul 06 22:28:06.385194 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:06.385161 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2969378d-4e8f-4819-8678-8032160b9967-bundle" (OuterVolumeSpecName: "bundle") pod "2969378d-4e8f-4819-8678-8032160b9967" (UID: "2969378d-4e8f-4819-8678-8032160b9967"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:28:06.386741 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:06.386682 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2969378d-4e8f-4819-8678-8032160b9967-kube-api-access-db886" (OuterVolumeSpecName: "kube-api-access-db886") pod "2969378d-4e8f-4819-8678-8032160b9967" (UID: "2969378d-4e8f-4819-8678-8032160b9967"). InnerVolumeSpecName "kube-api-access-db886". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:28:06.389927 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:06.389898 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2969378d-4e8f-4819-8678-8032160b9967-util" (OuterVolumeSpecName: "util") pod "2969378d-4e8f-4819-8678-8032160b9967" (UID: "2969378d-4e8f-4819-8678-8032160b9967"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:28:06.485574 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:06.485544 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2969378d-4e8f-4819-8678-8032160b9967-bundle\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:28:06.485574 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:06.485569 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2969378d-4e8f-4819-8678-8032160b9967-util\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:28:06.485574 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:06.485578 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db886\" (UniqueName: \"kubernetes.io/projected/2969378d-4e8f-4819-8678-8032160b9967-kube-api-access-db886\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:28:07.140572 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:07.140542 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" Jul 06 22:28:07.140572 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:07.140558 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qhphr" event={"ID":"2969378d-4e8f-4819-8678-8032160b9967","Type":"ContainerDied","Data":"a5699f066e3ac21f34cd958fd96c77564ff53e34fc2bbdd4f1246b956e493187"} Jul 06 22:28:07.140753 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:07.140609 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5699f066e3ac21f34cd958fd96c77564ff53e34fc2bbdd4f1246b956e493187" Jul 06 22:28:12.874153 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.874118 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb"] Jul 06 22:28:12.874634 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.874472 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2969378d-4e8f-4819-8678-8032160b9967" containerName="extract" Jul 06 22:28:12.874634 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.874506 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2969378d-4e8f-4819-8678-8032160b9967" containerName="extract" Jul 06 22:28:12.874634 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.874531 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2969378d-4e8f-4819-8678-8032160b9967" containerName="pull" Jul 06 22:28:12.874634 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.874539 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2969378d-4e8f-4819-8678-8032160b9967" containerName="pull" Jul 06 22:28:12.874634 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.874552 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2969378d-4e8f-4819-8678-8032160b9967" containerName="util" Jul 06 22:28:12.874634 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.874560 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2969378d-4e8f-4819-8678-8032160b9967" containerName="util" Jul 06 22:28:12.874634 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.874625 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2969378d-4e8f-4819-8678-8032160b9967" containerName="extract" Jul 06 22:28:12.878286 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.878264 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb" Jul 06 22:28:12.881156 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.881127 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:28:12.881332 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.881319 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4c9sr\"" Jul 06 22:28:12.881544 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.881529 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 22:28:12.893552 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.893530 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb"] Jul 06 22:28:12.933422 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.933388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb34c23d-4d66-423c-935c-a2ed540318cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fvzwb\" (UID: \"cb34c23d-4d66-423c-935c-a2ed540318cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb" Jul 06 22:28:12.933574 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:12.933468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnjxk\" (UniqueName: \"kubernetes.io/projected/cb34c23d-4d66-423c-935c-a2ed540318cb-kube-api-access-dnjxk\") pod \"cert-manager-operator-controller-manager-55c444bf86-fvzwb\" (UID: \"cb34c23d-4d66-423c-935c-a2ed540318cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb" Jul 06 22:28:13.033981 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:13.033946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjxk\" (UniqueName: \"kubernetes.io/projected/cb34c23d-4d66-423c-935c-a2ed540318cb-kube-api-access-dnjxk\") pod \"cert-manager-operator-controller-manager-55c444bf86-fvzwb\" (UID: \"cb34c23d-4d66-423c-935c-a2ed540318cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb" Jul 06 22:28:13.034132 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:13.033994 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb34c23d-4d66-423c-935c-a2ed540318cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fvzwb\" (UID: \"cb34c23d-4d66-423c-935c-a2ed540318cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb" Jul 06 22:28:13.034346 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:13.034325 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb34c23d-4d66-423c-935c-a2ed540318cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fvzwb\" (UID: \"cb34c23d-4d66-423c-935c-a2ed540318cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb" Jul 06 22:28:13.043051 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:13.043029 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnjxk\" (UniqueName: \"kubernetes.io/projected/cb34c23d-4d66-423c-935c-a2ed540318cb-kube-api-access-dnjxk\") pod \"cert-manager-operator-controller-manager-55c444bf86-fvzwb\" (UID: \"cb34c23d-4d66-423c-935c-a2ed540318cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb" Jul 06 22:28:13.186732 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:13.186649 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb" Jul 06 22:28:13.315549 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:13.315429 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb"] Jul 06 22:28:13.319636 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:28:13.319611 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb34c23d_4d66_423c_935c_a2ed540318cb.slice/crio-5ff0b06770f8f4f2b066bdbb9c0560647e1c6cd87b61a04afc55003248a4e7b2 WatchSource:0}: Error finding container 5ff0b06770f8f4f2b066bdbb9c0560647e1c6cd87b61a04afc55003248a4e7b2: Status 404 returned error can't find the container with id 5ff0b06770f8f4f2b066bdbb9c0560647e1c6cd87b61a04afc55003248a4e7b2 Jul 06 22:28:14.164921 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:14.164871 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb" event={"ID":"cb34c23d-4d66-423c-935c-a2ed540318cb","Type":"ContainerStarted","Data":"5ff0b06770f8f4f2b066bdbb9c0560647e1c6cd87b61a04afc55003248a4e7b2"} Jul 06 22:28:15.170334 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:15.170251 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb" event={"ID":"cb34c23d-4d66-423c-935c-a2ed540318cb","Type":"ContainerStarted","Data":"d13ca339c3a387bcd26333af6c45f2dee73651009a39bf235b4a44dbd4d4a725"} Jul 06 22:28:15.201006 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:15.200952 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fvzwb" podStartSLOduration=1.618825309 podStartE2EDuration="3.200932959s" totalImagesPullingTime="1.58210765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:15.198192892 +0000 UTC m=+262.591786704" watchObservedRunningTime="2026-07-06 22:28:15.200932959 +0000 UTC m=+262.594526773" Jul 06 22:28:16.608000 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.607959 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88"] Jul 06 22:28:16.610401 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.610378 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:16.612995 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.612973 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-26tt4\"" Jul 06 22:28:16.613225 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.613208 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 22:28:16.614374 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.614348 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 22:28:16.620000 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.619981 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88"] Jul 06 22:28:16.658642 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.658616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4c0b73-4b07-4f87-97db-c0285518d802-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88\" (UID: \"8b4c0b73-4b07-4f87-97db-c0285518d802\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:16.658740 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.658672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7tpx\" (UniqueName: \"kubernetes.io/projected/8b4c0b73-4b07-4f87-97db-c0285518d802-kube-api-access-g7tpx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88\" (UID: \"8b4c0b73-4b07-4f87-97db-c0285518d802\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:16.658740 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.658715 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4c0b73-4b07-4f87-97db-c0285518d802-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88\" (UID: \"8b4c0b73-4b07-4f87-97db-c0285518d802\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:16.759913 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.759879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7tpx\" (UniqueName: \"kubernetes.io/projected/8b4c0b73-4b07-4f87-97db-c0285518d802-kube-api-access-g7tpx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88\" (UID: \"8b4c0b73-4b07-4f87-97db-c0285518d802\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:16.760037 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.759925 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4c0b73-4b07-4f87-97db-c0285518d802-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88\" (UID: \"8b4c0b73-4b07-4f87-97db-c0285518d802\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:16.760037 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.759960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4c0b73-4b07-4f87-97db-c0285518d802-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88\" (UID: \"8b4c0b73-4b07-4f87-97db-c0285518d802\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:16.760375 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.760355 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4c0b73-4b07-4f87-97db-c0285518d802-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88\" (UID: \"8b4c0b73-4b07-4f87-97db-c0285518d802\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:16.760375 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.760368 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4c0b73-4b07-4f87-97db-c0285518d802-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88\" (UID: \"8b4c0b73-4b07-4f87-97db-c0285518d802\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:16.768976 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.768947 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7tpx\" (UniqueName: \"kubernetes.io/projected/8b4c0b73-4b07-4f87-97db-c0285518d802-kube-api-access-g7tpx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88\" (UID: \"8b4c0b73-4b07-4f87-97db-c0285518d802\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:16.920282 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:16.920206 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:17.042917 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.042883 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88"] Jul 06 22:28:17.045299 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:28:17.045270 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b4c0b73_4b07_4f87_97db_c0285518d802.slice/crio-88b80c7ed7ed31578699507467dbe4143b2405a5b8a67f9a987f6fbb21137c54 WatchSource:0}: Error finding container 88b80c7ed7ed31578699507467dbe4143b2405a5b8a67f9a987f6fbb21137c54: Status 404 returned error can't find the container with id 88b80c7ed7ed31578699507467dbe4143b2405a5b8a67f9a987f6fbb21137c54 Jul 06 22:28:17.179524 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.179455 2564 generic.go:356] "Generic (PLEG): container finished" podID="8b4c0b73-4b07-4f87-97db-c0285518d802" containerID="ea3f6448ebe9c72dcada6a11e6fee615834897710758471f9c08b80ba0b6214a" exitCode=0 Jul 06 22:28:17.179629 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.179548 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" event={"ID":"8b4c0b73-4b07-4f87-97db-c0285518d802","Type":"ContainerDied","Data":"ea3f6448ebe9c72dcada6a11e6fee615834897710758471f9c08b80ba0b6214a"} Jul 06 22:28:17.179629 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.179598 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" event={"ID":"8b4c0b73-4b07-4f87-97db-c0285518d802","Type":"ContainerStarted","Data":"88b80c7ed7ed31578699507467dbe4143b2405a5b8a67f9a987f6fbb21137c54"} Jul 06 22:28:17.554729 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.554650 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mplw6"] Jul 06 22:28:17.556711 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.556690 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" Jul 06 22:28:17.559233 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.559210 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rx26r\"" Jul 06 22:28:17.559345 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.559248 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 22:28:17.559345 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.559298 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 22:28:17.565689 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.565666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmmz8\" (UniqueName: \"kubernetes.io/projected/ec27e45d-12c6-4179-923d-3f611a50311b-kube-api-access-qmmz8\") pod \"cert-manager-webhook-6486ffd997-mplw6\" (UID: \"ec27e45d-12c6-4179-923d-3f611a50311b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" Jul 06 22:28:17.565804 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.565714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec27e45d-12c6-4179-923d-3f611a50311b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mplw6\" (UID: \"ec27e45d-12c6-4179-923d-3f611a50311b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" Jul 06 22:28:17.566391 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.566368 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mplw6"] Jul 06 22:28:17.667143 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.667113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmmz8\" (UniqueName: \"kubernetes.io/projected/ec27e45d-12c6-4179-923d-3f611a50311b-kube-api-access-qmmz8\") pod \"cert-manager-webhook-6486ffd997-mplw6\" (UID: \"ec27e45d-12c6-4179-923d-3f611a50311b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" Jul 06 22:28:17.667522 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.667162 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec27e45d-12c6-4179-923d-3f611a50311b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mplw6\" (UID: \"ec27e45d-12c6-4179-923d-3f611a50311b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" Jul 06 22:28:17.675385 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.675355 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec27e45d-12c6-4179-923d-3f611a50311b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mplw6\" (UID: \"ec27e45d-12c6-4179-923d-3f611a50311b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" Jul 06 22:28:17.675548 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.675531 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmmz8\" (UniqueName: \"kubernetes.io/projected/ec27e45d-12c6-4179-923d-3f611a50311b-kube-api-access-qmmz8\") pod \"cert-manager-webhook-6486ffd997-mplw6\" (UID: \"ec27e45d-12c6-4179-923d-3f611a50311b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" Jul 06 22:28:17.866448 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.866419 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" Jul 06 22:28:17.987843 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:17.987812 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mplw6"] Jul 06 22:28:17.990543 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:28:17.990479 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec27e45d_12c6_4179_923d_3f611a50311b.slice/crio-954151a413e9f6ff05c461624b723db9ced3169a48e2634eff61f2299e6916a7 WatchSource:0}: Error finding container 954151a413e9f6ff05c461624b723db9ced3169a48e2634eff61f2299e6916a7: Status 404 returned error can't find the container with id 954151a413e9f6ff05c461624b723db9ced3169a48e2634eff61f2299e6916a7 Jul 06 22:28:18.185384 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:18.185288 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" event={"ID":"ec27e45d-12c6-4179-923d-3f611a50311b","Type":"ContainerStarted","Data":"954151a413e9f6ff05c461624b723db9ced3169a48e2634eff61f2299e6916a7"} Jul 06 22:28:18.864402 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:18.864366 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd"] Jul 06 22:28:18.866678 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:18.866657 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd" Jul 06 22:28:18.869161 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:18.869138 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6527h\"" Jul 06 22:28:18.874761 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:18.874730 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd"] Jul 06 22:28:18.875185 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:18.874944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d6680ed-e373-49a9-9427-3a5dfa49b71d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2z7qd\" (UID: \"0d6680ed-e373-49a9-9427-3a5dfa49b71d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd" Jul 06 22:28:18.875185 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:18.875031 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpw4j\" (UniqueName: \"kubernetes.io/projected/0d6680ed-e373-49a9-9427-3a5dfa49b71d-kube-api-access-wpw4j\") pod \"cert-manager-cainjector-559cdd8c87-2z7qd\" (UID: \"0d6680ed-e373-49a9-9427-3a5dfa49b71d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd" Jul 06 22:28:18.976170 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:18.976131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpw4j\" (UniqueName: \"kubernetes.io/projected/0d6680ed-e373-49a9-9427-3a5dfa49b71d-kube-api-access-wpw4j\") pod \"cert-manager-cainjector-559cdd8c87-2z7qd\" (UID: \"0d6680ed-e373-49a9-9427-3a5dfa49b71d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd" Jul 06 22:28:18.976360 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:18.976198 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d6680ed-e373-49a9-9427-3a5dfa49b71d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2z7qd\" (UID: \"0d6680ed-e373-49a9-9427-3a5dfa49b71d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd" Jul 06 22:28:18.984656 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:18.984631 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d6680ed-e373-49a9-9427-3a5dfa49b71d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2z7qd\" (UID: \"0d6680ed-e373-49a9-9427-3a5dfa49b71d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd" Jul 06 22:28:18.984884 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:18.984864 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpw4j\" (UniqueName: \"kubernetes.io/projected/0d6680ed-e373-49a9-9427-3a5dfa49b71d-kube-api-access-wpw4j\") pod \"cert-manager-cainjector-559cdd8c87-2z7qd\" (UID: \"0d6680ed-e373-49a9-9427-3a5dfa49b71d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd" Jul 06 22:28:19.178258 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:19.178174 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd" Jul 06 22:28:19.945639 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:19.945610 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd"] Jul 06 22:28:19.948453 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:28:19.948426 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d6680ed_e373_49a9_9427_3a5dfa49b71d.slice/crio-9f1da0d01eeb36870f47241fad8f39ab0e459a3f571755dfba6e94fddcbe8b89 WatchSource:0}: Error finding container 9f1da0d01eeb36870f47241fad8f39ab0e459a3f571755dfba6e94fddcbe8b89: Status 404 returned error can't find the container with id 9f1da0d01eeb36870f47241fad8f39ab0e459a3f571755dfba6e94fddcbe8b89 Jul 06 22:28:20.197560 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:20.197526 2564 generic.go:356] "Generic (PLEG): container finished" podID="8b4c0b73-4b07-4f87-97db-c0285518d802" containerID="dcf21c31fc702eb1084fd2b48c638297417711b22b657695aed4d77663c9adb6" exitCode=0 Jul 06 22:28:20.197752 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:20.197613 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" event={"ID":"8b4c0b73-4b07-4f87-97db-c0285518d802","Type":"ContainerDied","Data":"dcf21c31fc702eb1084fd2b48c638297417711b22b657695aed4d77663c9adb6"} Jul 06 22:28:20.198746 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:20.198727 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd" event={"ID":"0d6680ed-e373-49a9-9427-3a5dfa49b71d","Type":"ContainerStarted","Data":"9f1da0d01eeb36870f47241fad8f39ab0e459a3f571755dfba6e94fddcbe8b89"} Jul 06 22:28:21.205073 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:21.205036 2564 generic.go:356] "Generic (PLEG): container finished" podID="8b4c0b73-4b07-4f87-97db-c0285518d802" containerID="ad01de6d1ac781ebb90149bf720426a3a7b18cb1d31b9ec5dff31f76a768bd63" exitCode=0 Jul 06 22:28:21.205443 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:21.205126 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" event={"ID":"8b4c0b73-4b07-4f87-97db-c0285518d802","Type":"ContainerDied","Data":"ad01de6d1ac781ebb90149bf720426a3a7b18cb1d31b9ec5dff31f76a768bd63"} Jul 06 22:28:22.210872 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.210837 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd" event={"ID":"0d6680ed-e373-49a9-9427-3a5dfa49b71d","Type":"ContainerStarted","Data":"2ff847033b0344d010d1f09adeffea403ce6b1e8bd13da5558afc48e4ca0499d"} Jul 06 22:28:22.212381 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.212343 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" event={"ID":"ec27e45d-12c6-4179-923d-3f611a50311b","Type":"ContainerStarted","Data":"54c5895fbfdc571d16abbe601f8dd4775a1c7818f0325bff7ac11f9427523efa"} Jul 06 22:28:22.212526 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.212401 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" Jul 06 22:28:22.244338 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.244205 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" podStartSLOduration=2.005545384 podStartE2EDuration="5.244183443s" totalImagesPullingTime="3.238638059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:22.243325786 +0000 UTC m=+269.636919599" watchObservedRunningTime="2026-07-06 22:28:22.244183443 +0000 UTC m=+269.637777273" Jul 06 22:28:22.245512 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.245441 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2z7qd" podStartSLOduration=2.964209546 podStartE2EDuration="4.245430171s" totalImagesPullingTime="1.281220625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:22.226400977 +0000 UTC m=+269.619994790" watchObservedRunningTime="2026-07-06 22:28:22.245430171 +0000 UTC m=+269.639023986" Jul 06 22:28:22.363615 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.363590 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:22.397416 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.397389 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4c0b73-4b07-4f87-97db-c0285518d802-util\") pod \"8b4c0b73-4b07-4f87-97db-c0285518d802\" (UID: \"8b4c0b73-4b07-4f87-97db-c0285518d802\") " Jul 06 22:28:22.397416 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.397422 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4c0b73-4b07-4f87-97db-c0285518d802-bundle\") pod \"8b4c0b73-4b07-4f87-97db-c0285518d802\" (UID: \"8b4c0b73-4b07-4f87-97db-c0285518d802\") " Jul 06 22:28:22.397669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.397478 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7tpx\" (UniqueName: \"kubernetes.io/projected/8b4c0b73-4b07-4f87-97db-c0285518d802-kube-api-access-g7tpx\") pod \"8b4c0b73-4b07-4f87-97db-c0285518d802\" (UID: \"8b4c0b73-4b07-4f87-97db-c0285518d802\") " Jul 06 22:28:22.397852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.397831 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b4c0b73-4b07-4f87-97db-c0285518d802-bundle" (OuterVolumeSpecName: "bundle") pod "8b4c0b73-4b07-4f87-97db-c0285518d802" (UID: "8b4c0b73-4b07-4f87-97db-c0285518d802"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:28:22.399565 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.399538 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b4c0b73-4b07-4f87-97db-c0285518d802-kube-api-access-g7tpx" (OuterVolumeSpecName: "kube-api-access-g7tpx") pod "8b4c0b73-4b07-4f87-97db-c0285518d802" (UID: "8b4c0b73-4b07-4f87-97db-c0285518d802"). InnerVolumeSpecName "kube-api-access-g7tpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:28:22.401650 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.401627 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b4c0b73-4b07-4f87-97db-c0285518d802-util" (OuterVolumeSpecName: "util") pod "8b4c0b73-4b07-4f87-97db-c0285518d802" (UID: "8b4c0b73-4b07-4f87-97db-c0285518d802"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:28:22.498125 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.498047 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7tpx\" (UniqueName: \"kubernetes.io/projected/8b4c0b73-4b07-4f87-97db-c0285518d802-kube-api-access-g7tpx\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:28:22.498125 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.498072 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4c0b73-4b07-4f87-97db-c0285518d802-util\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:28:22.498125 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:22.498083 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4c0b73-4b07-4f87-97db-c0285518d802-bundle\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:28:23.218581 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:23.218536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" event={"ID":"8b4c0b73-4b07-4f87-97db-c0285518d802","Type":"ContainerDied","Data":"88b80c7ed7ed31578699507467dbe4143b2405a5b8a67f9a987f6fbb21137c54"} Jul 06 22:28:23.219235 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:23.218593 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88b80c7ed7ed31578699507467dbe4143b2405a5b8a67f9a987f6fbb21137c54" Jul 06 22:28:23.219235 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:23.218560 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhpr88" Jul 06 22:28:27.147557 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.147527 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pkt2w"] Jul 06 22:28:27.147916 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.147782 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b4c0b73-4b07-4f87-97db-c0285518d802" containerName="util" Jul 06 22:28:27.147916 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.147792 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b4c0b73-4b07-4f87-97db-c0285518d802" containerName="util" Jul 06 22:28:27.147916 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.147805 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b4c0b73-4b07-4f87-97db-c0285518d802" containerName="pull" Jul 06 22:28:27.147916 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.147810 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b4c0b73-4b07-4f87-97db-c0285518d802" containerName="pull" Jul 06 22:28:27.147916 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.147817 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b4c0b73-4b07-4f87-97db-c0285518d802" containerName="extract" Jul 06 22:28:27.147916 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.147823 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b4c0b73-4b07-4f87-97db-c0285518d802" containerName="extract" Jul 06 22:28:27.147916 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.147870 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b4c0b73-4b07-4f87-97db-c0285518d802" containerName="extract" Jul 06 22:28:27.151601 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.151585 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pkt2w" Jul 06 22:28:27.154175 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.154155 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-p6v5k\"" Jul 06 22:28:27.160762 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.160740 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pkt2w"] Jul 06 22:28:27.227418 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.227385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcb67383-e861-4fa2-92c1-d67446311333-bound-sa-token\") pod \"cert-manager-55b4d954d5-pkt2w\" (UID: \"dcb67383-e861-4fa2-92c1-d67446311333\") " pod="cert-manager/cert-manager-55b4d954d5-pkt2w" Jul 06 22:28:27.227564 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.227441 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66f8m\" (UniqueName: \"kubernetes.io/projected/dcb67383-e861-4fa2-92c1-d67446311333-kube-api-access-66f8m\") pod \"cert-manager-55b4d954d5-pkt2w\" (UID: \"dcb67383-e861-4fa2-92c1-d67446311333\") " pod="cert-manager/cert-manager-55b4d954d5-pkt2w" Jul 06 22:28:27.327796 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.327769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66f8m\" (UniqueName: \"kubernetes.io/projected/dcb67383-e861-4fa2-92c1-d67446311333-kube-api-access-66f8m\") pod \"cert-manager-55b4d954d5-pkt2w\" (UID: \"dcb67383-e861-4fa2-92c1-d67446311333\") " pod="cert-manager/cert-manager-55b4d954d5-pkt2w" Jul 06 22:28:27.327951 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.327819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcb67383-e861-4fa2-92c1-d67446311333-bound-sa-token\") pod \"cert-manager-55b4d954d5-pkt2w\" (UID: \"dcb67383-e861-4fa2-92c1-d67446311333\") " pod="cert-manager/cert-manager-55b4d954d5-pkt2w" Jul 06 22:28:27.344230 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.344197 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66f8m\" (UniqueName: \"kubernetes.io/projected/dcb67383-e861-4fa2-92c1-d67446311333-kube-api-access-66f8m\") pod \"cert-manager-55b4d954d5-pkt2w\" (UID: \"dcb67383-e861-4fa2-92c1-d67446311333\") " pod="cert-manager/cert-manager-55b4d954d5-pkt2w" Jul 06 22:28:27.348869 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.348851 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcb67383-e861-4fa2-92c1-d67446311333-bound-sa-token\") pod \"cert-manager-55b4d954d5-pkt2w\" (UID: \"dcb67383-e861-4fa2-92c1-d67446311333\") " pod="cert-manager/cert-manager-55b4d954d5-pkt2w" Jul 06 22:28:27.460940 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.460850 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pkt2w" Jul 06 22:28:27.588823 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:27.588784 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pkt2w"] Jul 06 22:28:27.591682 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:28:27.591654 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcb67383_e861_4fa2_92c1_d67446311333.slice/crio-832df7470c36b39c321b57b22fca237ef4db11f98b2e6c92faa24255ba10912d WatchSource:0}: Error finding container 832df7470c36b39c321b57b22fca237ef4db11f98b2e6c92faa24255ba10912d: Status 404 returned error can't find the container with id 832df7470c36b39c321b57b22fca237ef4db11f98b2e6c92faa24255ba10912d Jul 06 22:28:28.221116 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:28.221085 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mplw6" Jul 06 22:28:28.241135 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:28.241108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pkt2w" event={"ID":"dcb67383-e861-4fa2-92c1-d67446311333","Type":"ContainerStarted","Data":"1c51b17f5b13c07297f66ba8ed47fa08e5899c7122cf21d7fa284999e6a9e1d1"} Jul 06 22:28:28.241244 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:28.241143 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pkt2w" event={"ID":"dcb67383-e861-4fa2-92c1-d67446311333","Type":"ContainerStarted","Data":"832df7470c36b39c321b57b22fca237ef4db11f98b2e6c92faa24255ba10912d"} Jul 06 22:28:28.257458 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:28.257410 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pkt2w" podStartSLOduration=1.257395906 podStartE2EDuration="1.257395906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:28.256038981 +0000 UTC m=+275.649632794" watchObservedRunningTime="2026-07-06 22:28:28.257395906 +0000 UTC m=+275.650989718" Jul 06 22:28:37.856381 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:37.856350 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j"] Jul 06 22:28:37.861453 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:37.861426 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j"] Jul 06 22:28:37.861599 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:37.861544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:37.863999 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:37.863978 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 22:28:37.864118 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:37.863985 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-26tt4\"" Jul 06 22:28:37.864118 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:37.864001 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 22:28:37.904675 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:37.904649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c7e4c02-c4fd-4841-9687-f26360914f4b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j\" (UID: \"7c7e4c02-c4fd-4841-9687-f26360914f4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:37.904786 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:37.904690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c7e4c02-c4fd-4841-9687-f26360914f4b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j\" (UID: \"7c7e4c02-c4fd-4841-9687-f26360914f4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:37.904786 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:37.904731 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bq99\" (UniqueName: \"kubernetes.io/projected/7c7e4c02-c4fd-4841-9687-f26360914f4b-kube-api-access-7bq99\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j\" (UID: \"7c7e4c02-c4fd-4841-9687-f26360914f4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:38.005554 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:38.005520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c7e4c02-c4fd-4841-9687-f26360914f4b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j\" (UID: \"7c7e4c02-c4fd-4841-9687-f26360914f4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:38.005693 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:38.005562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c7e4c02-c4fd-4841-9687-f26360914f4b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j\" (UID: \"7c7e4c02-c4fd-4841-9687-f26360914f4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:38.005693 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:38.005585 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bq99\" (UniqueName: \"kubernetes.io/projected/7c7e4c02-c4fd-4841-9687-f26360914f4b-kube-api-access-7bq99\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j\" (UID: \"7c7e4c02-c4fd-4841-9687-f26360914f4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:38.005901 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:38.005881 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c7e4c02-c4fd-4841-9687-f26360914f4b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j\" (UID: \"7c7e4c02-c4fd-4841-9687-f26360914f4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:38.005934 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:38.005909 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c7e4c02-c4fd-4841-9687-f26360914f4b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j\" (UID: \"7c7e4c02-c4fd-4841-9687-f26360914f4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:38.013204 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:38.013177 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bq99\" (UniqueName: \"kubernetes.io/projected/7c7e4c02-c4fd-4841-9687-f26360914f4b-kube-api-access-7bq99\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j\" (UID: \"7c7e4c02-c4fd-4841-9687-f26360914f4b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:38.171209 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:38.171112 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:38.296613 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:38.296586 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j"] Jul 06 22:28:38.298384 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:28:38.298355 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7e4c02_c4fd_4841_9687_f26360914f4b.slice/crio-0c11813abe942a20aeabe959a246ae26aa7c394ea715ce9023b59f7142ed9a4f WatchSource:0}: Error finding container 0c11813abe942a20aeabe959a246ae26aa7c394ea715ce9023b59f7142ed9a4f: Status 404 returned error can't find the container with id 0c11813abe942a20aeabe959a246ae26aa7c394ea715ce9023b59f7142ed9a4f Jul 06 22:28:39.292292 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:39.292193 2564 generic.go:356] "Generic (PLEG): container finished" podID="7c7e4c02-c4fd-4841-9687-f26360914f4b" containerID="9dc4d1c1c24287a032b47f19b8de29c2af0b1995a15837d115c5bcf7f3b2b9dc" exitCode=0 Jul 06 22:28:39.292779 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:39.292282 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" event={"ID":"7c7e4c02-c4fd-4841-9687-f26360914f4b","Type":"ContainerDied","Data":"9dc4d1c1c24287a032b47f19b8de29c2af0b1995a15837d115c5bcf7f3b2b9dc"} Jul 06 22:28:39.292779 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:39.292376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" event={"ID":"7c7e4c02-c4fd-4841-9687-f26360914f4b","Type":"ContainerStarted","Data":"0c11813abe942a20aeabe959a246ae26aa7c394ea715ce9023b59f7142ed9a4f"} Jul 06 22:28:40.299366 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:40.299331 2564 generic.go:356] "Generic (PLEG): container finished" podID="7c7e4c02-c4fd-4841-9687-f26360914f4b" containerID="c801ed8424930d1d1f24ced0c14a33396d3e20e88eac5d534e8e9a087c4dc423" exitCode=0 Jul 06 22:28:40.299751 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:40.299384 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" event={"ID":"7c7e4c02-c4fd-4841-9687-f26360914f4b","Type":"ContainerDied","Data":"c801ed8424930d1d1f24ced0c14a33396d3e20e88eac5d534e8e9a087c4dc423"} Jul 06 22:28:41.305091 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:41.305062 2564 generic.go:356] "Generic (PLEG): container finished" podID="7c7e4c02-c4fd-4841-9687-f26360914f4b" containerID="57bb0cbe26bec808f9ffa7ee3a201500abc53e214ef1e04e213ad0c23ec2df79" exitCode=0 Jul 06 22:28:41.305458 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:41.305146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" event={"ID":"7c7e4c02-c4fd-4841-9687-f26360914f4b","Type":"ContainerDied","Data":"57bb0cbe26bec808f9ffa7ee3a201500abc53e214ef1e04e213ad0c23ec2df79"} Jul 06 22:28:42.439029 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:42.439001 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:42.539460 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:42.539425 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bq99\" (UniqueName: \"kubernetes.io/projected/7c7e4c02-c4fd-4841-9687-f26360914f4b-kube-api-access-7bq99\") pod \"7c7e4c02-c4fd-4841-9687-f26360914f4b\" (UID: \"7c7e4c02-c4fd-4841-9687-f26360914f4b\") " Jul 06 22:28:42.539646 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:42.539474 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c7e4c02-c4fd-4841-9687-f26360914f4b-bundle\") pod \"7c7e4c02-c4fd-4841-9687-f26360914f4b\" (UID: \"7c7e4c02-c4fd-4841-9687-f26360914f4b\") " Jul 06 22:28:42.539646 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:42.539552 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c7e4c02-c4fd-4841-9687-f26360914f4b-util\") pod \"7c7e4c02-c4fd-4841-9687-f26360914f4b\" (UID: \"7c7e4c02-c4fd-4841-9687-f26360914f4b\") " Jul 06 22:28:42.540258 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:42.540228 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c7e4c02-c4fd-4841-9687-f26360914f4b-bundle" (OuterVolumeSpecName: "bundle") pod "7c7e4c02-c4fd-4841-9687-f26360914f4b" (UID: "7c7e4c02-c4fd-4841-9687-f26360914f4b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:28:42.541563 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:42.541541 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c7e4c02-c4fd-4841-9687-f26360914f4b-kube-api-access-7bq99" (OuterVolumeSpecName: "kube-api-access-7bq99") pod "7c7e4c02-c4fd-4841-9687-f26360914f4b" (UID: "7c7e4c02-c4fd-4841-9687-f26360914f4b"). InnerVolumeSpecName "kube-api-access-7bq99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:28:42.545308 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:42.545284 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c7e4c02-c4fd-4841-9687-f26360914f4b-util" (OuterVolumeSpecName: "util") pod "7c7e4c02-c4fd-4841-9687-f26360914f4b" (UID: "7c7e4c02-c4fd-4841-9687-f26360914f4b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:28:42.640849 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:42.640821 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c7e4c02-c4fd-4841-9687-f26360914f4b-util\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:28:42.640849 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:42.640846 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bq99\" (UniqueName: \"kubernetes.io/projected/7c7e4c02-c4fd-4841-9687-f26360914f4b-kube-api-access-7bq99\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:28:42.641016 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:42.640857 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c7e4c02-c4fd-4841-9687-f26360914f4b-bundle\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:28:43.314829 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:43.314747 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" Jul 06 22:28:43.314987 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:43.314745 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9c79j" event={"ID":"7c7e4c02-c4fd-4841-9687-f26360914f4b","Type":"ContainerDied","Data":"0c11813abe942a20aeabe959a246ae26aa7c394ea715ce9023b59f7142ed9a4f"} Jul 06 22:28:43.314987 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:43.314896 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c11813abe942a20aeabe959a246ae26aa7c394ea715ce9023b59f7142ed9a4f" Jul 06 22:28:50.010247 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.010210 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w"] Jul 06 22:28:50.010652 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.010469 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7e4c02-c4fd-4841-9687-f26360914f4b" containerName="util" Jul 06 22:28:50.010652 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.010479 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7e4c02-c4fd-4841-9687-f26360914f4b" containerName="util" Jul 06 22:28:50.010652 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.010507 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7e4c02-c4fd-4841-9687-f26360914f4b" containerName="extract" Jul 06 22:28:50.010652 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.010516 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7e4c02-c4fd-4841-9687-f26360914f4b" containerName="extract" Jul 06 22:28:50.010652 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.010534 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c7e4c02-c4fd-4841-9687-f26360914f4b" containerName="pull" Jul 06 22:28:50.010652 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.010540 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7e4c02-c4fd-4841-9687-f26360914f4b" containerName="pull" Jul 06 22:28:50.010652 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.010596 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c7e4c02-c4fd-4841-9687-f26360914f4b" containerName="extract" Jul 06 22:28:50.012554 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.012537 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.015309 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.015289 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 22:28:50.015607 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.015588 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 22:28:50.015823 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.015807 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 22:28:50.015908 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.015862 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n44fs\"" Jul 06 22:28:50.015908 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.015891 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 22:28:50.036729 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.036707 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w"] Jul 06 22:28:50.093620 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.093594 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-webhook-cert\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.093745 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.093658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.093745 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.093718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxfqk\" (UniqueName: \"kubernetes.io/projected/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-kube-api-access-rxfqk\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.093745 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.093742 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-manifests\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.093848 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.093776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-tmp\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.194593 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.194557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxfqk\" (UniqueName: \"kubernetes.io/projected/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-kube-api-access-rxfqk\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.194593 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.194595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-manifests\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.194790 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.194612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-tmp\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.194790 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.194653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-webhook-cert\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.194790 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.194686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.194994 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.194971 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-manifests\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.197048 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.197014 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-tmp\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.197157 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.197062 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-webhook-cert\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.197194 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.197168 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.205250 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.205229 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxfqk\" (UniqueName: \"kubernetes.io/projected/e9ea17c9-93ad-49f8-936f-59e27c59d4f6-kube-api-access-rxfqk\") pod \"opendatahub-operator-controller-manager-84b8787b6c-j294w\" (UID: \"e9ea17c9-93ad-49f8-936f-59e27c59d4f6\") " pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.322909 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.322817 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:50.469988 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:50.466417 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w"] Jul 06 22:28:50.475961 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:28:50.475936 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ea17c9_93ad_49f8_936f_59e27c59d4f6.slice/crio-55998b4bca9440ec6fc2a622d2d72e327b94f9e5b8b3347da969666ad35cd7ee WatchSource:0}: Error finding container 55998b4bca9440ec6fc2a622d2d72e327b94f9e5b8b3347da969666ad35cd7ee: Status 404 returned error can't find the container with id 55998b4bca9440ec6fc2a622d2d72e327b94f9e5b8b3347da969666ad35cd7ee Jul 06 22:28:51.350038 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:51.349989 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" event={"ID":"e9ea17c9-93ad-49f8-936f-59e27c59d4f6","Type":"ContainerStarted","Data":"55998b4bca9440ec6fc2a622d2d72e327b94f9e5b8b3347da969666ad35cd7ee"} Jul 06 22:28:53.185498 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:53.185454 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:28:53.186530 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:53.185542 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:28:53.190668 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:53.190650 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:28:53.190780 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:53.190698 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:28:53.195874 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:53.195855 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 22:28:53.360195 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:53.360162 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" event={"ID":"e9ea17c9-93ad-49f8-936f-59e27c59d4f6","Type":"ContainerStarted","Data":"6771857c6a9c472976b088216568658479c6f0fe069a706915e64592c95ee983"} Jul 06 22:28:54.366224 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:54.366186 2564 generic.go:356] "Generic (PLEG): container finished" podID="e9ea17c9-93ad-49f8-936f-59e27c59d4f6" containerID="6771857c6a9c472976b088216568658479c6f0fe069a706915e64592c95ee983" exitCode=0 Jul 06 22:28:54.366616 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:54.366240 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" event={"ID":"e9ea17c9-93ad-49f8-936f-59e27c59d4f6","Type":"ContainerDied","Data":"6771857c6a9c472976b088216568658479c6f0fe069a706915e64592c95ee983"} Jul 06 22:28:54.366782 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:54.366768 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:28:55.373391 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:55.373294 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" event={"ID":"e9ea17c9-93ad-49f8-936f-59e27c59d4f6","Type":"ContainerStarted","Data":"dc90316ecc79f3e9009b9c00ae4432f95561c2547220c47d9482d4ac80f0a705"} Jul 06 22:28:55.373792 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:55.373424 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:28:55.411283 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:28:55.411223 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" podStartSLOduration=1.954970333 podStartE2EDuration="6.411201309s" totalImagesPullingTime="3.444412555s" totalInitContainerRuntime="1.011818421s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:55.407806183 +0000 UTC m=+302.801399993" watchObservedRunningTime="2026-07-06 22:28:55.411201309 +0000 UTC m=+302.804795121" Jul 06 22:29:06.380158 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:06.380124 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84b8787b6c-j294w" Jul 06 22:29:09.021779 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.021747 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt"] Jul 06 22:29:09.035793 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.035772 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.040556 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.040177 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 22:29:09.041699 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.041674 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mslft\"" Jul 06 22:29:09.041880 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.041862 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 22:29:09.042019 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.041689 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:29:09.042270 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.041825 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 22:29:09.042556 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.041737 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 22:29:09.045770 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.045748 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt"] Jul 06 22:29:09.146884 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.146850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aedc9a01-0271-48c2-aabd-682be20862dd-manager-config\") pod \"lws-controller-manager-69b75b5694-hthdt\" (UID: \"aedc9a01-0271-48c2-aabd-682be20862dd\") " pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.146884 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.146889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aedc9a01-0271-48c2-aabd-682be20862dd-cert\") pod \"lws-controller-manager-69b75b5694-hthdt\" (UID: \"aedc9a01-0271-48c2-aabd-682be20862dd\") " pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.147093 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.146919 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aedc9a01-0271-48c2-aabd-682be20862dd-metrics-cert\") pod \"lws-controller-manager-69b75b5694-hthdt\" (UID: \"aedc9a01-0271-48c2-aabd-682be20862dd\") " pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.147093 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.146935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87vgz\" (UniqueName: \"kubernetes.io/projected/aedc9a01-0271-48c2-aabd-682be20862dd-kube-api-access-87vgz\") pod \"lws-controller-manager-69b75b5694-hthdt\" (UID: \"aedc9a01-0271-48c2-aabd-682be20862dd\") " pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.247943 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.247915 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aedc9a01-0271-48c2-aabd-682be20862dd-metrics-cert\") pod \"lws-controller-manager-69b75b5694-hthdt\" (UID: \"aedc9a01-0271-48c2-aabd-682be20862dd\") " pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.247943 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.247946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87vgz\" (UniqueName: \"kubernetes.io/projected/aedc9a01-0271-48c2-aabd-682be20862dd-kube-api-access-87vgz\") pod \"lws-controller-manager-69b75b5694-hthdt\" (UID: \"aedc9a01-0271-48c2-aabd-682be20862dd\") " pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.248167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.248085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aedc9a01-0271-48c2-aabd-682be20862dd-manager-config\") pod \"lws-controller-manager-69b75b5694-hthdt\" (UID: \"aedc9a01-0271-48c2-aabd-682be20862dd\") " pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.248167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.248140 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aedc9a01-0271-48c2-aabd-682be20862dd-cert\") pod \"lws-controller-manager-69b75b5694-hthdt\" (UID: \"aedc9a01-0271-48c2-aabd-682be20862dd\") " pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.248923 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.248898 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aedc9a01-0271-48c2-aabd-682be20862dd-manager-config\") pod \"lws-controller-manager-69b75b5694-hthdt\" (UID: \"aedc9a01-0271-48c2-aabd-682be20862dd\") " pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.250460 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.250438 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aedc9a01-0271-48c2-aabd-682be20862dd-cert\") pod \"lws-controller-manager-69b75b5694-hthdt\" (UID: \"aedc9a01-0271-48c2-aabd-682be20862dd\") " pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.250557 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.250543 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aedc9a01-0271-48c2-aabd-682be20862dd-metrics-cert\") pod \"lws-controller-manager-69b75b5694-hthdt\" (UID: \"aedc9a01-0271-48c2-aabd-682be20862dd\") " pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.282517 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.282401 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87vgz\" (UniqueName: \"kubernetes.io/projected/aedc9a01-0271-48c2-aabd-682be20862dd-kube-api-access-87vgz\") pod \"lws-controller-manager-69b75b5694-hthdt\" (UID: \"aedc9a01-0271-48c2-aabd-682be20862dd\") " pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.350920 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.350887 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:09.555274 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:09.555206 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt"] Jul 06 22:29:09.559218 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:29:09.559192 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaedc9a01_0271_48c2_aabd_682be20862dd.slice/crio-620de802e7ce28354cec3fc61788800d3c1a4afeae68a61a4f612511eb3ef8fa WatchSource:0}: Error finding container 620de802e7ce28354cec3fc61788800d3c1a4afeae68a61a4f612511eb3ef8fa: Status 404 returned error can't find the container with id 620de802e7ce28354cec3fc61788800d3c1a4afeae68a61a4f612511eb3ef8fa Jul 06 22:29:10.441871 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:10.441829 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" event={"ID":"aedc9a01-0271-48c2-aabd-682be20862dd","Type":"ContainerStarted","Data":"620de802e7ce28354cec3fc61788800d3c1a4afeae68a61a4f612511eb3ef8fa"} Jul 06 22:29:11.447959 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:11.447918 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" event={"ID":"aedc9a01-0271-48c2-aabd-682be20862dd","Type":"ContainerStarted","Data":"e1714649920ac5975f2943101758e8bc583cde00e7fdfa1152b61fce87b8bf04"} Jul 06 22:29:11.448337 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:11.448008 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:11.509138 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:11.509087 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" podStartSLOduration=2.096147577 podStartE2EDuration="3.509071634s" totalImagesPullingTime="1.412924057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:29:11.506283227 +0000 UTC m=+318.899877062" watchObservedRunningTime="2026-07-06 22:29:11.509071634 +0000 UTC m=+318.902665446" Jul 06 22:29:18.197594 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.197560 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm"] Jul 06 22:29:18.200716 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.200699 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.203559 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.203537 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-db6bf\"" Jul 06 22:29:18.203559 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.203554 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 22:29:18.203767 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.203752 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 22:29:18.203830 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.203782 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 22:29:18.203830 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.203796 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 22:29:18.203933 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.203755 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 22:29:18.204618 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.204602 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 22:29:18.214597 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.214570 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm"] Jul 06 22:29:18.323680 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.323644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af331e8b-3b06-479f-b926-2120fc547d8d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.323680 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.323686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af331e8b-3b06-479f-b926-2120fc547d8d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.323894 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.323716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af331e8b-3b06-479f-b926-2120fc547d8d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.323894 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.323751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af331e8b-3b06-479f-b926-2120fc547d8d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.323894 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.323774 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af331e8b-3b06-479f-b926-2120fc547d8d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.323894 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.323803 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fgjj\" (UniqueName: \"kubernetes.io/projected/af331e8b-3b06-479f-b926-2120fc547d8d-kube-api-access-2fgjj\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.323894 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.323850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af331e8b-3b06-479f-b926-2120fc547d8d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.424572 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.424535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af331e8b-3b06-479f-b926-2120fc547d8d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.424731 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.424587 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af331e8b-3b06-479f-b926-2120fc547d8d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.424731 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.424620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af331e8b-3b06-479f-b926-2120fc547d8d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.424731 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.424650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af331e8b-3b06-479f-b926-2120fc547d8d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.424857 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.424783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af331e8b-3b06-479f-b926-2120fc547d8d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.424857 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.424827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af331e8b-3b06-479f-b926-2120fc547d8d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.424991 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.424951 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fgjj\" (UniqueName: \"kubernetes.io/projected/af331e8b-3b06-479f-b926-2120fc547d8d-kube-api-access-2fgjj\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.425529 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.425507 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af331e8b-3b06-479f-b926-2120fc547d8d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.426970 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.426944 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af331e8b-3b06-479f-b926-2120fc547d8d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.427086 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.427072 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af331e8b-3b06-479f-b926-2120fc547d8d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.427212 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.427195 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af331e8b-3b06-479f-b926-2120fc547d8d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.427338 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.427319 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af331e8b-3b06-479f-b926-2120fc547d8d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.445225 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.445195 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fgjj\" (UniqueName: \"kubernetes.io/projected/af331e8b-3b06-479f-b926-2120fc547d8d-kube-api-access-2fgjj\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.455388 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.455332 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af331e8b-3b06-479f-b926-2120fc547d8d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-srqtm\" (UID: \"af331e8b-3b06-479f-b926-2120fc547d8d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.510777 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.510751 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:18.712147 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:18.712112 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm"] Jul 06 22:29:18.713738 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:29:18.713713 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf331e8b_3b06_479f_b926_2120fc547d8d.slice/crio-41821b685a35d666bcb904b86d739fcc4fe3912519fd0948ee7e067b7947eff2 WatchSource:0}: Error finding container 41821b685a35d666bcb904b86d739fcc4fe3912519fd0948ee7e067b7947eff2: Status 404 returned error can't find the container with id 41821b685a35d666bcb904b86d739fcc4fe3912519fd0948ee7e067b7947eff2 Jul 06 22:29:19.482280 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:19.482242 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" event={"ID":"af331e8b-3b06-479f-b926-2120fc547d8d","Type":"ContainerStarted","Data":"41821b685a35d666bcb904b86d739fcc4fe3912519fd0948ee7e067b7947eff2"} Jul 06 22:29:22.221536 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:22.221500 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:29:22.221894 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:22.221582 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:29:22.454469 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:22.454436 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69b75b5694-hthdt" Jul 06 22:29:22.504192 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:22.503228 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" event={"ID":"af331e8b-3b06-479f-b926-2120fc547d8d","Type":"ContainerStarted","Data":"197040899e5fdf857e3b2a38060bf0a512d2729c02ddb00a6c3309ef75b0f522"} Jul 06 22:29:22.504192 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:22.504088 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:29:22.535602 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:22.535550 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" podStartSLOduration=1.030001914 podStartE2EDuration="4.535534165s" totalImagesPullingTime="3.505532251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:29:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:29:22.533657396 +0000 UTC m=+329.927251233" watchObservedRunningTime="2026-07-06 22:29:22.535534165 +0000 UTC m=+329.929127977" Jul 06 22:29:23.509949 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:29:23.509921 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-srqtm" Jul 06 22:30:26.909392 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:26.909359 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m"] Jul 06 22:30:26.914184 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:26.914165 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:26.916945 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:26.916917 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 22:30:26.917059 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:26.916923 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xfnb6\"" Jul 06 22:30:26.918123 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:26.918102 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 22:30:26.920706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:26.920684 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m"] Jul 06 22:30:27.067284 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.067238 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4236c2a0-0b42-45ab-abe6-3d15a9370af4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m\" (UID: \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:27.067284 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.067295 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4236c2a0-0b42-45ab-abe6-3d15a9370af4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m\" (UID: \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:27.067482 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.067347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqjps\" (UniqueName: \"kubernetes.io/projected/4236c2a0-0b42-45ab-abe6-3d15a9370af4-kube-api-access-gqjps\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m\" (UID: \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:27.168641 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.168563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4236c2a0-0b42-45ab-abe6-3d15a9370af4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m\" (UID: \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:27.168641 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.168604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4236c2a0-0b42-45ab-abe6-3d15a9370af4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m\" (UID: \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:27.168641 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.168633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqjps\" (UniqueName: \"kubernetes.io/projected/4236c2a0-0b42-45ab-abe6-3d15a9370af4-kube-api-access-gqjps\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m\" (UID: \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:27.169004 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.168982 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4236c2a0-0b42-45ab-abe6-3d15a9370af4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m\" (UID: \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:27.169069 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.169012 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4236c2a0-0b42-45ab-abe6-3d15a9370af4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m\" (UID: \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:27.178868 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.178841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqjps\" (UniqueName: \"kubernetes.io/projected/4236c2a0-0b42-45ab-abe6-3d15a9370af4-kube-api-access-gqjps\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m\" (UID: \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:27.224279 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.224259 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:27.351635 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.351609 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m"] Jul 06 22:30:27.353978 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:30:27.353938 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4236c2a0_0b42_45ab_abe6_3d15a9370af4.slice/crio-1a3e5ca66fe0f2f43f324e8849aefefca8ea2443028402652f95fd8905ced311 WatchSource:0}: Error finding container 1a3e5ca66fe0f2f43f324e8849aefefca8ea2443028402652f95fd8905ced311: Status 404 returned error can't find the container with id 1a3e5ca66fe0f2f43f324e8849aefefca8ea2443028402652f95fd8905ced311 Jul 06 22:30:27.522987 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.522955 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl"] Jul 06 22:30:27.526206 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.526189 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:27.538414 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.538391 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl"] Jul 06 22:30:27.672526 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.672431 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl\" (UID: \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:27.672526 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.672474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl\" (UID: \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:27.672722 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.672549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m6zp\" (UniqueName: \"kubernetes.io/projected/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-kube-api-access-9m6zp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl\" (UID: \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:27.773100 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.773065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl\" (UID: \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:27.773231 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.773116 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl\" (UID: \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:27.773231 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.773166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m6zp\" (UniqueName: \"kubernetes.io/projected/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-kube-api-access-9m6zp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl\" (UID: \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:27.773464 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.773441 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl\" (UID: \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:27.773558 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.773477 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl\" (UID: \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:27.782516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.782474 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m6zp\" (UniqueName: \"kubernetes.io/projected/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-kube-api-access-9m6zp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl\" (UID: \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:27.785713 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.785683 2564 generic.go:356] "Generic (PLEG): container finished" podID="4236c2a0-0b42-45ab-abe6-3d15a9370af4" containerID="940fc4b6e60e0600e68a8cf9bc8a063c2c8beda2d00b3849955588b8fbfc29d6" exitCode=0 Jul 06 22:30:27.785874 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.785768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" event={"ID":"4236c2a0-0b42-45ab-abe6-3d15a9370af4","Type":"ContainerDied","Data":"940fc4b6e60e0600e68a8cf9bc8a063c2c8beda2d00b3849955588b8fbfc29d6"} Jul 06 22:30:27.785874 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.785822 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" event={"ID":"4236c2a0-0b42-45ab-abe6-3d15a9370af4","Type":"ContainerStarted","Data":"1a3e5ca66fe0f2f43f324e8849aefefca8ea2443028402652f95fd8905ced311"} Jul 06 22:30:27.840956 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.840931 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:27.906332 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.906306 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk"] Jul 06 22:30:27.909831 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.909815 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:27.917701 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.917677 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk"] Jul 06 22:30:27.974212 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:27.974189 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl"] Jul 06 22:30:27.975967 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:30:27.975929 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb389e69a_a456_446e_b0e1_a85e2cfb1fb3.slice/crio-4b6551a9c375fd3e2c8ea810a0b09cfdc4e8bcb937563677752f15c0740783eb WatchSource:0}: Error finding container 4b6551a9c375fd3e2c8ea810a0b09cfdc4e8bcb937563677752f15c0740783eb: Status 404 returned error can't find the container with id 4b6551a9c375fd3e2c8ea810a0b09cfdc4e8bcb937563677752f15c0740783eb Jul 06 22:30:28.074667 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.074641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znf52\" (UniqueName: \"kubernetes.io/projected/d41efa55-2bf5-497d-8613-73369e6b26da-kube-api-access-znf52\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk\" (UID: \"d41efa55-2bf5-497d-8613-73369e6b26da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:28.074778 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.074689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d41efa55-2bf5-497d-8613-73369e6b26da-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk\" (UID: \"d41efa55-2bf5-497d-8613-73369e6b26da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:28.074778 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.074764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d41efa55-2bf5-497d-8613-73369e6b26da-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk\" (UID: \"d41efa55-2bf5-497d-8613-73369e6b26da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:28.175973 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.175945 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d41efa55-2bf5-497d-8613-73369e6b26da-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk\" (UID: \"d41efa55-2bf5-497d-8613-73369e6b26da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:28.176101 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.175992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d41efa55-2bf5-497d-8613-73369e6b26da-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk\" (UID: \"d41efa55-2bf5-497d-8613-73369e6b26da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:28.176101 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.176041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znf52\" (UniqueName: \"kubernetes.io/projected/d41efa55-2bf5-497d-8613-73369e6b26da-kube-api-access-znf52\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk\" (UID: \"d41efa55-2bf5-497d-8613-73369e6b26da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:28.176316 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.176296 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d41efa55-2bf5-497d-8613-73369e6b26da-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk\" (UID: \"d41efa55-2bf5-497d-8613-73369e6b26da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:28.176390 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.176372 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d41efa55-2bf5-497d-8613-73369e6b26da-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk\" (UID: \"d41efa55-2bf5-497d-8613-73369e6b26da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:28.184509 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.184478 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znf52\" (UniqueName: \"kubernetes.io/projected/d41efa55-2bf5-497d-8613-73369e6b26da-kube-api-access-znf52\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk\" (UID: \"d41efa55-2bf5-497d-8613-73369e6b26da\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:28.219937 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.219910 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:28.307592 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.307561 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9"] Jul 06 22:30:28.311255 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.311231 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:30:28.319478 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.319452 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9"] Jul 06 22:30:28.350297 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.350275 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk"] Jul 06 22:30:28.352111 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:30:28.352087 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41efa55_2bf5_497d_8613_73369e6b26da.slice/crio-09c546d29d110c478dc7062156f513df97a800ecc44726da2ba80001ed9bd05c WatchSource:0}: Error finding container 09c546d29d110c478dc7062156f513df97a800ecc44726da2ba80001ed9bd05c: Status 404 returned error can't find the container with id 09c546d29d110c478dc7062156f513df97a800ecc44726da2ba80001ed9bd05c Jul 06 22:30:28.478422 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.478401 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bce170c5-6aa2-4993-8439-a29e63db725b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9\" (UID: \"bce170c5-6aa2-4993-8439-a29e63db725b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:30:28.478533 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.478450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmp8g\" (UniqueName: \"kubernetes.io/projected/bce170c5-6aa2-4993-8439-a29e63db725b-kube-api-access-gmp8g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9\" (UID: \"bce170c5-6aa2-4993-8439-a29e63db725b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:30:28.478576 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.478533 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bce170c5-6aa2-4993-8439-a29e63db725b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9\" (UID: \"bce170c5-6aa2-4993-8439-a29e63db725b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:30:28.579599 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.579576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmp8g\" (UniqueName: \"kubernetes.io/projected/bce170c5-6aa2-4993-8439-a29e63db725b-kube-api-access-gmp8g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9\" (UID: \"bce170c5-6aa2-4993-8439-a29e63db725b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:30:28.579701 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.579623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bce170c5-6aa2-4993-8439-a29e63db725b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9\" (UID: \"bce170c5-6aa2-4993-8439-a29e63db725b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:30:28.579701 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.579653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bce170c5-6aa2-4993-8439-a29e63db725b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9\" (UID: \"bce170c5-6aa2-4993-8439-a29e63db725b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:30:28.579952 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.579938 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bce170c5-6aa2-4993-8439-a29e63db725b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9\" (UID: \"bce170c5-6aa2-4993-8439-a29e63db725b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:30:28.579985 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.579964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bce170c5-6aa2-4993-8439-a29e63db725b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9\" (UID: \"bce170c5-6aa2-4993-8439-a29e63db725b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:30:28.587500 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.587469 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmp8g\" (UniqueName: \"kubernetes.io/projected/bce170c5-6aa2-4993-8439-a29e63db725b-kube-api-access-gmp8g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9\" (UID: \"bce170c5-6aa2-4993-8439-a29e63db725b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:30:28.623071 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.623042 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:30:28.751469 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.751442 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9"] Jul 06 22:30:28.753739 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:30:28.753714 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce170c5_6aa2_4993_8439_a29e63db725b.slice/crio-227094de603e8b75bd5f9f6629e050a93518cecf12765dc6854c29cda3166dee WatchSource:0}: Error finding container 227094de603e8b75bd5f9f6629e050a93518cecf12765dc6854c29cda3166dee: Status 404 returned error can't find the container with id 227094de603e8b75bd5f9f6629e050a93518cecf12765dc6854c29cda3166dee Jul 06 22:30:28.793273 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.793245 2564 generic.go:356] "Generic (PLEG): container finished" podID="4236c2a0-0b42-45ab-abe6-3d15a9370af4" containerID="38356fe904ba4aa85896cb48bdd33f41fca245207ed8bec0a1b6bff3d7ac1b62" exitCode=0 Jul 06 22:30:28.793390 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.793339 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" event={"ID":"4236c2a0-0b42-45ab-abe6-3d15a9370af4","Type":"ContainerDied","Data":"38356fe904ba4aa85896cb48bdd33f41fca245207ed8bec0a1b6bff3d7ac1b62"} Jul 06 22:30:28.794973 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.794945 2564 generic.go:356] "Generic (PLEG): container finished" podID="d41efa55-2bf5-497d-8613-73369e6b26da" containerID="5cb676489dd45876832354cded98fd6f82727b0e267f911c99498be172794870" exitCode=0 Jul 06 22:30:28.795063 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.794983 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" event={"ID":"d41efa55-2bf5-497d-8613-73369e6b26da","Type":"ContainerDied","Data":"5cb676489dd45876832354cded98fd6f82727b0e267f911c99498be172794870"} Jul 06 22:30:28.795063 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.795033 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" event={"ID":"d41efa55-2bf5-497d-8613-73369e6b26da","Type":"ContainerStarted","Data":"09c546d29d110c478dc7062156f513df97a800ecc44726da2ba80001ed9bd05c"} Jul 06 22:30:28.796635 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.796613 2564 generic.go:356] "Generic (PLEG): container finished" podID="b389e69a-a456-446e-b0e1-a85e2cfb1fb3" containerID="c16868501adda810e4a7ce32b211c94b5780ba235d2488e92ea1141e2c53d334" exitCode=0 Jul 06 22:30:28.796751 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.796710 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" event={"ID":"b389e69a-a456-446e-b0e1-a85e2cfb1fb3","Type":"ContainerDied","Data":"c16868501adda810e4a7ce32b211c94b5780ba235d2488e92ea1141e2c53d334"} Jul 06 22:30:28.796751 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.796747 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" event={"ID":"b389e69a-a456-446e-b0e1-a85e2cfb1fb3","Type":"ContainerStarted","Data":"4b6551a9c375fd3e2c8ea810a0b09cfdc4e8bcb937563677752f15c0740783eb"} Jul 06 22:30:28.798237 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:28.798217 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" event={"ID":"bce170c5-6aa2-4993-8439-a29e63db725b","Type":"ContainerStarted","Data":"227094de603e8b75bd5f9f6629e050a93518cecf12765dc6854c29cda3166dee"} Jul 06 22:30:29.806481 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:29.806451 2564 generic.go:356] "Generic (PLEG): container finished" podID="4236c2a0-0b42-45ab-abe6-3d15a9370af4" containerID="63094edf9b90031691fe75f925b7a36eb4775c2063bc78660c406490121bf4b1" exitCode=0 Jul 06 22:30:29.806805 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:29.806523 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" event={"ID":"4236c2a0-0b42-45ab-abe6-3d15a9370af4","Type":"ContainerDied","Data":"63094edf9b90031691fe75f925b7a36eb4775c2063bc78660c406490121bf4b1"} Jul 06 22:30:29.808175 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:29.808155 2564 generic.go:356] "Generic (PLEG): container finished" podID="bce170c5-6aa2-4993-8439-a29e63db725b" containerID="0465b772ff1f5e9c4f59880c899cb62317c231fa692c7d22550906e0f0d4987c" exitCode=0 Jul 06 22:30:29.808258 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:29.808187 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" event={"ID":"bce170c5-6aa2-4993-8439-a29e63db725b","Type":"ContainerDied","Data":"0465b772ff1f5e9c4f59880c899cb62317c231fa692c7d22550906e0f0d4987c"} Jul 06 22:30:30.815375 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:30.815276 2564 generic.go:356] "Generic (PLEG): container finished" podID="d41efa55-2bf5-497d-8613-73369e6b26da" containerID="b38481b338884631796dc7ecd0bc1f1ee2096aee726930f15b8ee410d425a032" exitCode=0 Jul 06 22:30:30.815843 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:30.815368 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" event={"ID":"d41efa55-2bf5-497d-8613-73369e6b26da","Type":"ContainerDied","Data":"b38481b338884631796dc7ecd0bc1f1ee2096aee726930f15b8ee410d425a032"} Jul 06 22:30:30.817148 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:30.817122 2564 generic.go:356] "Generic (PLEG): container finished" podID="b389e69a-a456-446e-b0e1-a85e2cfb1fb3" containerID="f614572694bf38549f8d63eb1c099a13eac8e7a83d5139738c2700aab1d84b46" exitCode=0 Jul 06 22:30:30.817242 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:30.817157 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" event={"ID":"b389e69a-a456-446e-b0e1-a85e2cfb1fb3","Type":"ContainerDied","Data":"f614572694bf38549f8d63eb1c099a13eac8e7a83d5139738c2700aab1d84b46"} Jul 06 22:30:30.819112 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:30.819093 2564 generic.go:356] "Generic (PLEG): container finished" podID="bce170c5-6aa2-4993-8439-a29e63db725b" containerID="be5b1cfed1dcfb5d690b9f1b02cc852714178b5956c64d25cfc3c7277dcda596" exitCode=0 Jul 06 22:30:30.819208 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:30.819170 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" event={"ID":"bce170c5-6aa2-4993-8439-a29e63db725b","Type":"ContainerDied","Data":"be5b1cfed1dcfb5d690b9f1b02cc852714178b5956c64d25cfc3c7277dcda596"} Jul 06 22:30:30.959572 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:30.959267 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:31.100203 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.100180 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4236c2a0-0b42-45ab-abe6-3d15a9370af4-bundle\") pod \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\" (UID: \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\") " Jul 06 22:30:31.100314 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.100221 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4236c2a0-0b42-45ab-abe6-3d15a9370af4-util\") pod \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\" (UID: \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\") " Jul 06 22:30:31.100314 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.100241 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqjps\" (UniqueName: \"kubernetes.io/projected/4236c2a0-0b42-45ab-abe6-3d15a9370af4-kube-api-access-gqjps\") pod \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\" (UID: \"4236c2a0-0b42-45ab-abe6-3d15a9370af4\") " Jul 06 22:30:31.100643 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.100621 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4236c2a0-0b42-45ab-abe6-3d15a9370af4-bundle" (OuterVolumeSpecName: "bundle") pod "4236c2a0-0b42-45ab-abe6-3d15a9370af4" (UID: "4236c2a0-0b42-45ab-abe6-3d15a9370af4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:30:31.102352 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.102331 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4236c2a0-0b42-45ab-abe6-3d15a9370af4-kube-api-access-gqjps" (OuterVolumeSpecName: "kube-api-access-gqjps") pod "4236c2a0-0b42-45ab-abe6-3d15a9370af4" (UID: "4236c2a0-0b42-45ab-abe6-3d15a9370af4"). InnerVolumeSpecName "kube-api-access-gqjps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:30:31.105710 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.105687 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4236c2a0-0b42-45ab-abe6-3d15a9370af4-util" (OuterVolumeSpecName: "util") pod "4236c2a0-0b42-45ab-abe6-3d15a9370af4" (UID: "4236c2a0-0b42-45ab-abe6-3d15a9370af4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:30:31.201334 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.201294 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4236c2a0-0b42-45ab-abe6-3d15a9370af4-bundle\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:30:31.201334 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.201329 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4236c2a0-0b42-45ab-abe6-3d15a9370af4-util\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:30:31.201521 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.201343 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqjps\" (UniqueName: \"kubernetes.io/projected/4236c2a0-0b42-45ab-abe6-3d15a9370af4-kube-api-access-gqjps\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:30:31.824913 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.824834 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" Jul 06 22:30:31.824913 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.824861 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m" event={"ID":"4236c2a0-0b42-45ab-abe6-3d15a9370af4","Type":"ContainerDied","Data":"1a3e5ca66fe0f2f43f324e8849aefefca8ea2443028402652f95fd8905ced311"} Jul 06 22:30:31.825364 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.824916 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a3e5ca66fe0f2f43f324e8849aefefca8ea2443028402652f95fd8905ced311" Jul 06 22:30:31.826831 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.826803 2564 generic.go:356] "Generic (PLEG): container finished" podID="d41efa55-2bf5-497d-8613-73369e6b26da" containerID="71ffd609f44c3270e0904a303e94bf04e88b08cd40f40a55830681a089d3c186" exitCode=0 Jul 06 22:30:31.826955 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.826884 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" event={"ID":"d41efa55-2bf5-497d-8613-73369e6b26da","Type":"ContainerDied","Data":"71ffd609f44c3270e0904a303e94bf04e88b08cd40f40a55830681a089d3c186"} Jul 06 22:30:31.828905 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.828885 2564 generic.go:356] "Generic (PLEG): container finished" podID="b389e69a-a456-446e-b0e1-a85e2cfb1fb3" containerID="3b18b447cee8c59b090f08311c8b5927038d1faccee2f8d6316ff51f55288dea" exitCode=0 Jul 06 22:30:31.829008 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.828957 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" event={"ID":"b389e69a-a456-446e-b0e1-a85e2cfb1fb3","Type":"ContainerDied","Data":"3b18b447cee8c59b090f08311c8b5927038d1faccee2f8d6316ff51f55288dea"} Jul 06 22:30:31.831229 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.831209 2564 generic.go:356] "Generic (PLEG): container finished" podID="bce170c5-6aa2-4993-8439-a29e63db725b" containerID="1b6d25c6867ba6c7a8f890e57fafe8a824d542ea00ba16a461628497ca5a7fbb" exitCode=0 Jul 06 22:30:31.831325 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:31.831241 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" event={"ID":"bce170c5-6aa2-4993-8439-a29e63db725b","Type":"ContainerDied","Data":"1b6d25c6867ba6c7a8f890e57fafe8a824d542ea00ba16a461628497ca5a7fbb"} Jul 06 22:30:32.983567 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:32.983542 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:30:33.028387 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.028367 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:33.031120 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.031101 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:33.116642 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.116556 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bce170c5-6aa2-4993-8439-a29e63db725b-bundle\") pod \"bce170c5-6aa2-4993-8439-a29e63db725b\" (UID: \"bce170c5-6aa2-4993-8439-a29e63db725b\") " Jul 06 22:30:33.116642 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.116612 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bce170c5-6aa2-4993-8439-a29e63db725b-util\") pod \"bce170c5-6aa2-4993-8439-a29e63db725b\" (UID: \"bce170c5-6aa2-4993-8439-a29e63db725b\") " Jul 06 22:30:33.116862 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.116654 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmp8g\" (UniqueName: \"kubernetes.io/projected/bce170c5-6aa2-4993-8439-a29e63db725b-kube-api-access-gmp8g\") pod \"bce170c5-6aa2-4993-8439-a29e63db725b\" (UID: \"bce170c5-6aa2-4993-8439-a29e63db725b\") " Jul 06 22:30:33.117129 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.117104 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bce170c5-6aa2-4993-8439-a29e63db725b-bundle" (OuterVolumeSpecName: "bundle") pod "bce170c5-6aa2-4993-8439-a29e63db725b" (UID: "bce170c5-6aa2-4993-8439-a29e63db725b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:30:33.118755 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.118725 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bce170c5-6aa2-4993-8439-a29e63db725b-kube-api-access-gmp8g" (OuterVolumeSpecName: "kube-api-access-gmp8g") pod "bce170c5-6aa2-4993-8439-a29e63db725b" (UID: "bce170c5-6aa2-4993-8439-a29e63db725b"). InnerVolumeSpecName "kube-api-access-gmp8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:30:33.121308 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.121287 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bce170c5-6aa2-4993-8439-a29e63db725b-util" (OuterVolumeSpecName: "util") pod "bce170c5-6aa2-4993-8439-a29e63db725b" (UID: "bce170c5-6aa2-4993-8439-a29e63db725b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:30:33.217366 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.217336 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-util\") pod \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\" (UID: \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\") " Jul 06 22:30:33.217479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.217372 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d41efa55-2bf5-497d-8613-73369e6b26da-bundle\") pod \"d41efa55-2bf5-497d-8613-73369e6b26da\" (UID: \"d41efa55-2bf5-497d-8613-73369e6b26da\") " Jul 06 22:30:33.217479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.217395 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m6zp\" (UniqueName: \"kubernetes.io/projected/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-kube-api-access-9m6zp\") pod \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\" (UID: \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\") " Jul 06 22:30:33.217479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.217429 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znf52\" (UniqueName: \"kubernetes.io/projected/d41efa55-2bf5-497d-8613-73369e6b26da-kube-api-access-znf52\") pod \"d41efa55-2bf5-497d-8613-73369e6b26da\" (UID: \"d41efa55-2bf5-497d-8613-73369e6b26da\") " Jul 06 22:30:33.217479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.217471 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-bundle\") pod \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\" (UID: \"b389e69a-a456-446e-b0e1-a85e2cfb1fb3\") " Jul 06 22:30:33.217651 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.217538 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d41efa55-2bf5-497d-8613-73369e6b26da-util\") pod \"d41efa55-2bf5-497d-8613-73369e6b26da\" (UID: \"d41efa55-2bf5-497d-8613-73369e6b26da\") " Jul 06 22:30:33.217803 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.217786 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bce170c5-6aa2-4993-8439-a29e63db725b-util\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:30:33.217897 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.217806 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmp8g\" (UniqueName: \"kubernetes.io/projected/bce170c5-6aa2-4993-8439-a29e63db725b-kube-api-access-gmp8g\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:30:33.217897 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.217823 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bce170c5-6aa2-4993-8439-a29e63db725b-bundle\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:30:33.218028 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.218003 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41efa55-2bf5-497d-8613-73369e6b26da-bundle" (OuterVolumeSpecName: "bundle") pod "d41efa55-2bf5-497d-8613-73369e6b26da" (UID: "d41efa55-2bf5-497d-8613-73369e6b26da"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:30:33.218102 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.218074 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-bundle" (OuterVolumeSpecName: "bundle") pod "b389e69a-a456-446e-b0e1-a85e2cfb1fb3" (UID: "b389e69a-a456-446e-b0e1-a85e2cfb1fb3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:30:33.219787 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.219759 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d41efa55-2bf5-497d-8613-73369e6b26da-kube-api-access-znf52" (OuterVolumeSpecName: "kube-api-access-znf52") pod "d41efa55-2bf5-497d-8613-73369e6b26da" (UID: "d41efa55-2bf5-497d-8613-73369e6b26da"). InnerVolumeSpecName "kube-api-access-znf52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:30:33.219923 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.219900 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-kube-api-access-9m6zp" (OuterVolumeSpecName: "kube-api-access-9m6zp") pod "b389e69a-a456-446e-b0e1-a85e2cfb1fb3" (UID: "b389e69a-a456-446e-b0e1-a85e2cfb1fb3"). InnerVolumeSpecName "kube-api-access-9m6zp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:30:33.223557 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.223533 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41efa55-2bf5-497d-8613-73369e6b26da-util" (OuterVolumeSpecName: "util") pod "d41efa55-2bf5-497d-8613-73369e6b26da" (UID: "d41efa55-2bf5-497d-8613-73369e6b26da"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:30:33.223656 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.223636 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-util" (OuterVolumeSpecName: "util") pod "b389e69a-a456-446e-b0e1-a85e2cfb1fb3" (UID: "b389e69a-a456-446e-b0e1-a85e2cfb1fb3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:30:33.318132 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.318103 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znf52\" (UniqueName: \"kubernetes.io/projected/d41efa55-2bf5-497d-8613-73369e6b26da-kube-api-access-znf52\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:30:33.318132 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.318127 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-bundle\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:30:33.318132 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.318137 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d41efa55-2bf5-497d-8613-73369e6b26da-util\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:30:33.318335 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.318146 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-util\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:30:33.318335 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.318154 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d41efa55-2bf5-497d-8613-73369e6b26da-bundle\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:30:33.318335 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.318161 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m6zp\" (UniqueName: \"kubernetes.io/projected/b389e69a-a456-446e-b0e1-a85e2cfb1fb3-kube-api-access-9m6zp\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:30:33.842446 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.842408 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" Jul 06 22:30:33.842660 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.842411 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk" event={"ID":"d41efa55-2bf5-497d-8613-73369e6b26da","Type":"ContainerDied","Data":"09c546d29d110c478dc7062156f513df97a800ecc44726da2ba80001ed9bd05c"} Jul 06 22:30:33.842660 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.842564 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09c546d29d110c478dc7062156f513df97a800ecc44726da2ba80001ed9bd05c" Jul 06 22:30:33.844179 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.844164 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" Jul 06 22:30:33.844250 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.844174 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl" event={"ID":"b389e69a-a456-446e-b0e1-a85e2cfb1fb3","Type":"ContainerDied","Data":"4b6551a9c375fd3e2c8ea810a0b09cfdc4e8bcb937563677752f15c0740783eb"} Jul 06 22:30:33.844250 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.844212 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b6551a9c375fd3e2c8ea810a0b09cfdc4e8bcb937563677752f15c0740783eb" Jul 06 22:30:33.846153 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.846128 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" event={"ID":"bce170c5-6aa2-4993-8439-a29e63db725b","Type":"ContainerDied","Data":"227094de603e8b75bd5f9f6629e050a93518cecf12765dc6854c29cda3166dee"} Jul 06 22:30:33.846263 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.846167 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="227094de603e8b75bd5f9f6629e050a93518cecf12765dc6854c29cda3166dee" Jul 06 22:30:33.846263 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:30:33.846136 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9" Jul 06 22:31:35.710652 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710616 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710901 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4236c2a0-0b42-45ab-abe6-3d15a9370af4" containerName="pull" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710912 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4236c2a0-0b42-45ab-abe6-3d15a9370af4" containerName="pull" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710920 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b389e69a-a456-446e-b0e1-a85e2cfb1fb3" containerName="extract" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710925 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b389e69a-a456-446e-b0e1-a85e2cfb1fb3" containerName="extract" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710932 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b389e69a-a456-446e-b0e1-a85e2cfb1fb3" containerName="util" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710938 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b389e69a-a456-446e-b0e1-a85e2cfb1fb3" containerName="util" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710944 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bce170c5-6aa2-4993-8439-a29e63db725b" containerName="util" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710949 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bce170c5-6aa2-4993-8439-a29e63db725b" containerName="util" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710957 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41efa55-2bf5-497d-8613-73369e6b26da" containerName="extract" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710961 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41efa55-2bf5-497d-8613-73369e6b26da" containerName="extract" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710969 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41efa55-2bf5-497d-8613-73369e6b26da" containerName="util" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710973 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41efa55-2bf5-497d-8613-73369e6b26da" containerName="util" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710980 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bce170c5-6aa2-4993-8439-a29e63db725b" containerName="pull" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710985 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bce170c5-6aa2-4993-8439-a29e63db725b" containerName="pull" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710992 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b389e69a-a456-446e-b0e1-a85e2cfb1fb3" containerName="pull" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.710997 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b389e69a-a456-446e-b0e1-a85e2cfb1fb3" containerName="pull" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.711003 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41efa55-2bf5-497d-8613-73369e6b26da" containerName="pull" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.711008 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41efa55-2bf5-497d-8613-73369e6b26da" containerName="pull" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.711014 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4236c2a0-0b42-45ab-abe6-3d15a9370af4" containerName="util" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.711019 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4236c2a0-0b42-45ab-abe6-3d15a9370af4" containerName="util" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.711026 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bce170c5-6aa2-4993-8439-a29e63db725b" containerName="extract" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.711030 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bce170c5-6aa2-4993-8439-a29e63db725b" containerName="extract" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.711038 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4236c2a0-0b42-45ab-abe6-3d15a9370af4" containerName="extract" Jul 06 22:31:35.711068 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.711042 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4236c2a0-0b42-45ab-abe6-3d15a9370af4" containerName="extract" Jul 06 22:31:35.711767 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.711089 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4236c2a0-0b42-45ab-abe6-3d15a9370af4" containerName="extract" Jul 06 22:31:35.711767 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.711096 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d41efa55-2bf5-497d-8613-73369e6b26da" containerName="extract" Jul 06 22:31:35.711767 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.711104 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b389e69a-a456-446e-b0e1-a85e2cfb1fb3" containerName="extract" Jul 06 22:31:35.711767 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.711111 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bce170c5-6aa2-4993-8439-a29e63db725b" containerName="extract" Jul 06 22:31:35.714014 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.713996 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" Jul 06 22:31:35.717192 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.717172 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 22:31:35.717291 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.717226 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xfnb6\"" Jul 06 22:31:35.718245 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.718227 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 22:31:35.718311 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.718243 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 22:31:35.725445 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.725425 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:31:35.762547 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.762525 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:31:35.776226 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.776201 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2bf56612-f1e6-42f9-ae0a-270ebe5b9493-config-file\") pod \"limitador-limitador-54d6d988d5-jsfmh\" (UID: \"2bf56612-f1e6-42f9-ae0a-270ebe5b9493\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" Jul 06 22:31:35.776312 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.776245 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55wn8\" (UniqueName: \"kubernetes.io/projected/2bf56612-f1e6-42f9-ae0a-270ebe5b9493-kube-api-access-55wn8\") pod \"limitador-limitador-54d6d988d5-jsfmh\" (UID: \"2bf56612-f1e6-42f9-ae0a-270ebe5b9493\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" Jul 06 22:31:35.877070 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.877036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2bf56612-f1e6-42f9-ae0a-270ebe5b9493-config-file\") pod \"limitador-limitador-54d6d988d5-jsfmh\" (UID: \"2bf56612-f1e6-42f9-ae0a-270ebe5b9493\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" Jul 06 22:31:35.877209 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.877084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55wn8\" (UniqueName: \"kubernetes.io/projected/2bf56612-f1e6-42f9-ae0a-270ebe5b9493-kube-api-access-55wn8\") pod \"limitador-limitador-54d6d988d5-jsfmh\" (UID: \"2bf56612-f1e6-42f9-ae0a-270ebe5b9493\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" Jul 06 22:31:35.877698 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.877680 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2bf56612-f1e6-42f9-ae0a-270ebe5b9493-config-file\") pod \"limitador-limitador-54d6d988d5-jsfmh\" (UID: \"2bf56612-f1e6-42f9-ae0a-270ebe5b9493\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" Jul 06 22:31:35.886781 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:35.886751 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55wn8\" (UniqueName: \"kubernetes.io/projected/2bf56612-f1e6-42f9-ae0a-270ebe5b9493-kube-api-access-55wn8\") pod \"limitador-limitador-54d6d988d5-jsfmh\" (UID: \"2bf56612-f1e6-42f9-ae0a-270ebe5b9493\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" Jul 06 22:31:36.023958 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:36.023857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" Jul 06 22:31:36.165618 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:36.165595 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:31:36.168364 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:31:36.168335 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf56612_f1e6_42f9_ae0a_270ebe5b9493.slice/crio-d7a1bd49c6bc4068b61b7b70e0fd52114032e2b232d7db2b3410ec4911a4afaf WatchSource:0}: Error finding container d7a1bd49c6bc4068b61b7b70e0fd52114032e2b232d7db2b3410ec4911a4afaf: Status 404 returned error can't find the container with id d7a1bd49c6bc4068b61b7b70e0fd52114032e2b232d7db2b3410ec4911a4afaf Jul 06 22:31:37.138800 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:37.138758 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" event={"ID":"2bf56612-f1e6-42f9-ae0a-270ebe5b9493","Type":"ContainerStarted","Data":"d7a1bd49c6bc4068b61b7b70e0fd52114032e2b232d7db2b3410ec4911a4afaf"} Jul 06 22:31:39.151429 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:39.151391 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" event={"ID":"2bf56612-f1e6-42f9-ae0a-270ebe5b9493","Type":"ContainerStarted","Data":"f2edea6f4b8363d3409b4daecf5c575f8f5e0c889431540a52b5b55aca3c8f36"} Jul 06 22:31:39.151870 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:39.151464 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" Jul 06 22:31:39.173052 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:39.172997 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" podStartSLOduration=1.543319337 podStartE2EDuration="4.172982719s" totalImagesPullingTime="2.629663382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:31:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:31:39.171606674 +0000 UTC m=+466.565200497" watchObservedRunningTime="2026-07-06 22:31:39.172982719 +0000 UTC m=+466.566576572" Jul 06 22:31:50.158056 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:31:50.158026 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsfmh" Jul 06 22:32:52.517566 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:32:52.517468 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:33:32.634391 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:33:32.634355 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:33:43.830969 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:33:43.830932 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:33:53.214680 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:33:53.214575 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:33:53.218938 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:33:53.216438 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:33:53.223051 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:33:53.223027 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:33:53.224775 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:33:53.224757 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:33:59.229533 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:33:59.229497 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:34:12.119664 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.119623 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv"] Jul 06 22:34:12.123317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.123294 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.126651 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.126631 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 22:34:12.127964 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.127947 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w2bxs\"" Jul 06 22:34:12.128063 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.127950 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 22:34:12.128475 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.128460 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 22:34:12.136325 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.136297 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv"] Jul 06 22:34:12.231355 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.231324 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.231564 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.231399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.231648 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.231567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klp95\" (UniqueName: \"kubernetes.io/projected/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-kube-api-access-klp95\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.231648 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.231600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.231740 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.231714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.231798 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.231782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.332188 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.332146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klp95\" (UniqueName: \"kubernetes.io/projected/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-kube-api-access-klp95\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.332188 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.332190 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.332421 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.332244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.332421 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.332291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.332421 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.332318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.332421 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.332360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.332678 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.332605 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.332678 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.332654 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.332795 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.332771 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.334749 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.334714 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.334941 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.334923 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.346626 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.346598 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klp95\" (UniqueName: \"kubernetes.io/projected/1b8dd7e9-8e99-429f-8bdb-0c15c87799f6-kube-api-access-klp95\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv\" (UID: \"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.433762 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.433678 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:12.566865 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.566842 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv"] Jul 06 22:34:12.568703 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:34:12.568678 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8dd7e9_8e99_429f_8bdb_0c15c87799f6.slice/crio-a925cb5f3ad34984787a958e0c1ee878fa8fba32493d68dfedae1d01995d3801 WatchSource:0}: Error finding container a925cb5f3ad34984787a958e0c1ee878fa8fba32493d68dfedae1d01995d3801: Status 404 returned error can't find the container with id a925cb5f3ad34984787a958e0c1ee878fa8fba32493d68dfedae1d01995d3801 Jul 06 22:34:12.569981 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.569964 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:34:12.879860 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:12.879813 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" event={"ID":"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6","Type":"ContainerStarted","Data":"a925cb5f3ad34984787a958e0c1ee878fa8fba32493d68dfedae1d01995d3801"} Jul 06 22:34:13.848903 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:13.848871 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:34:13.887102 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:13.887072 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" event={"ID":"1b8dd7e9-8e99-429f-8bdb-0c15c87799f6","Type":"ContainerStarted","Data":"6adcfde542762e571494ac4b2fbb12541f31715b6d4f736c9316debed650593a"} Jul 06 22:34:22.434303 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:22.434216 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:22.434303 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:22.434284 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:22.446586 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:22.446562 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:22.465549 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:22.465509 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" podStartSLOduration=9.466336038 podStartE2EDuration="10.465473711s" totalImagesPullingTime="999.137673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:34:13.936716124 +0000 UTC m=+621.330309936" watchObservedRunningTime="2026-07-06 22:34:22.465473711 +0000 UTC m=+629.859067523" Jul 06 22:34:22.945861 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:22.945833 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv" Jul 06 22:34:26.223220 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:26.223182 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:34:38.671024 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:34:38.670990 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:35:58.931354 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:35:58.931308 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:36:09.428579 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:36:09.428542 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:36:19.638957 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:36:19.638919 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:36:30.032310 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:36:30.032270 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:36:40.431859 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:36:40.431819 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:37:07.629839 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:37:07.629808 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:37:19.630057 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:37:19.629977 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:37:56.336646 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:37:56.336611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:38:05.529028 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:38:05.528989 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:38:12.633401 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:38:12.633364 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:38:19.932274 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:38:19.932240 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:38:30.737434 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:38:30.737394 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:38:39.933902 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:38:39.933870 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:38:51.826920 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:38:51.826883 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:38:53.248962 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:38:53.248858 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:38:53.255692 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:38:53.252739 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:38:53.255692 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:38:53.253669 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:38:53.257595 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:38:53.257577 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:39:01.538273 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:39:01.538239 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:39:24.225103 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:39:24.225069 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:39:35.433101 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:39:35.433069 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:39:58.029596 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:39:58.029556 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:40:07.941852 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:40:07.941817 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:40:24.730638 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:40:24.730562 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:40:34.725920 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:40:34.725884 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:40:44.440109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:40:44.440074 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:40:54.033300 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:40:54.033259 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:41:02.924287 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:41:02.924250 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:42:50.328598 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:42:50.328562 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:43:01.735182 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:43:01.735145 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:43:10.533746 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:43:10.533701 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:43:22.728736 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:43:22.728698 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:43:34.125066 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:43:34.125027 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:43:43.726371 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:43:43.726334 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:43:52.735232 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:43:52.735199 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:43:53.279243 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:43:53.279140 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:43:53.283948 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:43:53.283928 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:43:53.284067 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:43:53.284042 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:43:53.293675 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:43:53.293650 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:44:03.632996 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:44:03.632957 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:44:14.827426 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:44:14.827392 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:44:23.724064 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:44:23.724029 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:44:34.329568 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:44:34.329533 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:44:56.035403 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:44:56.035327 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:45:05.243811 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:45:05.243774 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:45:15.137158 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:45:15.137123 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:45:27.236627 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:45:27.236596 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:45:43.145140 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:45:43.145095 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:45:53.530408 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:45:53.530370 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:46:02.635202 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:46:02.635166 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:46:12.834217 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:46:12.834169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:46:22.124215 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:46:22.124126 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:46:31.641957 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:46:31.641911 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:46:45.837638 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:46:45.837601 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:46:54.739012 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:46:54.738973 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:47:04.756718 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:47:04.756679 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:47:16.733005 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:47:16.732970 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:47:29.633298 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:47:29.633257 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:47:38.135211 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:47:38.135174 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:47:50.029302 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:47:50.029216 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:48:02.637378 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:48:02.637340 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:48:15.028015 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:48:15.027972 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:48:23.830001 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:48:23.829965 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:48:45.429727 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:48:45.429690 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:48:53.320256 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:48:53.320146 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:48:53.324285 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:48:53.323072 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:48:53.325272 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:48:53.325255 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:48:53.327998 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:48:53.327978 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:48:54.834812 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:48:54.834776 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:49:02.836221 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.836191 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm"] Jul 06 22:49:02.839576 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.839552 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:02.842308 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.842284 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e2eb8c66-openshift-default-dockercfg-x9gpm\"" Jul 06 22:49:02.850607 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.850574 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm"] Jul 06 22:49:02.955739 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.955691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-credential-socket\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:02.955739 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.955749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-data\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:02.956013 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.955781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-podinfo\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:02.956013 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.955821 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2qfk\" (UniqueName: \"kubernetes.io/projected/89627762-79f8-4c3a-bce7-bd068b8a2c76-kube-api-access-v2qfk\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:02.956013 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.955899 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-envoy\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:02.956013 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.955932 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-workload-socket\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:02.956013 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.955988 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89627762-79f8-4c3a-bce7-bd068b8a2c76-istiod-ca-cert\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:02.956271 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.956026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-token\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:02.956271 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:02.956060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-workload-certs\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.057188 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.057155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-workload-certs\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.057378 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.057194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-credential-socket\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.057378 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.057214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-data\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.057378 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.057243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-podinfo\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.057378 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.057278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2qfk\" (UniqueName: \"kubernetes.io/projected/89627762-79f8-4c3a-bce7-bd068b8a2c76-kube-api-access-v2qfk\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.057378 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.057334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-envoy\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.057378 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.057371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-workload-socket\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.057737 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.057403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89627762-79f8-4c3a-bce7-bd068b8a2c76-istiod-ca-cert\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.057737 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.057429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-token\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.057737 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.057647 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-workload-certs\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.057737 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.057705 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-credential-socket\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.057880 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.057818 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-workload-socket\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.058101 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.058080 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89627762-79f8-4c3a-bce7-bd068b8a2c76-istiod-ca-cert\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.058180 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.058084 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-data\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.059669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.059640 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-envoy\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.059797 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.059778 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-podinfo\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.066822 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.066802 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-token\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.067044 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.066997 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2qfk\" (UniqueName: \"kubernetes.io/projected/89627762-79f8-4c3a-bce7-bd068b8a2c76-kube-api-access-v2qfk\") pod \"e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.151359 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.151270 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:03.286635 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.286608 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm"] Jul 06 22:49:03.288383 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:49:03.288353 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89627762_79f8_4c3a_bce7_bd068b8a2c76.slice/crio-5a54ec35104801a2ea66e9e50b2d962811a74c0925b9d3f74982f14fb593fd72 WatchSource:0}: Error finding container 5a54ec35104801a2ea66e9e50b2d962811a74c0925b9d3f74982f14fb593fd72: Status 404 returned error can't find the container with id 5a54ec35104801a2ea66e9e50b2d962811a74c0925b9d3f74982f14fb593fd72 Jul 06 22:49:03.290357 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:03.290336 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:49:04.153042 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:04.152864 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" event={"ID":"89627762-79f8-4c3a-bce7-bd068b8a2c76","Type":"ContainerStarted","Data":"5a54ec35104801a2ea66e9e50b2d962811a74c0925b9d3f74982f14fb593fd72"} Jul 06 22:49:05.861359 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:05.861320 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:49:05.861737 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:05.861396 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:49:05.861737 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:05.861425 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:49:06.166145 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:06.166054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" event={"ID":"89627762-79f8-4c3a-bce7-bd068b8a2c76","Type":"ContainerStarted","Data":"b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333"} Jul 06 22:49:06.188419 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:06.188367 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" podStartSLOduration=1.617834848 podStartE2EDuration="4.188349763s" totalImagesPullingTime="2.570514915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:49:06.18656513 +0000 UTC m=+1513.580158943" watchObservedRunningTime="2026-07-06 22:49:06.188349763 +0000 UTC m=+1513.581943568" Jul 06 22:49:06.632215 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:06.632178 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:49:07.151721 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:07.151689 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:07.156135 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:07.156113 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:07.171400 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:07.171374 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:07.172211 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:07.172185 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:14.215095 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:14.215060 2564 generic.go:356] "Generic (PLEG): container finished" podID="89627762-79f8-4c3a-bce7-bd068b8a2c76" containerID="b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333" exitCode=0 Jul 06 22:49:14.215520 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:14.215133 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" event={"ID":"89627762-79f8-4c3a-bce7-bd068b8a2c76","Type":"ContainerDied","Data":"b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333"} Jul 06 22:49:14.215520 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:14.215481 2564 scope.go:117] "RemoveContainer" containerID="b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333" Jul 06 22:49:14.217354 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:14.217328 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:49:14.217431 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:14.217390 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:49:14.217431 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:14.217423 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:49:15.221320 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:15.221233 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" event={"ID":"89627762-79f8-4c3a-bce7-bd068b8a2c76","Type":"ContainerStarted","Data":"13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6"} Jul 06 22:49:15.299684 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:15.299654 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm"] Jul 06 22:49:15.632888 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:15.632855 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:49:16.152388 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:16.152356 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:16.156129 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:16.156102 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:16.226368 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:16.226321 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" podUID="89627762-79f8-4c3a-bce7-bd068b8a2c76" containerName="istio-proxy" containerID="cri-o://13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6" gracePeriod=30 Jul 06 22:49:16.226822 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:16.226446 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:16.227475 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:16.227458 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:21.475647 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.475622 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:21.615578 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.615546 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-podinfo\") pod \"89627762-79f8-4c3a-bce7-bd068b8a2c76\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " Jul 06 22:49:21.615578 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.615583 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-envoy\") pod \"89627762-79f8-4c3a-bce7-bd068b8a2c76\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " Jul 06 22:49:21.615815 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.615607 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-workload-certs\") pod \"89627762-79f8-4c3a-bce7-bd068b8a2c76\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " Jul 06 22:49:21.615815 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.615624 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-workload-socket\") pod \"89627762-79f8-4c3a-bce7-bd068b8a2c76\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " Jul 06 22:49:21.615815 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.615653 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-data\") pod \"89627762-79f8-4c3a-bce7-bd068b8a2c76\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " Jul 06 22:49:21.615815 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.615677 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89627762-79f8-4c3a-bce7-bd068b8a2c76-istiod-ca-cert\") pod \"89627762-79f8-4c3a-bce7-bd068b8a2c76\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " Jul 06 22:49:21.615815 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.615730 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-token\") pod \"89627762-79f8-4c3a-bce7-bd068b8a2c76\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " Jul 06 22:49:21.615815 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.615758 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-credential-socket\") pod \"89627762-79f8-4c3a-bce7-bd068b8a2c76\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " Jul 06 22:49:21.615815 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.615788 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2qfk\" (UniqueName: \"kubernetes.io/projected/89627762-79f8-4c3a-bce7-bd068b8a2c76-kube-api-access-v2qfk\") pod \"89627762-79f8-4c3a-bce7-bd068b8a2c76\" (UID: \"89627762-79f8-4c3a-bce7-bd068b8a2c76\") " Jul 06 22:49:21.616156 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.615933 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "89627762-79f8-4c3a-bce7-bd068b8a2c76" (UID: "89627762-79f8-4c3a-bce7-bd068b8a2c76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:49:21.616156 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.616040 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-workload-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:49:21.616156 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.616109 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89627762-79f8-4c3a-bce7-bd068b8a2c76-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "89627762-79f8-4c3a-bce7-bd068b8a2c76" (UID: "89627762-79f8-4c3a-bce7-bd068b8a2c76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:49:21.616324 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.616226 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "89627762-79f8-4c3a-bce7-bd068b8a2c76" (UID: "89627762-79f8-4c3a-bce7-bd068b8a2c76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:49:21.616324 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.616240 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "89627762-79f8-4c3a-bce7-bd068b8a2c76" (UID: "89627762-79f8-4c3a-bce7-bd068b8a2c76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:49:21.616652 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.616619 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-data" (OuterVolumeSpecName: "istio-data") pod "89627762-79f8-4c3a-bce7-bd068b8a2c76" (UID: "89627762-79f8-4c3a-bce7-bd068b8a2c76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:49:21.617890 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.617865 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "89627762-79f8-4c3a-bce7-bd068b8a2c76" (UID: "89627762-79f8-4c3a-bce7-bd068b8a2c76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:49:21.618007 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.617940 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89627762-79f8-4c3a-bce7-bd068b8a2c76-kube-api-access-v2qfk" (OuterVolumeSpecName: "kube-api-access-v2qfk") pod "89627762-79f8-4c3a-bce7-bd068b8a2c76" (UID: "89627762-79f8-4c3a-bce7-bd068b8a2c76"). InnerVolumeSpecName "kube-api-access-v2qfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:49:21.618007 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.617941 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-token" (OuterVolumeSpecName: "istio-token") pod "89627762-79f8-4c3a-bce7-bd068b8a2c76" (UID: "89627762-79f8-4c3a-bce7-bd068b8a2c76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:49:21.618007 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.617982 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "89627762-79f8-4c3a-bce7-bd068b8a2c76" (UID: "89627762-79f8-4c3a-bce7-bd068b8a2c76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:49:21.717238 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.717185 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2qfk\" (UniqueName: \"kubernetes.io/projected/89627762-79f8-4c3a-bce7-bd068b8a2c76-kube-api-access-v2qfk\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:49:21.717238 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.717232 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-podinfo\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:49:21.717238 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.717242 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-envoy\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:49:21.717238 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.717250 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-workload-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:49:21.717238 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.717260 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-data\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:49:21.717582 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.717269 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89627762-79f8-4c3a-bce7-bd068b8a2c76-istiod-ca-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:49:21.717582 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.717276 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89627762-79f8-4c3a-bce7-bd068b8a2c76-istio-token\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:49:21.717582 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:21.717283 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89627762-79f8-4c3a-bce7-bd068b8a2c76-credential-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:49:22.258197 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:22.258168 2564 generic.go:356] "Generic (PLEG): container finished" podID="89627762-79f8-4c3a-bce7-bd068b8a2c76" containerID="13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6" exitCode=0 Jul 06 22:49:22.258352 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:22.258219 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" Jul 06 22:49:22.258352 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:22.258229 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" event={"ID":"89627762-79f8-4c3a-bce7-bd068b8a2c76","Type":"ContainerDied","Data":"13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6"} Jul 06 22:49:22.258352 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:22.258276 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm" event={"ID":"89627762-79f8-4c3a-bce7-bd068b8a2c76","Type":"ContainerDied","Data":"5a54ec35104801a2ea66e9e50b2d962811a74c0925b9d3f74982f14fb593fd72"} Jul 06 22:49:22.258352 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:22.258302 2564 scope.go:117] "RemoveContainer" containerID="13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6" Jul 06 22:49:22.267628 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:22.267609 2564 scope.go:117] "RemoveContainer" containerID="b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333" Jul 06 22:49:22.275982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:22.275965 2564 scope.go:117] "RemoveContainer" containerID="13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6" Jul 06 22:49:22.276233 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:49:22.276212 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6\": container with ID starting with 13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6 not found: ID does not exist" containerID="13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6" Jul 06 22:49:22.276297 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:22.276247 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6"} err="failed to get container status \"13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6\": rpc error: code = NotFound desc = could not find container \"13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6\": container with ID starting with 13cdfb7d11d6bc8f2fcfe2530883f9865c10022b07627661f56a143abeedc6b6 not found: ID does not exist" Jul 06 22:49:22.276297 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:22.276287 2564 scope.go:117] "RemoveContainer" containerID="b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333" Jul 06 22:49:22.276565 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:49:22.276547 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333\": container with ID starting with b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333 not found: ID does not exist" containerID="b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333" Jul 06 22:49:22.276612 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:22.276571 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333"} err="failed to get container status \"b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333\": rpc error: code = NotFound desc = could not find container \"b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333\": container with ID starting with b3046503f6df89a64a6ce10261c9457c17fb21c797ec0b9235866a57ed269333 not found: ID does not exist" Jul 06 22:49:22.281374 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:22.281354 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm"] Jul 06 22:49:22.286954 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:22.286934 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e2eb8c66-openshift-default-5b764866f7-8tbxm"] Jul 06 22:49:23.047816 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:49:23.047779 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89627762-79f8-4c3a-bce7-bd068b8a2c76" path="/var/lib/kubelet/pods/89627762-79f8-4c3a-bce7-bd068b8a2c76/volumes" Jul 06 22:50:56.628832 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:50:56.628757 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:51:05.428413 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:05.428376 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:51:09.212779 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.212745 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6"] Jul 06 22:51:09.213158 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.213045 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89627762-79f8-4c3a-bce7-bd068b8a2c76" containerName="istio-proxy" Jul 06 22:51:09.213158 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.213056 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="89627762-79f8-4c3a-bce7-bd068b8a2c76" containerName="istio-proxy" Jul 06 22:51:09.213158 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.213072 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89627762-79f8-4c3a-bce7-bd068b8a2c76" containerName="istio-proxy" Jul 06 22:51:09.213158 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.213077 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="89627762-79f8-4c3a-bce7-bd068b8a2c76" containerName="istio-proxy" Jul 06 22:51:09.213158 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.213130 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="89627762-79f8-4c3a-bce7-bd068b8a2c76" containerName="istio-proxy" Jul 06 22:51:09.213158 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.213140 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="89627762-79f8-4c3a-bce7-bd068b8a2c76" containerName="istio-proxy" Jul 06 22:51:09.215981 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.215966 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.219236 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.219219 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-50bd30f5-openshift-default-dockercfg-fdscb\"" Jul 06 22:51:09.235193 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.235167 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6"] Jul 06 22:51:09.286803 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.286775 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-credential-socket\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.286803 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.286807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltdrf\" (UniqueName: \"kubernetes.io/projected/70d00b72-0647-4321-a008-d6b9f746f445-kube-api-access-ltdrf\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.287016 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.286830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d00b72-0647-4321-a008-d6b9f746f445-istio-token\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.287016 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.286851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-workload-certs\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.287016 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.286914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70d00b72-0647-4321-a008-d6b9f746f445-istiod-ca-cert\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.287016 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.286948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-workload-socket\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.287016 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.286965 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70d00b72-0647-4321-a008-d6b9f746f445-istio-podinfo\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.287016 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.287001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-istio-data\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.287383 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.287031 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-istio-envoy\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.387980 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.387949 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70d00b72-0647-4321-a008-d6b9f746f445-istiod-ca-cert\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388155 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.387993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-workload-socket\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388155 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.388013 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70d00b72-0647-4321-a008-d6b9f746f445-istio-podinfo\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388155 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.388040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-istio-data\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388155 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.388064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-istio-envoy\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388155 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.388091 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-credential-socket\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388426 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.388192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltdrf\" (UniqueName: \"kubernetes.io/projected/70d00b72-0647-4321-a008-d6b9f746f445-kube-api-access-ltdrf\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388426 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.388250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d00b72-0647-4321-a008-d6b9f746f445-istio-token\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388426 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.388280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-workload-certs\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388426 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.388414 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-workload-socket\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388670 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.388556 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-credential-socket\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388732 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.388663 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-workload-certs\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388732 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.388712 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-istio-data\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.388881 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.388860 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70d00b72-0647-4321-a008-d6b9f746f445-istiod-ca-cert\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.390481 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.390456 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-istio-envoy\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.390600 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.390548 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70d00b72-0647-4321-a008-d6b9f746f445-istio-podinfo\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.396258 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.396235 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d00b72-0647-4321-a008-d6b9f746f445-istio-token\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.396801 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.396769 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltdrf\" (UniqueName: \"kubernetes.io/projected/70d00b72-0647-4321-a008-d6b9f746f445-kube-api-access-ltdrf\") pod \"e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.525998 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.525922 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:09.662171 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.662146 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6"] Jul 06 22:51:09.664535 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:51:09.664507 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d00b72_0647_4321_a008_d6b9f746f445.slice/crio-0d029df36c0206671c880d95c89343166716408756b65dd349dbe2896bda995a WatchSource:0}: Error finding container 0d029df36c0206671c880d95c89343166716408756b65dd349dbe2896bda995a: Status 404 returned error can't find the container with id 0d029df36c0206671c880d95c89343166716408756b65dd349dbe2896bda995a Jul 06 22:51:09.666587 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.666555 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:51:09.666669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.666619 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:51:09.666669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.666652 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:51:09.770221 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.770188 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" event={"ID":"70d00b72-0647-4321-a008-d6b9f746f445","Type":"ContainerStarted","Data":"8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d"} Jul 06 22:51:09.770403 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.770251 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" event={"ID":"70d00b72-0647-4321-a008-d6b9f746f445","Type":"ContainerStarted","Data":"0d029df36c0206671c880d95c89343166716408756b65dd349dbe2896bda995a"} Jul 06 22:51:09.792141 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:09.792037 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" podStartSLOduration=0.792015918 podStartE2EDuration="792.015918ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:51:09.79071047 +0000 UTC m=+1637.184304294" watchObservedRunningTime="2026-07-06 22:51:09.792015918 +0000 UTC m=+1637.185609731" Jul 06 22:51:10.526716 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:10.526680 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:10.532507 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:10.532461 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:10.775547 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:10.775519 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:10.776592 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:10.776574 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:17.344901 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:17.344861 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:51:25.777129 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:25.777094 2564 patch_prober.go:28] interesting pod/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 06 22:51:25.777557 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:25.777155 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" podUID="70d00b72-0647-4321-a008-d6b9f746f445" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 06 22:51:25.852439 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:25.852410 2564 generic.go:356] "Generic (PLEG): container finished" podID="70d00b72-0647-4321-a008-d6b9f746f445" containerID="8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d" exitCode=0 Jul 06 22:51:25.852596 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:25.852496 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" event={"ID":"70d00b72-0647-4321-a008-d6b9f746f445","Type":"ContainerDied","Data":"8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d"} Jul 06 22:51:25.852891 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:25.852877 2564 scope.go:117] "RemoveContainer" containerID="8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d" Jul 06 22:51:25.853858 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:25.853830 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:51:25.853929 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:25.853913 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:51:25.853974 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:25.853961 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:51:26.880756 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:26.880021 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" event={"ID":"70d00b72-0647-4321-a008-d6b9f746f445","Type":"ContainerStarted","Data":"5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5"} Jul 06 22:51:27.526480 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:27.526440 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:27.526674 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:27.526649 2564 patch_prober.go:28] interesting pod/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 06 22:51:27.526722 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:27.526700 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" podUID="70d00b72-0647-4321-a008-d6b9f746f445" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 06 22:51:27.636198 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:27.636162 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:51:28.526822 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:28.526786 2564 patch_prober.go:28] interesting pod/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 06 22:51:28.527306 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:28.526850 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" podUID="70d00b72-0647-4321-a008-d6b9f746f445" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 06 22:51:29.526343 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:29.526305 2564 patch_prober.go:28] interesting pod/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 06 22:51:29.526537 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:29.526357 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" podUID="70d00b72-0647-4321-a008-d6b9f746f445" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 06 22:51:30.526568 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:30.526531 2564 patch_prober.go:28] interesting pod/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 06 22:51:30.527004 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:30.526609 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" podUID="70d00b72-0647-4321-a008-d6b9f746f445" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 06 22:51:30.534030 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:30.534003 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6"] Jul 06 22:51:30.534189 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:30.534171 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" podUID="70d00b72-0647-4321-a008-d6b9f746f445" containerName="istio-proxy" containerID="cri-o://5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5" gracePeriod=30 Jul 06 22:51:36.080175 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.080146 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:36.232601 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.232516 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-credential-socket\") pod \"70d00b72-0647-4321-a008-d6b9f746f445\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " Jul 06 22:51:36.232601 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.232565 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d00b72-0647-4321-a008-d6b9f746f445-istio-token\") pod \"70d00b72-0647-4321-a008-d6b9f746f445\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " Jul 06 22:51:36.232601 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.232598 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltdrf\" (UniqueName: \"kubernetes.io/projected/70d00b72-0647-4321-a008-d6b9f746f445-kube-api-access-ltdrf\") pod \"70d00b72-0647-4321-a008-d6b9f746f445\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " Jul 06 22:51:36.232855 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.232623 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-istio-data\") pod \"70d00b72-0647-4321-a008-d6b9f746f445\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " Jul 06 22:51:36.232855 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.232658 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-workload-certs\") pod \"70d00b72-0647-4321-a008-d6b9f746f445\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " Jul 06 22:51:36.232855 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.232682 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70d00b72-0647-4321-a008-d6b9f746f445-istio-podinfo\") pod \"70d00b72-0647-4321-a008-d6b9f746f445\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " Jul 06 22:51:36.232855 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.232717 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70d00b72-0647-4321-a008-d6b9f746f445-istiod-ca-cert\") pod \"70d00b72-0647-4321-a008-d6b9f746f445\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " Jul 06 22:51:36.232855 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.232746 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-istio-envoy\") pod \"70d00b72-0647-4321-a008-d6b9f746f445\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " Jul 06 22:51:36.232855 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.232805 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-workload-socket\") pod \"70d00b72-0647-4321-a008-d6b9f746f445\" (UID: \"70d00b72-0647-4321-a008-d6b9f746f445\") " Jul 06 22:51:36.232855 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.232847 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70d00b72-0647-4321-a008-d6b9f746f445" (UID: "70d00b72-0647-4321-a008-d6b9f746f445"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:51:36.233195 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.233057 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-credential-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:51:36.233195 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.233119 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d00b72-0647-4321-a008-d6b9f746f445-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70d00b72-0647-4321-a008-d6b9f746f445" (UID: "70d00b72-0647-4321-a008-d6b9f746f445"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:51:36.233315 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.233270 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70d00b72-0647-4321-a008-d6b9f746f445" (UID: "70d00b72-0647-4321-a008-d6b9f746f445"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:51:36.233405 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.233337 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70d00b72-0647-4321-a008-d6b9f746f445" (UID: "70d00b72-0647-4321-a008-d6b9f746f445"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:51:36.233706 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.233681 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-istio-data" (OuterVolumeSpecName: "istio-data") pod "70d00b72-0647-4321-a008-d6b9f746f445" (UID: "70d00b72-0647-4321-a008-d6b9f746f445"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:51:36.234921 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.234888 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70d00b72-0647-4321-a008-d6b9f746f445-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70d00b72-0647-4321-a008-d6b9f746f445" (UID: "70d00b72-0647-4321-a008-d6b9f746f445"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:51:36.235220 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.235199 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d00b72-0647-4321-a008-d6b9f746f445-kube-api-access-ltdrf" (OuterVolumeSpecName: "kube-api-access-ltdrf") pod "70d00b72-0647-4321-a008-d6b9f746f445" (UID: "70d00b72-0647-4321-a008-d6b9f746f445"). InnerVolumeSpecName "kube-api-access-ltdrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:51:36.235353 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.235326 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d00b72-0647-4321-a008-d6b9f746f445-istio-token" (OuterVolumeSpecName: "istio-token") pod "70d00b72-0647-4321-a008-d6b9f746f445" (UID: "70d00b72-0647-4321-a008-d6b9f746f445"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:51:36.235424 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.235403 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70d00b72-0647-4321-a008-d6b9f746f445" (UID: "70d00b72-0647-4321-a008-d6b9f746f445"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:51:36.333921 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.333884 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70d00b72-0647-4321-a008-d6b9f746f445-istiod-ca-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:51:36.333921 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.333912 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-istio-envoy\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:51:36.333921 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.333921 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-workload-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:51:36.333921 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.333929 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70d00b72-0647-4321-a008-d6b9f746f445-istio-token\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:51:36.334195 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.333940 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltdrf\" (UniqueName: \"kubernetes.io/projected/70d00b72-0647-4321-a008-d6b9f746f445-kube-api-access-ltdrf\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:51:36.334195 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.333949 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-istio-data\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:51:36.334195 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.333957 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70d00b72-0647-4321-a008-d6b9f746f445-workload-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:51:36.334195 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.333965 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70d00b72-0647-4321-a008-d6b9f746f445-istio-podinfo\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:51:36.933095 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.933061 2564 generic.go:356] "Generic (PLEG): container finished" podID="70d00b72-0647-4321-a008-d6b9f746f445" containerID="5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5" exitCode=0 Jul 06 22:51:36.933264 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.933117 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" Jul 06 22:51:36.933264 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.933150 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" event={"ID":"70d00b72-0647-4321-a008-d6b9f746f445","Type":"ContainerDied","Data":"5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5"} Jul 06 22:51:36.933264 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.933207 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6" event={"ID":"70d00b72-0647-4321-a008-d6b9f746f445","Type":"ContainerDied","Data":"0d029df36c0206671c880d95c89343166716408756b65dd349dbe2896bda995a"} Jul 06 22:51:36.933264 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.933229 2564 scope.go:117] "RemoveContainer" containerID="5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5" Jul 06 22:51:36.942421 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.942402 2564 scope.go:117] "RemoveContainer" containerID="8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d" Jul 06 22:51:36.950112 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.950094 2564 scope.go:117] "RemoveContainer" containerID="5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5" Jul 06 22:51:36.950362 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:51:36.950343 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5\": container with ID starting with 5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5 not found: ID does not exist" containerID="5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5" Jul 06 22:51:36.950428 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.950371 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5"} err="failed to get container status \"5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5\": rpc error: code = NotFound desc = could not find container \"5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5\": container with ID starting with 5bdaaa69efe3965a77ad556a2c0b72a5989128c84fc9d879bab4648aa5a572a5 not found: ID does not exist" Jul 06 22:51:36.950428 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.950386 2564 scope.go:117] "RemoveContainer" containerID="8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d" Jul 06 22:51:36.950655 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:51:36.950639 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d\": container with ID starting with 8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d not found: ID does not exist" containerID="8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d" Jul 06 22:51:36.950702 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.950662 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d"} err="failed to get container status \"8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d\": rpc error: code = NotFound desc = could not find container \"8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d\": container with ID starting with 8a105d5cfe204e407fc92f322cb4049fa39277432f80ea79a773cc7f25171a4d not found: ID does not exist" Jul 06 22:51:36.954846 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.954825 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6"] Jul 06 22:51:36.960938 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:36.960918 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-50bd30f5-openshift-default-86cf844dd7-qhfx6"] Jul 06 22:51:37.043092 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:37.043058 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d00b72-0647-4321-a008-d6b9f746f445" path="/var/lib/kubelet/pods/70d00b72-0647-4321-a008-d6b9f746f445/volumes" Jul 06 22:51:50.460095 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.460061 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x"] Jul 06 22:51:50.460443 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.460355 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d00b72-0647-4321-a008-d6b9f746f445" containerName="istio-proxy" Jul 06 22:51:50.460443 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.460371 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d00b72-0647-4321-a008-d6b9f746f445" containerName="istio-proxy" Jul 06 22:51:50.462937 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.460872 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d00b72-0647-4321-a008-d6b9f746f445" containerName="istio-proxy" Jul 06 22:51:50.467438 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.467416 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.469954 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.469933 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fed91589-openshift-default-dockercfg-ntw6h\"" Jul 06 22:51:50.477346 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.477321 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x"] Jul 06 22:51:50.545990 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.545960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j82cp\" (UniqueName: \"kubernetes.io/projected/67d34a56-ca36-44b6-bcdb-0635250f5b00-kube-api-access-j82cp\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.546189 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.546000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67d34a56-ca36-44b6-bcdb-0635250f5b00-istiod-ca-cert\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.546189 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.546054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-workload-certs\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.546189 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.546110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-envoy\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.546189 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.546161 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-data\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.546189 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.546186 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-podinfo\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.546467 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.546215 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-credential-socket\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.546467 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.546241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-token\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.546467 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.546355 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-workload-socket\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.646747 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.646716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-workload-socket\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.646917 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.646756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j82cp\" (UniqueName: \"kubernetes.io/projected/67d34a56-ca36-44b6-bcdb-0635250f5b00-kube-api-access-j82cp\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.646917 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.646782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67d34a56-ca36-44b6-bcdb-0635250f5b00-istiod-ca-cert\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.646917 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.646816 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-workload-certs\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.646917 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.646840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-envoy\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.647073 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.647012 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-data\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.647141 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.647068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-podinfo\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.647141 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.647109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-credential-socket\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.647141 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.647129 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-workload-socket\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.647141 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.647137 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-token\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.647349 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.647226 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-workload-certs\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.647413 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.647381 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-data\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.647463 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.647431 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-credential-socket\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.647580 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.647562 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67d34a56-ca36-44b6-bcdb-0635250f5b00-istiod-ca-cert\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.649109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.649087 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-envoy\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.649323 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.649295 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-podinfo\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.654370 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.654350 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-token\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.654511 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.654474 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j82cp\" (UniqueName: \"kubernetes.io/projected/67d34a56-ca36-44b6-bcdb-0635250f5b00-kube-api-access-j82cp\") pod \"e2e-mt-fed91589-openshift-default-64b5cf8787-l244x\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.778721 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.778639 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:50.914305 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.914279 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x"] Jul 06 22:51:50.916234 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:51:50.916209 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d34a56_ca36_44b6_bcdb_0635250f5b00.slice/crio-6c3d1b414b0634abb4f6a398bad939583e78931d157760ddb10c3a21aac61cbb WatchSource:0}: Error finding container 6c3d1b414b0634abb4f6a398bad939583e78931d157760ddb10c3a21aac61cbb: Status 404 returned error can't find the container with id 6c3d1b414b0634abb4f6a398bad939583e78931d157760ddb10c3a21aac61cbb Jul 06 22:51:50.918387 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.918351 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:51:50.918482 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.918423 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:51:50.918482 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:50.918455 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:51:51.005387 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:51.005352 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" event={"ID":"67d34a56-ca36-44b6-bcdb-0635250f5b00","Type":"ContainerStarted","Data":"5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3"} Jul 06 22:51:51.005757 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:51.005408 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" event={"ID":"67d34a56-ca36-44b6-bcdb-0635250f5b00","Type":"ContainerStarted","Data":"6c3d1b414b0634abb4f6a398bad939583e78931d157760ddb10c3a21aac61cbb"} Jul 06 22:51:51.023760 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:51.023713 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" podStartSLOduration=1.023694843 podStartE2EDuration="1.023694843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:51:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:51:51.022829587 +0000 UTC m=+1678.416423400" watchObservedRunningTime="2026-07-06 22:51:51.023694843 +0000 UTC m=+1678.417288727" Jul 06 22:51:51.779069 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:51.779034 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:51.783954 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:51.783930 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:52.010338 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:52.010308 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:52.011332 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:52.011314 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:51:55.723511 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:51:55.723454 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:52:04.070637 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:04.070600 2564 generic.go:356] "Generic (PLEG): container finished" podID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerID="5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3" exitCode=0 Jul 06 22:52:04.071071 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:04.070665 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" event={"ID":"67d34a56-ca36-44b6-bcdb-0635250f5b00","Type":"ContainerDied","Data":"5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3"} Jul 06 22:52:04.071071 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:04.071025 2564 scope.go:117] "RemoveContainer" containerID="5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3" Jul 06 22:52:04.072026 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:04.071995 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:52:04.072115 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:04.072065 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:52:04.072115 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:04.072105 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:52:05.081042 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:05.080998 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" event={"ID":"67d34a56-ca36-44b6-bcdb-0635250f5b00","Type":"ContainerStarted","Data":"8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86"} Jul 06 22:52:05.779510 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:05.779456 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:52:05.780572 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:05.780539 2564 patch_prober.go:28] interesting pod/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 06 22:52:05.780719 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:05.780595 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 06 22:52:06.779788 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:06.779741 2564 patch_prober.go:28] interesting pod/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 06 22:52:06.780307 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:06.779812 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 06 22:52:07.011067 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:07.011032 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:52:07.779954 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:07.779910 2564 patch_prober.go:28] interesting pod/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 06 22:52:07.780573 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:07.780540 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 06 22:52:08.779965 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:08.779921 2564 patch_prober.go:28] interesting pod/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 06 22:52:08.780594 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:08.780557 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 06 22:52:09.783827 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:09.783793 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:52:09.784832 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:09.784812 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:52:13.129232 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:13.129202 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:52:26.985585 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:26.985530 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:52:41.136896 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:52:41.136864 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:53:20.424721 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:20.424685 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:53:23.807503 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:23.807453 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x"] Jul 06 22:53:23.807955 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:23.807718 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerName="istio-proxy" containerID="cri-o://8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86" gracePeriod=30 Jul 06 22:53:24.786423 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:24.786381 2564 patch_prober.go:28] interesting pod/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 22:53:24.786635 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:24.786452 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 22:53:29.053148 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.053122 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:53:29.095027 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.095003 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-envoy\") pod \"67d34a56-ca36-44b6-bcdb-0635250f5b00\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " Jul 06 22:53:29.095172 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.095036 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-token\") pod \"67d34a56-ca36-44b6-bcdb-0635250f5b00\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " Jul 06 22:53:29.095172 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.095065 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-podinfo\") pod \"67d34a56-ca36-44b6-bcdb-0635250f5b00\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " Jul 06 22:53:29.095172 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.095081 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-workload-socket\") pod \"67d34a56-ca36-44b6-bcdb-0635250f5b00\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " Jul 06 22:53:29.095172 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.095123 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-workload-certs\") pod \"67d34a56-ca36-44b6-bcdb-0635250f5b00\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " Jul 06 22:53:29.095384 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.095175 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j82cp\" (UniqueName: \"kubernetes.io/projected/67d34a56-ca36-44b6-bcdb-0635250f5b00-kube-api-access-j82cp\") pod \"67d34a56-ca36-44b6-bcdb-0635250f5b00\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " Jul 06 22:53:29.095384 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.095197 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-data\") pod \"67d34a56-ca36-44b6-bcdb-0635250f5b00\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " Jul 06 22:53:29.095384 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.095227 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-credential-socket\") pod \"67d34a56-ca36-44b6-bcdb-0635250f5b00\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " Jul 06 22:53:29.095384 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.095252 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67d34a56-ca36-44b6-bcdb-0635250f5b00-istiod-ca-cert\") pod \"67d34a56-ca36-44b6-bcdb-0635250f5b00\" (UID: \"67d34a56-ca36-44b6-bcdb-0635250f5b00\") " Jul 06 22:53:29.095610 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.095453 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67d34a56-ca36-44b6-bcdb-0635250f5b00" (UID: "67d34a56-ca36-44b6-bcdb-0635250f5b00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:53:29.095828 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.095801 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67d34a56-ca36-44b6-bcdb-0635250f5b00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67d34a56-ca36-44b6-bcdb-0635250f5b00" (UID: "67d34a56-ca36-44b6-bcdb-0635250f5b00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:53:29.096012 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.095978 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67d34a56-ca36-44b6-bcdb-0635250f5b00" (UID: "67d34a56-ca36-44b6-bcdb-0635250f5b00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:53:29.096129 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.096056 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67d34a56-ca36-44b6-bcdb-0635250f5b00" (UID: "67d34a56-ca36-44b6-bcdb-0635250f5b00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:53:29.096882 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.096854 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-data" (OuterVolumeSpecName: "istio-data") pod "67d34a56-ca36-44b6-bcdb-0635250f5b00" (UID: "67d34a56-ca36-44b6-bcdb-0635250f5b00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:53:29.097355 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.097324 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-token" (OuterVolumeSpecName: "istio-token") pod "67d34a56-ca36-44b6-bcdb-0635250f5b00" (UID: "67d34a56-ca36-44b6-bcdb-0635250f5b00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:53:29.097442 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.097353 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67d34a56-ca36-44b6-bcdb-0635250f5b00" (UID: "67d34a56-ca36-44b6-bcdb-0635250f5b00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:53:29.097503 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.097447 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67d34a56-ca36-44b6-bcdb-0635250f5b00-kube-api-access-j82cp" (OuterVolumeSpecName: "kube-api-access-j82cp") pod "67d34a56-ca36-44b6-bcdb-0635250f5b00" (UID: "67d34a56-ca36-44b6-bcdb-0635250f5b00"). InnerVolumeSpecName "kube-api-access-j82cp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:53:29.097503 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.097454 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67d34a56-ca36-44b6-bcdb-0635250f5b00" (UID: "67d34a56-ca36-44b6-bcdb-0635250f5b00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:53:29.196091 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.196053 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j82cp\" (UniqueName: \"kubernetes.io/projected/67d34a56-ca36-44b6-bcdb-0635250f5b00-kube-api-access-j82cp\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:53:29.196091 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.196086 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-data\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:53:29.196091 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.196097 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-credential-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:53:29.196313 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.196106 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67d34a56-ca36-44b6-bcdb-0635250f5b00-istiod-ca-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:53:29.196313 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.196115 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-envoy\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:53:29.196313 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.196123 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-token\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:53:29.196313 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.196130 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67d34a56-ca36-44b6-bcdb-0635250f5b00-istio-podinfo\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:53:29.196313 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.196137 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-workload-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:53:29.196313 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.196145 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67d34a56-ca36-44b6-bcdb-0635250f5b00-workload-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:53:29.491393 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.491316 2564 generic.go:356] "Generic (PLEG): container finished" podID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerID="8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86" exitCode=0 Jul 06 22:53:29.491393 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.491365 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" Jul 06 22:53:29.491578 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.491395 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" event={"ID":"67d34a56-ca36-44b6-bcdb-0635250f5b00","Type":"ContainerDied","Data":"8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86"} Jul 06 22:53:29.491578 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.491454 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x" event={"ID":"67d34a56-ca36-44b6-bcdb-0635250f5b00","Type":"ContainerDied","Data":"6c3d1b414b0634abb4f6a398bad939583e78931d157760ddb10c3a21aac61cbb"} Jul 06 22:53:29.491578 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.491499 2564 scope.go:117] "RemoveContainer" containerID="8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86" Jul 06 22:53:29.500296 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.500280 2564 scope.go:117] "RemoveContainer" containerID="5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3" Jul 06 22:53:29.507975 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.507949 2564 scope.go:117] "RemoveContainer" containerID="8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86" Jul 06 22:53:29.508220 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:53:29.508201 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86\": container with ID starting with 8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86 not found: ID does not exist" containerID="8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86" Jul 06 22:53:29.508277 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.508227 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86"} err="failed to get container status \"8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86\": rpc error: code = NotFound desc = could not find container \"8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86\": container with ID starting with 8d4d7ec0f71bcfd915c904c86d8c12cb09f422351d222aab5298a1f1cb421a86 not found: ID does not exist" Jul 06 22:53:29.508277 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.508245 2564 scope.go:117] "RemoveContainer" containerID="5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3" Jul 06 22:53:29.508481 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:53:29.508462 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3\": container with ID starting with 5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3 not found: ID does not exist" containerID="5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3" Jul 06 22:53:29.508558 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.508505 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3"} err="failed to get container status \"5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3\": rpc error: code = NotFound desc = could not find container \"5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3\": container with ID starting with 5a51297b76f251e5d2e880589346bc41eed0cb4569926cc07ec5163d506400e3 not found: ID does not exist" Jul 06 22:53:29.513853 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.513832 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x"] Jul 06 22:53:29.517065 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.517048 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fed91589-openshift-default-64b5cf8787-l244x"] Jul 06 22:53:29.834592 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:29.834557 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:53:31.042315 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:31.042283 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" path="/var/lib/kubelet/pods/67d34a56-ca36-44b6-bcdb-0635250f5b00/volumes" Jul 06 22:53:40.630507 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:40.630456 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:53:53.353317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:53.353291 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:53:53.355881 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:53.355855 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:53:53.358374 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:53.358354 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:53:53.360765 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:53:53.360747 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:54:18.350830 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.350796 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6"] Jul 06 22:54:18.351192 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.351093 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d00b72-0647-4321-a008-d6b9f746f445" containerName="istio-proxy" Jul 06 22:54:18.351192 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.351104 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d00b72-0647-4321-a008-d6b9f746f445" containerName="istio-proxy" Jul 06 22:54:18.351192 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.351115 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerName="istio-proxy" Jul 06 22:54:18.351192 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.351120 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerName="istio-proxy" Jul 06 22:54:18.351192 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.351127 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerName="istio-proxy" Jul 06 22:54:18.351192 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.351134 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerName="istio-proxy" Jul 06 22:54:18.351192 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.351189 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d00b72-0647-4321-a008-d6b9f746f445" containerName="istio-proxy" Jul 06 22:54:18.351403 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.351197 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerName="istio-proxy" Jul 06 22:54:18.351403 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.351204 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="67d34a56-ca36-44b6-bcdb-0635250f5b00" containerName="istio-proxy" Jul 06 22:54:18.354048 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.354032 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.357350 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.357329 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-b673d1-openshift-default-dockercfg-ltb9r\"" Jul 06 22:54:18.377971 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.377948 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6"] Jul 06 22:54:18.409733 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.409702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-credential-socket\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.409859 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.409738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-workload-certs\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.409859 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.409757 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-envoy\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.409859 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.409825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073c4945-e302-4fd6-83a5-ca081ca451a8-istiod-ca-cert\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.409974 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.409894 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-podinfo\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.409974 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.409934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-data\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.410056 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.409976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgv2l\" (UniqueName: \"kubernetes.io/projected/073c4945-e302-4fd6-83a5-ca081ca451a8-kube-api-access-vgv2l\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.410056 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.410003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-token\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.410056 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.410035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-workload-socket\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.511316 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.511280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-token\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.511535 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.511331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-workload-socket\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.511535 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.511352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-credential-socket\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.511535 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.511374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-workload-certs\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.511535 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.511398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-envoy\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.511535 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.511422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073c4945-e302-4fd6-83a5-ca081ca451a8-istiod-ca-cert\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.511535 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.511455 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-podinfo\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.511871 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.511572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-data\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.511871 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.511660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgv2l\" (UniqueName: \"kubernetes.io/projected/073c4945-e302-4fd6-83a5-ca081ca451a8-kube-api-access-vgv2l\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.511871 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.511782 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-workload-socket\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.511871 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.511804 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-workload-certs\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.512077 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.511987 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-data\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.512077 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.512020 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-credential-socket\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.512236 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.512217 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073c4945-e302-4fd6-83a5-ca081ca451a8-istiod-ca-cert\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.513811 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.513782 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-envoy\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.513912 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.513847 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-podinfo\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.520066 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.520040 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgv2l\" (UniqueName: \"kubernetes.io/projected/073c4945-e302-4fd6-83a5-ca081ca451a8-kube-api-access-vgv2l\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.520195 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.520176 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-token\") pod \"e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.663959 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.663879 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:18.797309 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.797284 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6"] Jul 06 22:54:18.799023 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:54:18.798993 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073c4945_e302_4fd6_83a5_ca081ca451a8.slice/crio-299bb99be62c256dde9c125f4a18cd41bb0a8c2108a162f912b97c70f1d0bf92 WatchSource:0}: Error finding container 299bb99be62c256dde9c125f4a18cd41bb0a8c2108a162f912b97c70f1d0bf92: Status 404 returned error can't find the container with id 299bb99be62c256dde9c125f4a18cd41bb0a8c2108a162f912b97c70f1d0bf92 Jul 06 22:54:18.801124 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.801095 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:54:18.801178 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.801162 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:54:18.801213 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:18.801206 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:54:19.733265 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:19.733228 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" event={"ID":"073c4945-e302-4fd6-83a5-ca081ca451a8","Type":"ContainerStarted","Data":"aad1f74a94826d077e770a533ac6b7da71f073c44ef618417774070c15d8949e"} Jul 06 22:54:19.733692 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:19.733279 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" event={"ID":"073c4945-e302-4fd6-83a5-ca081ca451a8","Type":"ContainerStarted","Data":"299bb99be62c256dde9c125f4a18cd41bb0a8c2108a162f912b97c70f1d0bf92"} Jul 06 22:54:19.754097 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:19.754032 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" podStartSLOduration=1.754016664 podStartE2EDuration="1.754016664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:54:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:54:19.751641782 +0000 UTC m=+1827.145235591" watchObservedRunningTime="2026-07-06 22:54:19.754016664 +0000 UTC m=+1827.147610476" Jul 06 22:54:20.664483 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:20.664447 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:20.669177 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:20.669152 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:20.739069 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:20.739038 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:20.739980 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:20.739962 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:26.722276 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.722237 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq"] Jul 06 22:54:26.725935 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.725913 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.728370 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.728349 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f49549-openshift-default-dockercfg-m6bbw\"" Jul 06 22:54:26.738214 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.738190 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq"] Jul 06 22:54:26.781077 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.781039 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-workload-socket\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.781077 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.781077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-podinfo\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.781280 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.781160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-token\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.781280 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.781185 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-workload-certs\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.781280 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.781199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-envoy\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.781280 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.781216 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0958af7-1632-4879-9031-4beab8ffb5b6-istiod-ca-cert\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.781280 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.781246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-credential-socket\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.781280 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.781269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn7ss\" (UniqueName: \"kubernetes.io/projected/d0958af7-1632-4879-9031-4beab8ffb5b6-kube-api-access-gn7ss\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.781479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.781319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-data\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.881833 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.881800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-data\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882003 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.881842 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-workload-socket\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882003 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.881867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-podinfo\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882003 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.881930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-token\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882003 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.881965 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-workload-certs\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882203 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.882096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-envoy\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882203 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.882151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0958af7-1632-4879-9031-4beab8ffb5b6-istiod-ca-cert\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882203 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.882196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-credential-socket\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882359 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.882236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn7ss\" (UniqueName: \"kubernetes.io/projected/d0958af7-1632-4879-9031-4beab8ffb5b6-kube-api-access-gn7ss\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882359 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.882260 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-data\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882359 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.882295 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-workload-certs\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882359 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.882334 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-workload-socket\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882582 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.882518 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-credential-socket\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.882817 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.882799 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0958af7-1632-4879-9031-4beab8ffb5b6-istiod-ca-cert\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.884246 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.884225 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-envoy\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.884466 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.884446 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-podinfo\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.889959 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.889932 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-token\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:26.890085 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:26.890068 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn7ss\" (UniqueName: \"kubernetes.io/projected/d0958af7-1632-4879-9031-4beab8ffb5b6-kube-api-access-gn7ss\") pod \"e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:27.036684 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:27.036607 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:27.174529 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:27.174505 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq"] Jul 06 22:54:27.176544 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:54:27.176514 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0958af7_1632_4879_9031_4beab8ffb5b6.slice/crio-012fb76d397e7fe240689e00fdd0edceefc190973318d5bbd8b9311259a6a305 WatchSource:0}: Error finding container 012fb76d397e7fe240689e00fdd0edceefc190973318d5bbd8b9311259a6a305: Status 404 returned error can't find the container with id 012fb76d397e7fe240689e00fdd0edceefc190973318d5bbd8b9311259a6a305 Jul 06 22:54:27.178642 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:27.178610 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:54:27.178735 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:27.178672 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:54:27.178735 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:27.178703 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:54:27.778407 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:27.778374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" event={"ID":"d0958af7-1632-4879-9031-4beab8ffb5b6","Type":"ContainerStarted","Data":"bee294221f2ee1d2838465805e75717bc91fffea665fa510f2ee59ee50cd8a56"} Jul 06 22:54:27.778813 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:27.778430 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" event={"ID":"d0958af7-1632-4879-9031-4beab8ffb5b6","Type":"ContainerStarted","Data":"012fb76d397e7fe240689e00fdd0edceefc190973318d5bbd8b9311259a6a305"} Jul 06 22:54:27.800537 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:27.800479 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" podStartSLOduration=1.8004640680000001 podStartE2EDuration="1.800464068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:54:27.799400779 +0000 UTC m=+1835.192994593" watchObservedRunningTime="2026-07-06 22:54:27.800464068 +0000 UTC m=+1835.194057879" Jul 06 22:54:28.036926 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:28.036842 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:28.041421 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:28.041395 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:28.784424 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:28.784386 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:28.785202 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:28.785183 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:28.839931 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:28.839899 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:54:36.062139 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:36.061303 2564 patch_prober.go:28] interesting pod/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": read tcp 10.132.0.2:37592->10.132.0.39:15021: read: connection reset by peer" start-of-body= Jul 06 22:54:36.062139 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:36.061391 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": read tcp 10.132.0.2:37592->10.132.0.39:15021: read: connection reset by peer" Jul 06 22:54:36.835517 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:36.835468 2564 generic.go:356] "Generic (PLEG): container finished" podID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerID="aad1f74a94826d077e770a533ac6b7da71f073c44ef618417774070c15d8949e" exitCode=0 Jul 06 22:54:36.835695 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:36.835539 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" event={"ID":"073c4945-e302-4fd6-83a5-ca081ca451a8","Type":"ContainerDied","Data":"aad1f74a94826d077e770a533ac6b7da71f073c44ef618417774070c15d8949e"} Jul 06 22:54:36.835914 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:36.835901 2564 scope.go:117] "RemoveContainer" containerID="aad1f74a94826d077e770a533ac6b7da71f073c44ef618417774070c15d8949e" Jul 06 22:54:36.836841 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:36.836817 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:54:36.836905 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:36.836882 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:54:36.836942 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:36.836914 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:54:37.841944 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:37.841909 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" event={"ID":"073c4945-e302-4fd6-83a5-ca081ca451a8","Type":"ContainerStarted","Data":"eff71d1f9138ad19749432d778fdac4d3d77b0cbed7be9127d77667d2443ea5d"} Jul 06 22:54:38.664970 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:38.664927 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:38.665198 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:38.665060 2564 patch_prober.go:28] interesting pod/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 06 22:54:38.665198 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:38.665119 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 06 22:54:39.534303 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:39.534266 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:54:39.664632 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:39.664578 2564 patch_prober.go:28] interesting pod/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 06 22:54:39.664824 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:39.664655 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 06 22:54:40.665008 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:40.664551 2564 patch_prober.go:28] interesting pod/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 06 22:54:40.665008 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:40.664631 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 06 22:54:41.664901 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:41.664860 2564 patch_prober.go:28] interesting pod/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 06 22:54:41.665083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:41.664934 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 06 22:54:42.669082 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:42.669051 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:42.669591 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:42.669333 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:42.670078 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:42.670063 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:54:43.785753 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:43.785716 2564 patch_prober.go:28] interesting pod/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 22:54:43.786167 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:43.785771 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 22:54:43.874907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:43.874871 2564 generic.go:356] "Generic (PLEG): container finished" podID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerID="bee294221f2ee1d2838465805e75717bc91fffea665fa510f2ee59ee50cd8a56" exitCode=0 Jul 06 22:54:43.875064 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:43.874945 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" event={"ID":"d0958af7-1632-4879-9031-4beab8ffb5b6","Type":"ContainerDied","Data":"bee294221f2ee1d2838465805e75717bc91fffea665fa510f2ee59ee50cd8a56"} Jul 06 22:54:43.875430 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:43.875415 2564 scope.go:117] "RemoveContainer" containerID="bee294221f2ee1d2838465805e75717bc91fffea665fa510f2ee59ee50cd8a56" Jul 06 22:54:43.876307 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:43.876285 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:54:43.876356 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:43.876341 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:54:43.876390 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:43.876370 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:54:44.886221 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:44.886184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" event={"ID":"d0958af7-1632-4879-9031-4beab8ffb5b6","Type":"ContainerStarted","Data":"ddf0cc53c66859867b395edc87c3f79e0b4f774fea5e69cc3d7ab607a268cd58"} Jul 06 22:54:45.037626 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:45.037589 2564 patch_prober.go:28] interesting pod/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 22:54:45.037841 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:45.037644 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 22:54:45.042834 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:45.042812 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:46.037548 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:46.037512 2564 patch_prober.go:28] interesting pod/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 22:54:46.037933 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:46.037577 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 22:54:47.037932 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:47.037891 2564 patch_prober.go:28] interesting pod/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 22:54:47.038311 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:47.037954 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 22:54:48.037125 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:48.037094 2564 patch_prober.go:28] interesting pod/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 22:54:48.037297 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:48.037148 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 22:54:49.042864 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:49.042836 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:49.043322 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:49.043080 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:49.043798 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:49.043780 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:54:51.330261 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:54:51.330224 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:55:01.433376 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:55:01.433338 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:55:14.533020 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:55:14.532982 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:55:34.130717 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:55:34.130686 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:56:11.211576 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:11.211543 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6"] Jul 06 22:56:11.212075 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:11.211758 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" containerID="cri-o://eff71d1f9138ad19749432d778fdac4d3d77b0cbed7be9127d77667d2443ea5d" gracePeriod=30 Jul 06 22:56:12.671317 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:12.671278 2564 patch_prober.go:28] interesting pod/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 22:56:12.671698 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:12.671341 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 22:56:15.526740 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:15.526704 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:56:16.338833 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.338805 2564 generic.go:356] "Generic (PLEG): container finished" podID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerID="eff71d1f9138ad19749432d778fdac4d3d77b0cbed7be9127d77667d2443ea5d" exitCode=0 Jul 06 22:56:16.338982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.338874 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" event={"ID":"073c4945-e302-4fd6-83a5-ca081ca451a8","Type":"ContainerDied","Data":"eff71d1f9138ad19749432d778fdac4d3d77b0cbed7be9127d77667d2443ea5d"} Jul 06 22:56:16.338982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.338968 2564 scope.go:117] "RemoveContainer" containerID="aad1f74a94826d077e770a533ac6b7da71f073c44ef618417774070c15d8949e" Jul 06 22:56:16.469272 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.469242 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:56:16.540972 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.540894 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-envoy\") pod \"073c4945-e302-4fd6-83a5-ca081ca451a8\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " Jul 06 22:56:16.540972 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.540945 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-credential-socket\") pod \"073c4945-e302-4fd6-83a5-ca081ca451a8\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " Jul 06 22:56:16.541479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.540986 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-data\") pod \"073c4945-e302-4fd6-83a5-ca081ca451a8\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " Jul 06 22:56:16.541479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.541016 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-token\") pod \"073c4945-e302-4fd6-83a5-ca081ca451a8\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " Jul 06 22:56:16.541479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.541053 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgv2l\" (UniqueName: \"kubernetes.io/projected/073c4945-e302-4fd6-83a5-ca081ca451a8-kube-api-access-vgv2l\") pod \"073c4945-e302-4fd6-83a5-ca081ca451a8\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " Jul 06 22:56:16.541479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.541107 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-workload-socket\") pod \"073c4945-e302-4fd6-83a5-ca081ca451a8\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " Jul 06 22:56:16.541479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.541138 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-podinfo\") pod \"073c4945-e302-4fd6-83a5-ca081ca451a8\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " Jul 06 22:56:16.541479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.541200 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-workload-certs\") pod \"073c4945-e302-4fd6-83a5-ca081ca451a8\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " Jul 06 22:56:16.541479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.541231 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073c4945-e302-4fd6-83a5-ca081ca451a8-istiod-ca-cert\") pod \"073c4945-e302-4fd6-83a5-ca081ca451a8\" (UID: \"073c4945-e302-4fd6-83a5-ca081ca451a8\") " Jul 06 22:56:16.541479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.541321 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "073c4945-e302-4fd6-83a5-ca081ca451a8" (UID: "073c4945-e302-4fd6-83a5-ca081ca451a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:16.541479 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.541410 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "073c4945-e302-4fd6-83a5-ca081ca451a8" (UID: "073c4945-e302-4fd6-83a5-ca081ca451a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:16.541999 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.541589 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "073c4945-e302-4fd6-83a5-ca081ca451a8" (UID: "073c4945-e302-4fd6-83a5-ca081ca451a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:16.541999 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.541604 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-workload-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:16.541999 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.541661 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-credential-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:16.541999 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.541755 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/073c4945-e302-4fd6-83a5-ca081ca451a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "073c4945-e302-4fd6-83a5-ca081ca451a8" (UID: "073c4945-e302-4fd6-83a5-ca081ca451a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:56:16.542238 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.542211 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "073c4945-e302-4fd6-83a5-ca081ca451a8" (UID: "073c4945-e302-4fd6-83a5-ca081ca451a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:16.543205 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.543177 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "073c4945-e302-4fd6-83a5-ca081ca451a8" (UID: "073c4945-e302-4fd6-83a5-ca081ca451a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:16.543322 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.543228 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "073c4945-e302-4fd6-83a5-ca081ca451a8" (UID: "073c4945-e302-4fd6-83a5-ca081ca451a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:56:16.543374 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.543343 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/073c4945-e302-4fd6-83a5-ca081ca451a8-kube-api-access-vgv2l" (OuterVolumeSpecName: "kube-api-access-vgv2l") pod "073c4945-e302-4fd6-83a5-ca081ca451a8" (UID: "073c4945-e302-4fd6-83a5-ca081ca451a8"). InnerVolumeSpecName "kube-api-access-vgv2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:56:16.543432 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.543414 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "073c4945-e302-4fd6-83a5-ca081ca451a8" (UID: "073c4945-e302-4fd6-83a5-ca081ca451a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:56:16.642940 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.642913 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073c4945-e302-4fd6-83a5-ca081ca451a8-istiod-ca-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:16.642940 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.642941 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-envoy\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:16.643139 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.642953 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-data\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:16.643139 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.642964 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-token\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:16.643139 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.642976 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgv2l\" (UniqueName: \"kubernetes.io/projected/073c4945-e302-4fd6-83a5-ca081ca451a8-kube-api-access-vgv2l\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:16.643139 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.642989 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073c4945-e302-4fd6-83a5-ca081ca451a8-istio-podinfo\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:16.643139 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:16.643000 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073c4945-e302-4fd6-83a5-ca081ca451a8-workload-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:17.345173 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:17.345142 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" Jul 06 22:56:17.345347 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:17.345186 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6" event={"ID":"073c4945-e302-4fd6-83a5-ca081ca451a8","Type":"ContainerDied","Data":"299bb99be62c256dde9c125f4a18cd41bb0a8c2108a162f912b97c70f1d0bf92"} Jul 06 22:56:17.345347 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:17.345242 2564 scope.go:117] "RemoveContainer" containerID="eff71d1f9138ad19749432d778fdac4d3d77b0cbed7be9127d77667d2443ea5d" Jul 06 22:56:17.362543 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:17.362521 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6"] Jul 06 22:56:17.366030 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:17.366011 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-b673d1-openshift-default-6f775864bc-rd7r6"] Jul 06 22:56:18.261999 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:18.261966 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq"] Jul 06 22:56:18.262447 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:18.262254 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" containerID="cri-o://ddf0cc53c66859867b395edc87c3f79e0b4f774fea5e69cc3d7ab607a268cd58" gracePeriod=30 Jul 06 22:56:19.043598 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.043561 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" path="/var/lib/kubelet/pods/073c4945-e302-4fd6-83a5-ca081ca451a8/volumes" Jul 06 22:56:19.045409 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.045380 2564 patch_prober.go:28] interesting pod/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 22:56:19.045566 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.045434 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 22:56:19.096681 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.096651 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd"] Jul 06 22:56:19.096979 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.096968 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" Jul 06 22:56:19.097022 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.096982 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" Jul 06 22:56:19.097022 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.096989 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" Jul 06 22:56:19.097022 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.096995 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" Jul 06 22:56:19.097117 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.097048 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" Jul 06 22:56:19.097117 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.097057 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="073c4945-e302-4fd6-83a5-ca081ca451a8" containerName="istio-proxy" Jul 06 22:56:19.101421 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.101403 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.103898 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.103875 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b793fb-openshift-default-dockercfg-s8tzb\"" Jul 06 22:56:19.110448 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.110421 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd"] Jul 06 22:56:19.165623 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.165592 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26262cf1-7203-49e7-9abb-0c7874da4122-istio-podinfo\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.165623 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.165624 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26262cf1-7203-49e7-9abb-0c7874da4122-istio-token\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.165846 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.165644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc5sb\" (UniqueName: \"kubernetes.io/projected/26262cf1-7203-49e7-9abb-0c7874da4122-kube-api-access-cc5sb\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.165846 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.165661 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26262cf1-7203-49e7-9abb-0c7874da4122-istiod-ca-cert\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.165846 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.165741 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-workload-certs\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.165846 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.165771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-istio-envoy\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.165846 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.165788 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-istio-data\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.166029 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.165861 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-credential-socket\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.166029 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.165902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-workload-socket\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.267152 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267116 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-credential-socket\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.267633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-workload-socket\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.267633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26262cf1-7203-49e7-9abb-0c7874da4122-istio-podinfo\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.267633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26262cf1-7203-49e7-9abb-0c7874da4122-istio-token\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.267633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc5sb\" (UniqueName: \"kubernetes.io/projected/26262cf1-7203-49e7-9abb-0c7874da4122-kube-api-access-cc5sb\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.267633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26262cf1-7203-49e7-9abb-0c7874da4122-istiod-ca-cert\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.267633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-workload-certs\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.267633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-istio-envoy\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.267633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-istio-data\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.267633 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267601 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-credential-socket\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.268087 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-workload-socket\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.268087 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267853 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-workload-certs\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.268087 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.267925 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-istio-data\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.268324 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.268300 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26262cf1-7203-49e7-9abb-0c7874da4122-istiod-ca-cert\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.269816 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.269790 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-istio-envoy\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.269994 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.269977 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26262cf1-7203-49e7-9abb-0c7874da4122-istio-podinfo\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.275180 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.275155 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26262cf1-7203-49e7-9abb-0c7874da4122-istio-token\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.275264 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.275163 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc5sb\" (UniqueName: \"kubernetes.io/projected/26262cf1-7203-49e7-9abb-0c7874da4122-kube-api-access-cc5sb\") pod \"e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.412930 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.412893 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:19.545577 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.545538 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd"] Jul 06 22:56:19.547310 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:56:19.547279 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26262cf1_7203_49e7_9abb_0c7874da4122.slice/crio-33b63e44135481ddce45334438c0a5a8ad19fe00d45cbf1abb7edcc6dcb2b1c2 WatchSource:0}: Error finding container 33b63e44135481ddce45334438c0a5a8ad19fe00d45cbf1abb7edcc6dcb2b1c2: Status 404 returned error can't find the container with id 33b63e44135481ddce45334438c0a5a8ad19fe00d45cbf1abb7edcc6dcb2b1c2 Jul 06 22:56:19.549364 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.549336 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:19.549454 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.549401 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:19.549454 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:19.549431 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:20.369162 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:20.369121 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" event={"ID":"26262cf1-7203-49e7-9abb-0c7874da4122","Type":"ContainerStarted","Data":"d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8"} Jul 06 22:56:20.369637 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:20.369209 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" event={"ID":"26262cf1-7203-49e7-9abb-0c7874da4122","Type":"ContainerStarted","Data":"33b63e44135481ddce45334438c0a5a8ad19fe00d45cbf1abb7edcc6dcb2b1c2"} Jul 06 22:56:20.391124 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:20.391075 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" podStartSLOduration=1.391061087 podStartE2EDuration="1.391061087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:56:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:56:20.389108526 +0000 UTC m=+1947.782702329" watchObservedRunningTime="2026-07-06 22:56:20.391061087 +0000 UTC m=+1947.784654899" Jul 06 22:56:20.413390 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:20.413353 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:20.418221 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:20.418201 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:21.374305 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:21.374276 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:21.375303 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:21.375286 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:23.387942 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.387913 2564 generic.go:356] "Generic (PLEG): container finished" podID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerID="ddf0cc53c66859867b395edc87c3f79e0b4f774fea5e69cc3d7ab607a268cd58" exitCode=0 Jul 06 22:56:23.388268 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.387983 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" event={"ID":"d0958af7-1632-4879-9031-4beab8ffb5b6","Type":"ContainerDied","Data":"ddf0cc53c66859867b395edc87c3f79e0b4f774fea5e69cc3d7ab607a268cd58"} Jul 06 22:56:23.388268 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.388050 2564 scope.go:117] "RemoveContainer" containerID="bee294221f2ee1d2838465805e75717bc91fffea665fa510f2ee59ee50cd8a56" Jul 06 22:56:23.519044 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.519022 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:56:23.605696 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.605670 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-credential-socket\") pod \"d0958af7-1632-4879-9031-4beab8ffb5b6\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " Jul 06 22:56:23.605847 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.605717 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-podinfo\") pod \"d0958af7-1632-4879-9031-4beab8ffb5b6\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " Jul 06 22:56:23.605847 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.605742 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-workload-socket\") pod \"d0958af7-1632-4879-9031-4beab8ffb5b6\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " Jul 06 22:56:23.605847 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.605758 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn7ss\" (UniqueName: \"kubernetes.io/projected/d0958af7-1632-4879-9031-4beab8ffb5b6-kube-api-access-gn7ss\") pod \"d0958af7-1632-4879-9031-4beab8ffb5b6\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " Jul 06 22:56:23.605847 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.605799 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-workload-certs\") pod \"d0958af7-1632-4879-9031-4beab8ffb5b6\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " Jul 06 22:56:23.605847 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.605824 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-data\") pod \"d0958af7-1632-4879-9031-4beab8ffb5b6\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " Jul 06 22:56:23.605847 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.605841 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-token\") pod \"d0958af7-1632-4879-9031-4beab8ffb5b6\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " Jul 06 22:56:23.606182 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.605870 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0958af7-1632-4879-9031-4beab8ffb5b6-istiod-ca-cert\") pod \"d0958af7-1632-4879-9031-4beab8ffb5b6\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " Jul 06 22:56:23.606182 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.605899 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-envoy\") pod \"d0958af7-1632-4879-9031-4beab8ffb5b6\" (UID: \"d0958af7-1632-4879-9031-4beab8ffb5b6\") " Jul 06 22:56:23.606182 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.605978 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0958af7-1632-4879-9031-4beab8ffb5b6" (UID: "d0958af7-1632-4879-9031-4beab8ffb5b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:23.606182 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.606052 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0958af7-1632-4879-9031-4beab8ffb5b6" (UID: "d0958af7-1632-4879-9031-4beab8ffb5b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:23.606182 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.606099 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0958af7-1632-4879-9031-4beab8ffb5b6" (UID: "d0958af7-1632-4879-9031-4beab8ffb5b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:23.606427 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.606185 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-credential-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:23.606427 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.606203 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-workload-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:23.606427 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.606220 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-workload-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:23.606616 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.606428 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0958af7-1632-4879-9031-4beab8ffb5b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0958af7-1632-4879-9031-4beab8ffb5b6" (UID: "d0958af7-1632-4879-9031-4beab8ffb5b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:56:23.606862 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.606840 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0958af7-1632-4879-9031-4beab8ffb5b6" (UID: "d0958af7-1632-4879-9031-4beab8ffb5b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:23.607953 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.607926 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0958af7-1632-4879-9031-4beab8ffb5b6" (UID: "d0958af7-1632-4879-9031-4beab8ffb5b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:23.608070 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.608027 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0958af7-1632-4879-9031-4beab8ffb5b6" (UID: "d0958af7-1632-4879-9031-4beab8ffb5b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:56:23.608339 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.608314 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0958af7-1632-4879-9031-4beab8ffb5b6-kube-api-access-gn7ss" (OuterVolumeSpecName: "kube-api-access-gn7ss") pod "d0958af7-1632-4879-9031-4beab8ffb5b6" (UID: "d0958af7-1632-4879-9031-4beab8ffb5b6"). InnerVolumeSpecName "kube-api-access-gn7ss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:56:23.608339 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.608324 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0958af7-1632-4879-9031-4beab8ffb5b6" (UID: "d0958af7-1632-4879-9031-4beab8ffb5b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:56:23.706902 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.706868 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0958af7-1632-4879-9031-4beab8ffb5b6-istiod-ca-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:23.706902 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.706894 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-envoy\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:23.706902 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.706903 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-podinfo\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:23.707131 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.706912 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn7ss\" (UniqueName: \"kubernetes.io/projected/d0958af7-1632-4879-9031-4beab8ffb5b6-kube-api-access-gn7ss\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:23.707131 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.706922 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-data\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:23.707131 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:23.706931 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0958af7-1632-4879-9031-4beab8ffb5b6-istio-token\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:24.394770 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:24.394730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" event={"ID":"d0958af7-1632-4879-9031-4beab8ffb5b6","Type":"ContainerDied","Data":"012fb76d397e7fe240689e00fdd0edceefc190973318d5bbd8b9311259a6a305"} Jul 06 22:56:24.395169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:24.394791 2564 scope.go:117] "RemoveContainer" containerID="ddf0cc53c66859867b395edc87c3f79e0b4f774fea5e69cc3d7ab607a268cd58" Jul 06 22:56:24.395169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:24.394746 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq" Jul 06 22:56:24.432675 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:24.432648 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq"] Jul 06 22:56:24.439176 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:24.439154 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f49549-openshift-default-6f6f8bffd5-krbtq"] Jul 06 22:56:25.043180 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:25.043147 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" path="/var/lib/kubelet/pods/d0958af7-1632-4879-9031-4beab8ffb5b6/volumes" Jul 06 22:56:27.473617 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.473583 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g"] Jul 06 22:56:27.474022 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.473890 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" Jul 06 22:56:27.474022 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.473901 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" Jul 06 22:56:27.474022 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.473909 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" Jul 06 22:56:27.474022 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.473914 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" Jul 06 22:56:27.474022 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.473966 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" Jul 06 22:56:27.474022 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.473973 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0958af7-1632-4879-9031-4beab8ffb5b6" containerName="istio-proxy" Jul 06 22:56:27.477029 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.477006 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.479587 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.479565 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e97391-openshift-default-dockercfg-d2q2v\"" Jul 06 22:56:27.489169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.489147 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g"] Jul 06 22:56:27.540412 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.540383 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j7ld\" (UniqueName: \"kubernetes.io/projected/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-kube-api-access-2j7ld\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.540581 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.540417 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-workload-socket\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.540581 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.540439 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istiod-ca-cert\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.540581 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.540507 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-data\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.540581 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.540553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-podinfo\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.540581 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.540580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-token\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.540800 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.540614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-workload-certs\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.540800 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.540676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-envoy\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.540800 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.540738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-credential-socket\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642179 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-workload-certs\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642179 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-envoy\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642446 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-credential-socket\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642446 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642264 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j7ld\" (UniqueName: \"kubernetes.io/projected/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-kube-api-access-2j7ld\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642446 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-workload-socket\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642446 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istiod-ca-cert\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642446 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-data\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642727 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-podinfo\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642727 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642569 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-token\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642727 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-workload-certs\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642727 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642675 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-credential-socket\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642869 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642755 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-workload-socket\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.642905 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.642871 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-data\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.643064 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.643046 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istiod-ca-cert\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.644511 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.644476 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-envoy\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.644935 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.644912 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-podinfo\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.649912 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.649889 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-token\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.650573 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.650556 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j7ld\" (UniqueName: \"kubernetes.io/projected/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-kube-api-access-2j7ld\") pod \"e2e-api-b-e97391-openshift-default-768b45444f-8625g\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.787032 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.786942 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:27.922763 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.922699 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g"] Jul 06 22:56:27.925666 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:56:27.925635 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aaaeb81_e581_4324_b2c7_dd75b269e2cc.slice/crio-437cbe0e15db77c98d503cf51a5f653b1a835be6da19c2283fd3cc3733b27402 WatchSource:0}: Error finding container 437cbe0e15db77c98d503cf51a5f653b1a835be6da19c2283fd3cc3733b27402: Status 404 returned error can't find the container with id 437cbe0e15db77c98d503cf51a5f653b1a835be6da19c2283fd3cc3733b27402 Jul 06 22:56:27.928226 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.928186 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:27.928308 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.928272 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:27.928342 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:27.928313 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:28.417453 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:28.417412 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" event={"ID":"9aaaeb81-e581-4324-b2c7-dd75b269e2cc","Type":"ContainerStarted","Data":"075b2a26681b552bf8b03e05c4807d73b05cab4669c68446fe34bba9f42dfca3"} Jul 06 22:56:28.417678 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:28.417475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" event={"ID":"9aaaeb81-e581-4324-b2c7-dd75b269e2cc","Type":"ContainerStarted","Data":"437cbe0e15db77c98d503cf51a5f653b1a835be6da19c2283fd3cc3733b27402"} Jul 06 22:56:28.438813 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:28.438767 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" podStartSLOduration=1.438751334 podStartE2EDuration="1.438751334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:56:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:56:28.435552705 +0000 UTC m=+1955.829146514" watchObservedRunningTime="2026-07-06 22:56:28.438751334 +0000 UTC m=+1955.832345146" Jul 06 22:56:28.787532 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:28.787423 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:28.792388 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:28.792362 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:29.422932 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:29.422899 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:29.423796 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:29.423778 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:30.230651 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:30.230614 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:56:37.416663 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:37.416619 2564 patch_prober.go:28] interesting pod/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 22:56:37.417050 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:37.416705 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 22:56:38.468921 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:38.468888 2564 generic.go:356] "Generic (PLEG): container finished" podID="26262cf1-7203-49e7-9abb-0c7874da4122" containerID="d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8" exitCode=0 Jul 06 22:56:38.469333 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:38.468961 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" event={"ID":"26262cf1-7203-49e7-9abb-0c7874da4122","Type":"ContainerDied","Data":"d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8"} Jul 06 22:56:38.469333 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:38.469312 2564 scope.go:117] "RemoveContainer" containerID="d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8" Jul 06 22:56:38.470302 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:38.470276 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:38.470411 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:38.470356 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:38.470411 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:38.470400 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:39.480016 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:39.479970 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" event={"ID":"26262cf1-7203-49e7-9abb-0c7874da4122","Type":"ContainerStarted","Data":"9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171"} Jul 06 22:56:40.413947 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:40.413902 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:40.414174 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:40.414035 2564 patch_prober.go:28] interesting pod/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 06 22:56:40.414174 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:40.414079 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 06 22:56:41.413696 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:41.413656 2564 patch_prober.go:28] interesting pod/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 06 22:56:41.414346 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:41.414311 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 06 22:56:42.413950 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:42.413902 2564 patch_prober.go:28] interesting pod/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 06 22:56:42.414465 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:42.413979 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 06 22:56:43.413723 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:43.413682 2564 patch_prober.go:28] interesting pod/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 06 22:56:43.413882 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:43.413744 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 06 22:56:44.417174 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:44.417143 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:44.417568 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:44.417415 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:44.418031 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:44.418011 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:44.427569 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:44.427544 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:56:45.464626 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:45.464594 2564 patch_prober.go:28] interesting pod/e2e-api-b-e97391-openshift-default-768b45444f-8625g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 22:56:45.466083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:45.464648 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 22:56:46.526600 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:46.526569 2564 generic.go:356] "Generic (PLEG): container finished" podID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerID="075b2a26681b552bf8b03e05c4807d73b05cab4669c68446fe34bba9f42dfca3" exitCode=0 Jul 06 22:56:46.526977 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:46.526649 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" event={"ID":"9aaaeb81-e581-4324-b2c7-dd75b269e2cc","Type":"ContainerDied","Data":"075b2a26681b552bf8b03e05c4807d73b05cab4669c68446fe34bba9f42dfca3"} Jul 06 22:56:46.527020 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:46.526988 2564 scope.go:117] "RemoveContainer" containerID="075b2a26681b552bf8b03e05c4807d73b05cab4669c68446fe34bba9f42dfca3" Jul 06 22:56:46.527975 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:46.527949 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:46.528040 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:46.528026 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:46.528077 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:46.528068 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:47.533819 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:47.533783 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" event={"ID":"9aaaeb81-e581-4324-b2c7-dd75b269e2cc","Type":"ContainerStarted","Data":"91593b18fcd579319da2669510b66c942b0f4e135a8a9c861bbedc2e0ba6bb45"} Jul 06 22:56:47.788386 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:47.788288 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:47.789054 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:47.788717 2564 patch_prober.go:28] interesting pod/e2e-api-b-e97391-openshift-default-768b45444f-8625g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 06 22:56:47.789054 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:47.788771 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 06 22:56:48.788119 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:48.788079 2564 patch_prober.go:28] interesting pod/e2e-api-b-e97391-openshift-default-768b45444f-8625g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 06 22:56:48.788740 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:48.788705 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 06 22:56:49.315173 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:49.315137 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd"] Jul 06 22:56:49.315359 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:49.315336 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" containerName="istio-proxy" containerID="cri-o://9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171" gracePeriod=30 Jul 06 22:56:49.787910 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:49.787872 2564 patch_prober.go:28] interesting pod/e2e-api-b-e97391-openshift-default-768b45444f-8625g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 06 22:56:49.788190 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:49.788159 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 06 22:56:50.787944 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:50.787905 2564 patch_prober.go:28] interesting pod/e2e-api-b-e97391-openshift-default-768b45444f-8625g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 06 22:56:50.788261 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:50.788228 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 06 22:56:51.791662 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:51.791631 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:51.792038 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:51.791968 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:51.792546 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:51.792528 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:56:53.833916 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:53.833880 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:56:54.562580 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.562557 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:54.568471 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.568436 2564 generic.go:356] "Generic (PLEG): container finished" podID="26262cf1-7203-49e7-9abb-0c7874da4122" containerID="9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171" exitCode=0 Jul 06 22:56:54.568471 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.568471 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" Jul 06 22:56:54.568641 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.568584 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" event={"ID":"26262cf1-7203-49e7-9abb-0c7874da4122","Type":"ContainerDied","Data":"9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171"} Jul 06 22:56:54.568641 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.568631 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd" event={"ID":"26262cf1-7203-49e7-9abb-0c7874da4122","Type":"ContainerDied","Data":"33b63e44135481ddce45334438c0a5a8ad19fe00d45cbf1abb7edcc6dcb2b1c2"} Jul 06 22:56:54.568709 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.568654 2564 scope.go:117] "RemoveContainer" containerID="9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171" Jul 06 22:56:54.576982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.576961 2564 scope.go:117] "RemoveContainer" containerID="d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8" Jul 06 22:56:54.585460 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.585430 2564 scope.go:117] "RemoveContainer" containerID="9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171" Jul 06 22:56:54.585869 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:56:54.585841 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171\": container with ID starting with 9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171 not found: ID does not exist" containerID="9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171" Jul 06 22:56:54.585972 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.585879 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171"} err="failed to get container status \"9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171\": rpc error: code = NotFound desc = could not find container \"9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171\": container with ID starting with 9fdcbadeba07ccb123ea5844b875c21c99e87f85c12f52e114f6bb0ec7d18171 not found: ID does not exist" Jul 06 22:56:54.585972 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.585903 2564 scope.go:117] "RemoveContainer" containerID="d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8" Jul 06 22:56:54.586169 ip-10-0-130-224 kubenswrapper[2564]: E0706 22:56:54.586148 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8\": container with ID starting with d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8 not found: ID does not exist" containerID="d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8" Jul 06 22:56:54.586226 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.586173 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8"} err="failed to get container status \"d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8\": rpc error: code = NotFound desc = could not find container \"d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8\": container with ID starting with d471bde248ee8550d85ff0d75700f6d6339322905796a02cf08080f8e0623ed8 not found: ID does not exist" Jul 06 22:56:54.591453 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.591436 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26262cf1-7203-49e7-9abb-0c7874da4122-istiod-ca-cert\") pod \"26262cf1-7203-49e7-9abb-0c7874da4122\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " Jul 06 22:56:54.591555 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.591477 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26262cf1-7203-49e7-9abb-0c7874da4122-istio-token\") pod \"26262cf1-7203-49e7-9abb-0c7874da4122\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " Jul 06 22:56:54.591555 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.591509 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-istio-data\") pod \"26262cf1-7203-49e7-9abb-0c7874da4122\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " Jul 06 22:56:54.591644 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.591623 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26262cf1-7203-49e7-9abb-0c7874da4122-istio-podinfo\") pod \"26262cf1-7203-49e7-9abb-0c7874da4122\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " Jul 06 22:56:54.591687 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.591665 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-workload-certs\") pod \"26262cf1-7203-49e7-9abb-0c7874da4122\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " Jul 06 22:56:54.591742 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.591700 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc5sb\" (UniqueName: \"kubernetes.io/projected/26262cf1-7203-49e7-9abb-0c7874da4122-kube-api-access-cc5sb\") pod \"26262cf1-7203-49e7-9abb-0c7874da4122\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " Jul 06 22:56:54.591742 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.591734 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-credential-socket\") pod \"26262cf1-7203-49e7-9abb-0c7874da4122\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " Jul 06 22:56:54.591849 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.591767 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-istio-envoy\") pod \"26262cf1-7203-49e7-9abb-0c7874da4122\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " Jul 06 22:56:54.591849 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.591796 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-workload-socket\") pod \"26262cf1-7203-49e7-9abb-0c7874da4122\" (UID: \"26262cf1-7203-49e7-9abb-0c7874da4122\") " Jul 06 22:56:54.591849 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.591809 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26262cf1-7203-49e7-9abb-0c7874da4122-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26262cf1-7203-49e7-9abb-0c7874da4122" (UID: "26262cf1-7203-49e7-9abb-0c7874da4122"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:56:54.592090 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.592046 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26262cf1-7203-49e7-9abb-0c7874da4122" (UID: "26262cf1-7203-49e7-9abb-0c7874da4122"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:54.592090 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.592073 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26262cf1-7203-49e7-9abb-0c7874da4122-istiod-ca-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:54.592314 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.592290 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26262cf1-7203-49e7-9abb-0c7874da4122" (UID: "26262cf1-7203-49e7-9abb-0c7874da4122"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:54.592454 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.592361 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-istio-data" (OuterVolumeSpecName: "istio-data") pod "26262cf1-7203-49e7-9abb-0c7874da4122" (UID: "26262cf1-7203-49e7-9abb-0c7874da4122"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:54.592454 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.592441 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26262cf1-7203-49e7-9abb-0c7874da4122" (UID: "26262cf1-7203-49e7-9abb-0c7874da4122"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:54.593730 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.593705 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26262cf1-7203-49e7-9abb-0c7874da4122-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26262cf1-7203-49e7-9abb-0c7874da4122" (UID: "26262cf1-7203-49e7-9abb-0c7874da4122"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:56:54.593933 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.593908 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26262cf1-7203-49e7-9abb-0c7874da4122-kube-api-access-cc5sb" (OuterVolumeSpecName: "kube-api-access-cc5sb") pod "26262cf1-7203-49e7-9abb-0c7874da4122" (UID: "26262cf1-7203-49e7-9abb-0c7874da4122"). InnerVolumeSpecName "kube-api-access-cc5sb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:56:54.594056 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.594039 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26262cf1-7203-49e7-9abb-0c7874da4122-istio-token" (OuterVolumeSpecName: "istio-token") pod "26262cf1-7203-49e7-9abb-0c7874da4122" (UID: "26262cf1-7203-49e7-9abb-0c7874da4122"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:56:54.594361 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.594335 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26262cf1-7203-49e7-9abb-0c7874da4122" (UID: "26262cf1-7203-49e7-9abb-0c7874da4122"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:54.692941 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.692908 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26262cf1-7203-49e7-9abb-0c7874da4122-istio-podinfo\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:54.692941 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.692941 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-workload-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:54.693125 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.692954 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc5sb\" (UniqueName: \"kubernetes.io/projected/26262cf1-7203-49e7-9abb-0c7874da4122-kube-api-access-cc5sb\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:54.693125 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.692968 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-credential-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:54.693125 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.692981 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-istio-envoy\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:54.693125 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.692992 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-workload-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:54.693125 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.693003 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26262cf1-7203-49e7-9abb-0c7874da4122-istio-token\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:54.693125 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.693015 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26262cf1-7203-49e7-9abb-0c7874da4122-istio-data\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:56:54.891555 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.891525 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd"] Jul 06 22:56:54.895049 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:54.895022 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b793fb-openshift-default-59fbd4cb89-znkgd"] Jul 06 22:56:55.043010 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:55.042981 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" path="/var/lib/kubelet/pods/26262cf1-7203-49e7-9abb-0c7874da4122/volumes" Jul 06 22:56:56.448963 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:56.448930 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g"] Jul 06 22:56:56.449373 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:56.449155 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerName="istio-proxy" containerID="cri-o://91593b18fcd579319da2669510b66c942b0f4e135a8a9c861bbedc2e0ba6bb45" gracePeriod=30 Jul 06 22:56:57.256355 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.256319 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp"] Jul 06 22:56:57.256676 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.256662 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" containerName="istio-proxy" Jul 06 22:56:57.256768 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.256678 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" containerName="istio-proxy" Jul 06 22:56:57.256768 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.256736 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" containerName="istio-proxy" Jul 06 22:56:57.256768 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.256744 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" containerName="istio-proxy" Jul 06 22:56:57.259716 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.259694 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.262729 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.262709 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-936b5d-openshift-default-dockercfg-ksjlf\"" Jul 06 22:56:57.271630 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.271611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp"] Jul 06 22:56:57.313950 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.313925 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8210f79c-df54-4251-9215-4d172196e24f-istiod-ca-cert\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.314087 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.313958 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-workload-socket\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.314087 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.313980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-workload-certs\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.314087 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.314039 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-istio-data\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.314202 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.314098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8210f79c-df54-4251-9215-4d172196e24f-istio-token\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.314202 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.314125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bjxv\" (UniqueName: \"kubernetes.io/projected/8210f79c-df54-4251-9215-4d172196e24f-kube-api-access-5bjxv\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.314202 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.314145 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8210f79c-df54-4251-9215-4d172196e24f-istio-podinfo\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.314202 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.314174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-istio-envoy\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.314328 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.314209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-credential-socket\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.414976 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.414947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8210f79c-df54-4251-9215-4d172196e24f-istiod-ca-cert\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.415145 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.414985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-workload-socket\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.415145 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.415016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-workload-certs\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.415145 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.415044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-istio-data\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.415145 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.415066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8210f79c-df54-4251-9215-4d172196e24f-istio-token\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.415145 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.415083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bjxv\" (UniqueName: \"kubernetes.io/projected/8210f79c-df54-4251-9215-4d172196e24f-kube-api-access-5bjxv\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.415145 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.415113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8210f79c-df54-4251-9215-4d172196e24f-istio-podinfo\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.415459 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.415247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-istio-envoy\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.415459 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.415309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-credential-socket\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.415459 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.415399 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-workload-socket\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.415459 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.415447 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-istio-data\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.415969 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.415933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8210f79c-df54-4251-9215-4d172196e24f-istiod-ca-cert\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.415969 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.415954 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-workload-certs\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.416124 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.415972 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-credential-socket\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.417604 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.417584 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8210f79c-df54-4251-9215-4d172196e24f-istio-podinfo\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.417698 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.417641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-istio-envoy\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.423388 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.423360 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bjxv\" (UniqueName: \"kubernetes.io/projected/8210f79c-df54-4251-9215-4d172196e24f-kube-api-access-5bjxv\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.423750 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.423728 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8210f79c-df54-4251-9215-4d172196e24f-istio-token\") pod \"e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.569669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.569592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:57.709128 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.709100 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp"] Jul 06 22:56:57.710630 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:56:57.710605 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8210f79c_df54_4251_9215_4d172196e24f.slice/crio-04a41c7c2bf5cc071bc15b792c6012181a6aac3ab8986f574807a03fffebdb23 WatchSource:0}: Error finding container 04a41c7c2bf5cc071bc15b792c6012181a6aac3ab8986f574807a03fffebdb23: Status 404 returned error can't find the container with id 04a41c7c2bf5cc071bc15b792c6012181a6aac3ab8986f574807a03fffebdb23 Jul 06 22:56:57.712828 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.712776 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:57.712912 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.712861 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:57.712912 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:57.712899 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:56:58.590943 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:58.590910 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" event={"ID":"8210f79c-df54-4251-9215-4d172196e24f","Type":"ContainerStarted","Data":"d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4"} Jul 06 22:56:58.591322 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:58.590959 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" event={"ID":"8210f79c-df54-4251-9215-4d172196e24f","Type":"ContainerStarted","Data":"04a41c7c2bf5cc071bc15b792c6012181a6aac3ab8986f574807a03fffebdb23"} Jul 06 22:56:58.614145 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:58.614098 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" podStartSLOduration=1.614084748 podStartE2EDuration="1.614084748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:56:58.612110598 +0000 UTC m=+1986.005704679" watchObservedRunningTime="2026-07-06 22:56:58.614084748 +0000 UTC m=+1986.007678559" Jul 06 22:56:59.570768 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:59.570738 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:59.575538 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:59.575512 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:59.596960 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:59.596925 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:56:59.597688 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:56:59.597671 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:57:01.608196 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.608163 2564 generic.go:356] "Generic (PLEG): container finished" podID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerID="91593b18fcd579319da2669510b66c942b0f4e135a8a9c861bbedc2e0ba6bb45" exitCode=0 Jul 06 22:57:01.608672 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.608243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" event={"ID":"9aaaeb81-e581-4324-b2c7-dd75b269e2cc","Type":"ContainerDied","Data":"91593b18fcd579319da2669510b66c942b0f4e135a8a9c861bbedc2e0ba6bb45"} Jul 06 22:57:01.608672 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.608359 2564 scope.go:117] "RemoveContainer" containerID="075b2a26681b552bf8b03e05c4807d73b05cab4669c68446fe34bba9f42dfca3" Jul 06 22:57:01.704826 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.704800 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:57:01.753934 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.753848 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-workload-certs\") pod \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " Jul 06 22:57:01.753934 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.753913 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-token\") pod \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " Jul 06 22:57:01.754169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.753939 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-data\") pod \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " Jul 06 22:57:01.754169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.753972 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-podinfo\") pod \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " Jul 06 22:57:01.754169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.754005 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-workload-socket\") pod \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " Jul 06 22:57:01.754169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.754042 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-envoy\") pod \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " Jul 06 22:57:01.754169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.754086 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-credential-socket\") pod \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " Jul 06 22:57:01.754169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.754141 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istiod-ca-cert\") pod \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " Jul 06 22:57:01.754169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.754148 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9aaaeb81-e581-4324-b2c7-dd75b269e2cc" (UID: "9aaaeb81-e581-4324-b2c7-dd75b269e2cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:57:01.754572 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.754191 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j7ld\" (UniqueName: \"kubernetes.io/projected/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-kube-api-access-2j7ld\") pod \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\" (UID: \"9aaaeb81-e581-4324-b2c7-dd75b269e2cc\") " Jul 06 22:57:01.754572 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.754410 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9aaaeb81-e581-4324-b2c7-dd75b269e2cc" (UID: "9aaaeb81-e581-4324-b2c7-dd75b269e2cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:57:01.754572 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.754469 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-workload-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:57:01.754572 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.754476 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9aaaeb81-e581-4324-b2c7-dd75b269e2cc" (UID: "9aaaeb81-e581-4324-b2c7-dd75b269e2cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:57:01.754572 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.754561 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9aaaeb81-e581-4324-b2c7-dd75b269e2cc" (UID: "9aaaeb81-e581-4324-b2c7-dd75b269e2cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:57:01.754835 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.754813 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "9aaaeb81-e581-4324-b2c7-dd75b269e2cc" (UID: "9aaaeb81-e581-4324-b2c7-dd75b269e2cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:57:01.756281 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.756251 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9aaaeb81-e581-4324-b2c7-dd75b269e2cc" (UID: "9aaaeb81-e581-4324-b2c7-dd75b269e2cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:57:01.756390 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.756258 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9aaaeb81-e581-4324-b2c7-dd75b269e2cc" (UID: "9aaaeb81-e581-4324-b2c7-dd75b269e2cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:57:01.756390 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.756259 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "9aaaeb81-e581-4324-b2c7-dd75b269e2cc" (UID: "9aaaeb81-e581-4324-b2c7-dd75b269e2cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:57:01.756390 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.756282 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-kube-api-access-2j7ld" (OuterVolumeSpecName: "kube-api-access-2j7ld") pod "9aaaeb81-e581-4324-b2c7-dd75b269e2cc" (UID: "9aaaeb81-e581-4324-b2c7-dd75b269e2cc"). InnerVolumeSpecName "kube-api-access-2j7ld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:57:01.855169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.855129 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-data\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:57:01.855169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.855164 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-podinfo\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:57:01.855169 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.855173 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-workload-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:57:01.855414 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.855183 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-envoy\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:57:01.855414 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.855192 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-credential-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:57:01.855414 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.855200 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istiod-ca-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:57:01.855414 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.855209 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j7ld\" (UniqueName: \"kubernetes.io/projected/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-kube-api-access-2j7ld\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:57:01.855414 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:01.855217 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aaaeb81-e581-4324-b2c7-dd75b269e2cc-istio-token\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 22:57:02.614740 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:02.614714 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" Jul 06 22:57:02.615200 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:02.614763 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g" event={"ID":"9aaaeb81-e581-4324-b2c7-dd75b269e2cc","Type":"ContainerDied","Data":"437cbe0e15db77c98d503cf51a5f653b1a835be6da19c2283fd3cc3733b27402"} Jul 06 22:57:02.615200 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:02.614818 2564 scope.go:117] "RemoveContainer" containerID="91593b18fcd579319da2669510b66c942b0f4e135a8a9c861bbedc2e0ba6bb45" Jul 06 22:57:02.669153 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:02.669120 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g"] Jul 06 22:57:02.677367 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:02.677340 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e97391-openshift-default-768b45444f-8625g"] Jul 06 22:57:03.043516 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:03.043411 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" path="/var/lib/kubelet/pods/9aaaeb81-e581-4324-b2c7-dd75b269e2cc/volumes" Jul 06 22:57:04.931703 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:04.931666 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:57:05.536531 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.536500 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb"] Jul 06 22:57:05.536912 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.536887 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerName="istio-proxy" Jul 06 22:57:05.536912 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.536910 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerName="istio-proxy" Jul 06 22:57:05.537134 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.536929 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" containerName="istio-proxy" Jul 06 22:57:05.537134 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.536937 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="26262cf1-7203-49e7-9abb-0c7874da4122" containerName="istio-proxy" Jul 06 22:57:05.537134 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.536947 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerName="istio-proxy" Jul 06 22:57:05.537134 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.536952 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerName="istio-proxy" Jul 06 22:57:05.537134 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.537019 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerName="istio-proxy" Jul 06 22:57:05.541669 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.541646 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.544072 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.544054 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-cf2b54-openshift-default-dockercfg-bzzq4\"" Jul 06 22:57:05.552762 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.552738 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb"] Jul 06 22:57:05.587311 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.587279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-credential-socket\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.587440 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.587315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-workload-certs\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.587440 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.587341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2gwm\" (UniqueName: \"kubernetes.io/projected/46f26bed-fecd-4312-bbcd-18615156dbc0-kube-api-access-z2gwm\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.587440 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.587401 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-envoy\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.587440 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.587437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-token\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.587613 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.587465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f26bed-fecd-4312-bbcd-18615156dbc0-istiod-ca-cert\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.587613 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.587559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-workload-socket\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.587613 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.587609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-data\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.587707 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.587623 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-podinfo\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.688351 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.688316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f26bed-fecd-4312-bbcd-18615156dbc0-istiod-ca-cert\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.688552 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.688385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-workload-socket\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.688552 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.688437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-data\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.688552 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.688460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-podinfo\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.688794 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.688608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-credential-socket\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.688794 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.688643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-workload-certs\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.688794 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.688671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2gwm\" (UniqueName: \"kubernetes.io/projected/46f26bed-fecd-4312-bbcd-18615156dbc0-kube-api-access-z2gwm\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.688794 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.688701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-envoy\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.688794 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.688728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-token\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.689024 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.688855 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-workload-socket\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.689024 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.688906 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-data\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.689024 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.688999 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-credential-socket\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.689123 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.689080 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-workload-certs\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.689168 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.689147 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f26bed-fecd-4312-bbcd-18615156dbc0-istiod-ca-cert\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.690825 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.690806 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-envoy\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.690939 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.690922 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-podinfo\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.696421 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.696398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-token\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.696652 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.696633 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2gwm\" (UniqueName: \"kubernetes.io/projected/46f26bed-fecd-4312-bbcd-18615156dbc0-kube-api-access-z2gwm\") pod \"e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:05.852600 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:05.852558 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:06.012527 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:06.012480 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb"] Jul 06 22:57:06.014148 ip-10-0-130-224 kubenswrapper[2564]: W0706 22:57:06.014118 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f26bed_fecd_4312_bbcd_18615156dbc0.slice/crio-3c0eba31c94d8e5c151e88d509ddf7c9f5a5b015c12bdc1286bf961d0d0bf939 WatchSource:0}: Error finding container 3c0eba31c94d8e5c151e88d509ddf7c9f5a5b015c12bdc1286bf961d0d0bf939: Status 404 returned error can't find the container with id 3c0eba31c94d8e5c151e88d509ddf7c9f5a5b015c12bdc1286bf961d0d0bf939 Jul 06 22:57:06.016290 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:06.016254 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:57:06.016406 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:06.016322 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:57:06.016406 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:06.016357 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:57:06.637747 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:06.637704 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" event={"ID":"46f26bed-fecd-4312-bbcd-18615156dbc0","Type":"ContainerStarted","Data":"068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7"} Jul 06 22:57:06.637945 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:06.637795 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" event={"ID":"46f26bed-fecd-4312-bbcd-18615156dbc0","Type":"ContainerStarted","Data":"3c0eba31c94d8e5c151e88d509ddf7c9f5a5b015c12bdc1286bf961d0d0bf939"} Jul 06 22:57:06.656404 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:06.656360 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" podStartSLOduration=1.656342743 podStartE2EDuration="1.656342743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:57:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:57:06.656053477 +0000 UTC m=+1994.049647291" watchObservedRunningTime="2026-07-06 22:57:06.656342743 +0000 UTC m=+1994.049936556" Jul 06 22:57:06.853481 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:06.853440 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:07.858926 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:07.858894 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:08.648409 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:08.648378 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:08.649181 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:08.649160 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:13.632777 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:13.632739 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:57:13.675619 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:13.675586 2564 generic.go:356] "Generic (PLEG): container finished" podID="8210f79c-df54-4251-9215-4d172196e24f" containerID="d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4" exitCode=0 Jul 06 22:57:13.675759 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:13.675653 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" event={"ID":"8210f79c-df54-4251-9215-4d172196e24f","Type":"ContainerDied","Data":"d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4"} Jul 06 22:57:13.676017 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:13.676000 2564 scope.go:117] "RemoveContainer" containerID="d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4" Jul 06 22:57:13.676982 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:13.676955 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:57:13.677038 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:13.677020 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:57:13.677083 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:13.677051 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:57:14.598159 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:14.598121 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:57:14.687636 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:14.687596 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" event={"ID":"8210f79c-df54-4251-9215-4d172196e24f","Type":"ContainerStarted","Data":"89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091"} Jul 06 22:57:15.571907 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:15.571879 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:57:15.572221 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:15.572200 2564 patch_prober.go:28] interesting pod/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 06 22:57:15.572374 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:15.572351 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" podUID="8210f79c-df54-4251-9215-4d172196e24f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 06 22:57:16.570722 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:16.570676 2564 patch_prober.go:28] interesting pod/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 06 22:57:16.571234 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:16.570745 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" podUID="8210f79c-df54-4251-9215-4d172196e24f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 06 22:57:17.570417 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:17.570376 2564 patch_prober.go:28] interesting pod/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 06 22:57:17.570640 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:17.570450 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" podUID="8210f79c-df54-4251-9215-4d172196e24f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 06 22:57:18.573972 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:18.573943 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:57:18.574387 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:18.574348 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:57:18.574972 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:18.574952 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 22:57:21.733690 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:21.733658 2564 generic.go:356] "Generic (PLEG): container finished" podID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerID="068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7" exitCode=0 Jul 06 22:57:21.734080 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:21.733727 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" event={"ID":"46f26bed-fecd-4312-bbcd-18615156dbc0","Type":"ContainerDied","Data":"068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7"} Jul 06 22:57:21.734123 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:21.734093 2564 scope.go:117] "RemoveContainer" containerID="068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7" Jul 06 22:57:21.735088 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:21.735061 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:57:21.735151 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:21.735127 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:57:21.735187 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:21.735166 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 22:57:22.740949 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:22.740918 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" event={"ID":"46f26bed-fecd-4312-bbcd-18615156dbc0","Type":"ContainerStarted","Data":"34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773"} Jul 06 22:57:22.853906 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:22.853869 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:22.855200 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:22.855155 2564 patch_prober.go:28] interesting pod/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 06 22:57:22.855347 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:22.855226 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 06 22:57:23.649045 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:23.649015 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:23.853477 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:23.853431 2564 patch_prober.go:28] interesting pod/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 06 22:57:23.853878 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:23.853526 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 06 22:57:24.853610 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:24.853574 2564 patch_prober.go:28] interesting pod/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 06 22:57:24.853992 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:24.853632 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 06 22:57:25.541300 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:25.541264 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:57:25.852932 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:25.852898 2564 patch_prober.go:28] interesting pod/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 06 22:57:25.853109 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:25.852953 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 06 22:57:26.897215 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:26.897184 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:57:26.898377 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:57:26.898355 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 22:58:06.233065 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:58:06.230272 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:58:29.850045 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:58:29.850007 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:58:45.435572 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:58:45.435536 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:58:53.387048 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:58:53.387021 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:58:53.389788 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:58:53.389769 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 22:58:53.391939 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:58:53.391920 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:58:53.394553 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:58:53.394535 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 22:59:02.432843 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:59:02.432803 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:59:19.728095 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:59:19.728060 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:59:36.932709 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:59:36.932673 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 22:59:54.221573 ip-10-0-130-224 kubenswrapper[2564]: I0706 22:59:54.221473 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 23:00:11.134853 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:11.134816 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 23:00:20.210526 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.210480 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r"] Jul 06 23:00:20.210968 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.210872 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aaaeb81-e581-4324-b2c7-dd75b269e2cc" containerName="istio-proxy" Jul 06 23:00:20.214223 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.214203 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.218182 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.218159 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-936b5d\"/\"kube-root-ca.crt\"" Jul 06 23:00:20.218182 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.218174 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-936b5d\"/\"sub-test-model-936b5d-kserve-self-signed-certs\"" Jul 06 23:00:20.218348 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.218183 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-936b5d\"/\"default-dockercfg-cl27v\"" Jul 06 23:00:20.218348 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.218275 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-936b5d\"/\"openshift-service-ca.crt\"" Jul 06 23:00:20.224186 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.224162 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r"] Jul 06 23:00:20.312383 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.312339 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-dshm\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.312611 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.312403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-model-cache\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.312611 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.312481 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-tmp-dir\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.312611 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.312571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-home\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.312611 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.312598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9fb62c2-da46-4764-a759-d1017bc0139e-tls-certs\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.312802 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.312621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gdwv\" (UniqueName: \"kubernetes.io/projected/e9fb62c2-da46-4764-a759-d1017bc0139e-kube-api-access-6gdwv\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.414068 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.414033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-dshm\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.414265 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.414088 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-model-cache\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.414265 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.414202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-tmp-dir\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.414265 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.414252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-home\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.414444 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.414279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9fb62c2-da46-4764-a759-d1017bc0139e-tls-certs\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.414444 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.414297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gdwv\" (UniqueName: \"kubernetes.io/projected/e9fb62c2-da46-4764-a759-d1017bc0139e-kube-api-access-6gdwv\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.414444 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.414434 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-model-cache\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.414614 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.414601 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-tmp-dir\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.414658 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.414635 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-home\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.416346 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.416328 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-dshm\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.416624 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.416608 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9fb62c2-da46-4764-a759-d1017bc0139e-tls-certs\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.423240 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.423217 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gdwv\" (UniqueName: \"kubernetes.io/projected/e9fb62c2-da46-4764-a759-d1017bc0139e-kube-api-access-6gdwv\") pod \"sub-test-model-936b5d-kserve-56478fd79c-pbc4r\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.523803 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.523726 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:20.657278 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:20.657254 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r"] Jul 06 23:00:20.659260 ip-10-0-130-224 kubenswrapper[2564]: W0706 23:00:20.659228 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9fb62c2_da46_4764_a759_d1017bc0139e.slice/crio-7de33f6af1137abe6d68d8d92d75cf0b5b416ae2d9d94ef3120a22ca66dd7187 WatchSource:0}: Error finding container 7de33f6af1137abe6d68d8d92d75cf0b5b416ae2d9d94ef3120a22ca66dd7187: Status 404 returned error can't find the container with id 7de33f6af1137abe6d68d8d92d75cf0b5b416ae2d9d94ef3120a22ca66dd7187 Jul 06 23:00:21.616863 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:21.616820 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" event={"ID":"e9fb62c2-da46-4764-a759-d1017bc0139e","Type":"ContainerStarted","Data":"d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d"} Jul 06 23:00:21.616863 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:21.616871 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" event={"ID":"e9fb62c2-da46-4764-a759-d1017bc0139e","Type":"ContainerStarted","Data":"7de33f6af1137abe6d68d8d92d75cf0b5b416ae2d9d94ef3120a22ca66dd7187"} Jul 06 23:00:21.636576 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:21.636527 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" podStartSLOduration=1.6365106520000001 podStartE2EDuration="1.636510652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:00:21.633948223 +0000 UTC m=+2189.027542067" watchObservedRunningTime="2026-07-06 23:00:21.636510652 +0000 UTC m=+2189.030104464" Jul 06 23:00:23.238821 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:23.238789 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 23:00:30.524852 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:30.524803 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:30.524852 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:30.524864 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:30.537174 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:30.537150 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:30.672016 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:30.671987 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:00:59.027068 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:00:59.027034 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 23:01:20.234891 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:01:20.234814 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 23:01:38.628758 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:01:38.628716 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 23:01:44.995937 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:01:44.995904 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r"] Jul 06 23:01:58.627040 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:01:58.627001 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 23:02:00.015634 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.015588 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" podUID="e9fb62c2-da46-4764-a759-d1017bc0139e" containerName="main" containerID="cri-o://d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d" gracePeriod=45 Jul 06 23:02:00.260030 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.260006 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:02:00.385175 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.385145 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9fb62c2-da46-4764-a759-d1017bc0139e-tls-certs\") pod \"e9fb62c2-da46-4764-a759-d1017bc0139e\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " Jul 06 23:02:00.385357 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.385194 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gdwv\" (UniqueName: \"kubernetes.io/projected/e9fb62c2-da46-4764-a759-d1017bc0139e-kube-api-access-6gdwv\") pod \"e9fb62c2-da46-4764-a759-d1017bc0139e\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " Jul 06 23:02:00.385357 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.385251 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-dshm\") pod \"e9fb62c2-da46-4764-a759-d1017bc0139e\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " Jul 06 23:02:00.385357 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.385288 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-tmp-dir\") pod \"e9fb62c2-da46-4764-a759-d1017bc0139e\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " Jul 06 23:02:00.385357 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.385312 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-home\") pod \"e9fb62c2-da46-4764-a759-d1017bc0139e\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " Jul 06 23:02:00.385357 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.385339 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-model-cache\") pod \"e9fb62c2-da46-4764-a759-d1017bc0139e\" (UID: \"e9fb62c2-da46-4764-a759-d1017bc0139e\") " Jul 06 23:02:00.385660 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.385604 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e9fb62c2-da46-4764-a759-d1017bc0139e" (UID: "e9fb62c2-da46-4764-a759-d1017bc0139e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:02:00.385720 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.385694 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-model-cache" (OuterVolumeSpecName: "model-cache") pod "e9fb62c2-da46-4764-a759-d1017bc0139e" (UID: "e9fb62c2-da46-4764-a759-d1017bc0139e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:02:00.385766 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.385711 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-home" (OuterVolumeSpecName: "home") pod "e9fb62c2-da46-4764-a759-d1017bc0139e" (UID: "e9fb62c2-da46-4764-a759-d1017bc0139e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:02:00.387646 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.387616 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9fb62c2-da46-4764-a759-d1017bc0139e-kube-api-access-6gdwv" (OuterVolumeSpecName: "kube-api-access-6gdwv") pod "e9fb62c2-da46-4764-a759-d1017bc0139e" (UID: "e9fb62c2-da46-4764-a759-d1017bc0139e"). InnerVolumeSpecName "kube-api-access-6gdwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:02:00.387646 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.387627 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9fb62c2-da46-4764-a759-d1017bc0139e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e9fb62c2-da46-4764-a759-d1017bc0139e" (UID: "e9fb62c2-da46-4764-a759-d1017bc0139e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:02:00.387827 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.387647 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-dshm" (OuterVolumeSpecName: "dshm") pod "e9fb62c2-da46-4764-a759-d1017bc0139e" (UID: "e9fb62c2-da46-4764-a759-d1017bc0139e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:02:00.486877 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.486845 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-tmp-dir\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:02:00.486877 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.486871 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-home\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:02:00.486877 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.486880 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-model-cache\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:02:00.486877 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.486887 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9fb62c2-da46-4764-a759-d1017bc0139e-tls-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:02:00.487131 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.486895 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gdwv\" (UniqueName: \"kubernetes.io/projected/e9fb62c2-da46-4764-a759-d1017bc0139e-kube-api-access-6gdwv\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:02:00.487131 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:00.486904 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9fb62c2-da46-4764-a759-d1017bc0139e-dshm\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:02:01.109925 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:01.109897 2564 generic.go:356] "Generic (PLEG): container finished" podID="e9fb62c2-da46-4764-a759-d1017bc0139e" containerID="d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d" exitCode=0 Jul 06 23:02:01.110322 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:01.109937 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" Jul 06 23:02:01.110322 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:01.109984 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" event={"ID":"e9fb62c2-da46-4764-a759-d1017bc0139e","Type":"ContainerDied","Data":"d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d"} Jul 06 23:02:01.110322 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:01.110023 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r" event={"ID":"e9fb62c2-da46-4764-a759-d1017bc0139e","Type":"ContainerDied","Data":"7de33f6af1137abe6d68d8d92d75cf0b5b416ae2d9d94ef3120a22ca66dd7187"} Jul 06 23:02:01.110322 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:01.110040 2564 scope.go:117] "RemoveContainer" containerID="d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d" Jul 06 23:02:01.118564 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:01.118546 2564 scope.go:117] "RemoveContainer" containerID="d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d" Jul 06 23:02:01.118832 ip-10-0-130-224 kubenswrapper[2564]: E0706 23:02:01.118814 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d\": container with ID starting with d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d not found: ID does not exist" containerID="d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d" Jul 06 23:02:01.118897 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:01.118843 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d"} err="failed to get container status \"d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d\": rpc error: code = NotFound desc = could not find container \"d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d\": container with ID starting with d05c7debeacadc8e2090e9c1e0f91d74c0cbece021ef810a5acc96cb8897b35d not found: ID does not exist" Jul 06 23:02:01.126375 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:01.126354 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r"] Jul 06 23:02:01.129803 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:01.129783 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-936b5d/sub-test-model-936b5d-kserve-56478fd79c-pbc4r"] Jul 06 23:02:03.044382 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:03.044345 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9fb62c2-da46-4764-a759-d1017bc0139e" path="/var/lib/kubelet/pods/e9fb62c2-da46-4764-a759-d1017bc0139e/volumes" Jul 06 23:02:25.117934 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.117905 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz"] Jul 06 23:02:25.119929 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.118222 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9fb62c2-da46-4764-a759-d1017bc0139e" containerName="main" Jul 06 23:02:25.119929 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.118232 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9fb62c2-da46-4764-a759-d1017bc0139e" containerName="main" Jul 06 23:02:25.119929 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.118337 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9fb62c2-da46-4764-a759-d1017bc0139e" containerName="main" Jul 06 23:02:25.120802 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.120787 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.125376 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.125355 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cf2b54\"/\"default-dockercfg-s796x\"" Jul 06 23:02:25.125568 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.125396 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cf2b54\"/\"kube-root-ca.crt\"" Jul 06 23:02:25.125568 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.125404 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cf2b54\"/\"openshift-service-ca.crt\"" Jul 06 23:02:25.125568 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.125561 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cf2b54\"/\"rate-test-model-cf2b54-kserve-self-signed-certs\"" Jul 06 23:02:25.131605 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.131584 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz"] Jul 06 23:02:25.205687 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.205658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-tmp-dir\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.205872 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.205694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-model-cache\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.205872 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.205719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-home\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.205872 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.205772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc8gd\" (UniqueName: \"kubernetes.io/projected/e760374e-90a6-4cda-91e4-d579ab195bae-kube-api-access-cc8gd\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.205872 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.205819 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-dshm\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.205872 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.205847 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e760374e-90a6-4cda-91e4-d579ab195bae-tls-certs\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.307320 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.307279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-dshm\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.307320 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.307330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e760374e-90a6-4cda-91e4-d579ab195bae-tls-certs\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.307637 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.307387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-tmp-dir\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.307637 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.307406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-model-cache\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.307637 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.307429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-home\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.307637 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.307542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc8gd\" (UniqueName: \"kubernetes.io/projected/e760374e-90a6-4cda-91e4-d579ab195bae-kube-api-access-cc8gd\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.307861 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.307825 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-model-cache\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.307905 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.307861 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-tmp-dir\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.307955 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.307909 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-home\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.309688 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.309665 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-dshm\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.309857 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.309839 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e760374e-90a6-4cda-91e4-d579ab195bae-tls-certs\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.323974 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.323948 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc8gd\" (UniqueName: \"kubernetes.io/projected/e760374e-90a6-4cda-91e4-d579ab195bae-kube-api-access-cc8gd\") pod \"rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.430518 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.430400 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:25.567740 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:25.567716 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz"] Jul 06 23:02:25.570171 ip-10-0-130-224 kubenswrapper[2564]: W0706 23:02:25.570143 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode760374e_90a6_4cda_91e4_d579ab195bae.slice/crio-bf5e901f361af1252df859b99c446ebc4f5960e9e2aa1bfb9be9c2712fb49b93 WatchSource:0}: Error finding container bf5e901f361af1252df859b99c446ebc4f5960e9e2aa1bfb9be9c2712fb49b93: Status 404 returned error can't find the container with id bf5e901f361af1252df859b99c446ebc4f5960e9e2aa1bfb9be9c2712fb49b93 Jul 06 23:02:26.244321 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:26.244283 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" event={"ID":"e760374e-90a6-4cda-91e4-d579ab195bae","Type":"ContainerStarted","Data":"5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487"} Jul 06 23:02:26.244321 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:26.244327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" event={"ID":"e760374e-90a6-4cda-91e4-d579ab195bae","Type":"ContainerStarted","Data":"bf5e901f361af1252df859b99c446ebc4f5960e9e2aa1bfb9be9c2712fb49b93"} Jul 06 23:02:26.264068 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:26.264021 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" podStartSLOduration=1.264006464 podStartE2EDuration="1.264006464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:02:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:02:26.262851447 +0000 UTC m=+2313.656445293" watchObservedRunningTime="2026-07-06 23:02:26.264006464 +0000 UTC m=+2313.657600275" Jul 06 23:02:29.547904 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:29.547870 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 23:02:35.430892 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:35.430860 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:35.431277 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:35.430908 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:35.443507 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:35.443459 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:36.305145 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:36.305115 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:02:58.031271 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:02:58.031230 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 23:03:12.827570 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:12.827526 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 23:03:21.013581 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:21.013550 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz"] Jul 06 23:03:26.025600 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:26.025562 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 23:03:36.033541 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.033479 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" podUID="e760374e-90a6-4cda-91e4-d579ab195bae" containerName="main" containerID="cri-o://5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487" gracePeriod=45 Jul 06 23:03:36.292763 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.292711 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:03:36.419705 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.419672 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-model-cache\") pod \"e760374e-90a6-4cda-91e4-d579ab195bae\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " Jul 06 23:03:36.419905 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.419738 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-tmp-dir\") pod \"e760374e-90a6-4cda-91e4-d579ab195bae\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " Jul 06 23:03:36.419905 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.419775 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e760374e-90a6-4cda-91e4-d579ab195bae-tls-certs\") pod \"e760374e-90a6-4cda-91e4-d579ab195bae\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " Jul 06 23:03:36.419905 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.419814 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-home\") pod \"e760374e-90a6-4cda-91e4-d579ab195bae\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " Jul 06 23:03:36.419905 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.419833 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-dshm\") pod \"e760374e-90a6-4cda-91e4-d579ab195bae\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " Jul 06 23:03:36.419905 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.419867 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc8gd\" (UniqueName: \"kubernetes.io/projected/e760374e-90a6-4cda-91e4-d579ab195bae-kube-api-access-cc8gd\") pod \"e760374e-90a6-4cda-91e4-d579ab195bae\" (UID: \"e760374e-90a6-4cda-91e4-d579ab195bae\") " Jul 06 23:03:36.420143 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.420023 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e760374e-90a6-4cda-91e4-d579ab195bae" (UID: "e760374e-90a6-4cda-91e4-d579ab195bae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:03:36.420143 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.420017 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-model-cache" (OuterVolumeSpecName: "model-cache") pod "e760374e-90a6-4cda-91e4-d579ab195bae" (UID: "e760374e-90a6-4cda-91e4-d579ab195bae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:03:36.420143 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.420057 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-home" (OuterVolumeSpecName: "home") pod "e760374e-90a6-4cda-91e4-d579ab195bae" (UID: "e760374e-90a6-4cda-91e4-d579ab195bae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:03:36.422253 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.422225 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e760374e-90a6-4cda-91e4-d579ab195bae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e760374e-90a6-4cda-91e4-d579ab195bae" (UID: "e760374e-90a6-4cda-91e4-d579ab195bae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 23:03:36.422253 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.422239 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-dshm" (OuterVolumeSpecName: "dshm") pod "e760374e-90a6-4cda-91e4-d579ab195bae" (UID: "e760374e-90a6-4cda-91e4-d579ab195bae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:03:36.422445 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.422257 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e760374e-90a6-4cda-91e4-d579ab195bae-kube-api-access-cc8gd" (OuterVolumeSpecName: "kube-api-access-cc8gd") pod "e760374e-90a6-4cda-91e4-d579ab195bae" (UID: "e760374e-90a6-4cda-91e4-d579ab195bae"). InnerVolumeSpecName "kube-api-access-cc8gd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:03:36.520561 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.520521 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-home\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:03:36.520561 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.520558 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-dshm\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:03:36.520561 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.520568 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc8gd\" (UniqueName: \"kubernetes.io/projected/e760374e-90a6-4cda-91e4-d579ab195bae-kube-api-access-cc8gd\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:03:36.520561 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.520577 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-model-cache\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:03:36.520821 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.520585 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e760374e-90a6-4cda-91e4-d579ab195bae-tmp-dir\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:03:36.520821 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.520594 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e760374e-90a6-4cda-91e4-d579ab195bae-tls-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:03:36.596744 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.596712 2564 generic.go:356] "Generic (PLEG): container finished" podID="e760374e-90a6-4cda-91e4-d579ab195bae" containerID="5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487" exitCode=0 Jul 06 23:03:36.596880 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.596750 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" Jul 06 23:03:36.596880 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.596771 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" event={"ID":"e760374e-90a6-4cda-91e4-d579ab195bae","Type":"ContainerDied","Data":"5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487"} Jul 06 23:03:36.596880 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.596812 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz" event={"ID":"e760374e-90a6-4cda-91e4-d579ab195bae","Type":"ContainerDied","Data":"bf5e901f361af1252df859b99c446ebc4f5960e9e2aa1bfb9be9c2712fb49b93"} Jul 06 23:03:36.596880 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.596834 2564 scope.go:117] "RemoveContainer" containerID="5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487" Jul 06 23:03:36.606161 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.606146 2564 scope.go:117] "RemoveContainer" containerID="5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487" Jul 06 23:03:36.606406 ip-10-0-130-224 kubenswrapper[2564]: E0706 23:03:36.606388 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487\": container with ID starting with 5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487 not found: ID does not exist" containerID="5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487" Jul 06 23:03:36.606454 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.606414 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487"} err="failed to get container status \"5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487\": rpc error: code = NotFound desc = could not find container \"5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487\": container with ID starting with 5ddec88ff78df0b88bb4e2805b9a6aeab2249cba0500e761e39b3fddabc19487 not found: ID does not exist" Jul 06 23:03:36.618662 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.618640 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz"] Jul 06 23:03:36.622249 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:36.622229 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-cf2b54/rate-test-model-cf2b54-kserve-69b84f9f8c-w77hz"] Jul 06 23:03:37.043890 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:37.043813 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e760374e-90a6-4cda-91e4-d579ab195bae" path="/var/lib/kubelet/pods/e760374e-90a6-4cda-91e4-d579ab195bae/volumes" Jul 06 23:03:53.418953 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:53.418917 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 23:03:53.422528 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:53.422507 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 23:03:53.423983 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:53.423963 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 23:03:53.427371 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:03:53.427354 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x264m_2b989f2d-90f8-4c31-b5c8-48815d1bd60a/ovn-acl-logging/0.log" Jul 06 23:04:04.811213 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:04.811174 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp"] Jul 06 23:04:04.811854 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:04.811423 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" podUID="8210f79c-df54-4251-9215-4d172196e24f" containerName="istio-proxy" containerID="cri-o://89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091" gracePeriod=30 Jul 06 23:04:07.835107 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:07.835072 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsfmh"] Jul 06 23:04:10.062680 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.062656 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 23:04:10.096149 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096124 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8210f79c-df54-4251-9215-4d172196e24f-istio-podinfo\") pod \"8210f79c-df54-4251-9215-4d172196e24f\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " Jul 06 23:04:10.096305 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096158 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8210f79c-df54-4251-9215-4d172196e24f-istiod-ca-cert\") pod \"8210f79c-df54-4251-9215-4d172196e24f\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " Jul 06 23:04:10.096305 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096183 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8210f79c-df54-4251-9215-4d172196e24f-istio-token\") pod \"8210f79c-df54-4251-9215-4d172196e24f\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " Jul 06 23:04:10.096305 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096200 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bjxv\" (UniqueName: \"kubernetes.io/projected/8210f79c-df54-4251-9215-4d172196e24f-kube-api-access-5bjxv\") pod \"8210f79c-df54-4251-9215-4d172196e24f\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " Jul 06 23:04:10.096305 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096234 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-workload-socket\") pod \"8210f79c-df54-4251-9215-4d172196e24f\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " Jul 06 23:04:10.096305 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096262 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-istio-data\") pod \"8210f79c-df54-4251-9215-4d172196e24f\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " Jul 06 23:04:10.096613 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096315 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-istio-envoy\") pod \"8210f79c-df54-4251-9215-4d172196e24f\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " Jul 06 23:04:10.096613 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096342 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-workload-certs\") pod \"8210f79c-df54-4251-9215-4d172196e24f\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " Jul 06 23:04:10.096613 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096390 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-credential-socket\") pod \"8210f79c-df54-4251-9215-4d172196e24f\" (UID: \"8210f79c-df54-4251-9215-4d172196e24f\") " Jul 06 23:04:10.096613 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096510 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8210f79c-df54-4251-9215-4d172196e24f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8210f79c-df54-4251-9215-4d172196e24f" (UID: "8210f79c-df54-4251-9215-4d172196e24f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:04:10.096613 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096562 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8210f79c-df54-4251-9215-4d172196e24f" (UID: "8210f79c-df54-4251-9215-4d172196e24f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:04:10.096948 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096702 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8210f79c-df54-4251-9215-4d172196e24f-istiod-ca-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:10.096948 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096729 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-workload-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:10.096948 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096833 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8210f79c-df54-4251-9215-4d172196e24f" (UID: "8210f79c-df54-4251-9215-4d172196e24f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:04:10.096948 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.096940 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8210f79c-df54-4251-9215-4d172196e24f" (UID: "8210f79c-df54-4251-9215-4d172196e24f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:04:10.097647 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.097620 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-istio-data" (OuterVolumeSpecName: "istio-data") pod "8210f79c-df54-4251-9215-4d172196e24f" (UID: "8210f79c-df54-4251-9215-4d172196e24f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:04:10.098553 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.098515 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8210f79c-df54-4251-9215-4d172196e24f-istio-token" (OuterVolumeSpecName: "istio-token") pod "8210f79c-df54-4251-9215-4d172196e24f" (UID: "8210f79c-df54-4251-9215-4d172196e24f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:04:10.098821 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.098794 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8210f79c-df54-4251-9215-4d172196e24f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8210f79c-df54-4251-9215-4d172196e24f" (UID: "8210f79c-df54-4251-9215-4d172196e24f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 23:04:10.098932 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.098896 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8210f79c-df54-4251-9215-4d172196e24f-kube-api-access-5bjxv" (OuterVolumeSpecName: "kube-api-access-5bjxv") pod "8210f79c-df54-4251-9215-4d172196e24f" (UID: "8210f79c-df54-4251-9215-4d172196e24f"). InnerVolumeSpecName "kube-api-access-5bjxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:04:10.098932 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.098919 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8210f79c-df54-4251-9215-4d172196e24f" (UID: "8210f79c-df54-4251-9215-4d172196e24f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:04:10.197960 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.197918 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-workload-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:10.197960 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.197952 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-credential-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:10.197960 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.197962 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8210f79c-df54-4251-9215-4d172196e24f-istio-podinfo\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:10.198193 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.197971 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8210f79c-df54-4251-9215-4d172196e24f-istio-token\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:10.198193 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.197980 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bjxv\" (UniqueName: \"kubernetes.io/projected/8210f79c-df54-4251-9215-4d172196e24f-kube-api-access-5bjxv\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:10.198193 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.197989 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-istio-data\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:10.198193 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.197997 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8210f79c-df54-4251-9215-4d172196e24f-istio-envoy\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:10.764458 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.764422 2564 generic.go:356] "Generic (PLEG): container finished" podID="8210f79c-df54-4251-9215-4d172196e24f" containerID="89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091" exitCode=0 Jul 06 23:04:10.764683 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.764470 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" Jul 06 23:04:10.764683 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.764471 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" event={"ID":"8210f79c-df54-4251-9215-4d172196e24f","Type":"ContainerDied","Data":"89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091"} Jul 06 23:04:10.764683 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.764560 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp" event={"ID":"8210f79c-df54-4251-9215-4d172196e24f","Type":"ContainerDied","Data":"04a41c7c2bf5cc071bc15b792c6012181a6aac3ab8986f574807a03fffebdb23"} Jul 06 23:04:10.764683 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.764590 2564 scope.go:117] "RemoveContainer" containerID="89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091" Jul 06 23:04:10.773989 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.773974 2564 scope.go:117] "RemoveContainer" containerID="d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4" Jul 06 23:04:10.782392 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.782376 2564 scope.go:117] "RemoveContainer" containerID="89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091" Jul 06 23:04:10.782647 ip-10-0-130-224 kubenswrapper[2564]: E0706 23:04:10.782630 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091\": container with ID starting with 89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091 not found: ID does not exist" containerID="89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091" Jul 06 23:04:10.782702 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.782654 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091"} err="failed to get container status \"89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091\": rpc error: code = NotFound desc = could not find container \"89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091\": container with ID starting with 89f8d5aa225735e6344855e45c5dc5db2923926afa79218e3761c771560fe091 not found: ID does not exist" Jul 06 23:04:10.782702 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.782668 2564 scope.go:117] "RemoveContainer" containerID="d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4" Jul 06 23:04:10.782867 ip-10-0-130-224 kubenswrapper[2564]: E0706 23:04:10.782851 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4\": container with ID starting with d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4 not found: ID does not exist" containerID="d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4" Jul 06 23:04:10.782904 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.782870 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4"} err="failed to get container status \"d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4\": rpc error: code = NotFound desc = could not find container \"d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4\": container with ID starting with d00cad30de32a4f43eb716ede71d205fdde92b6da8891ed915247cae9cf411d4 not found: ID does not exist" Jul 06 23:04:10.786048 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.786025 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp"] Jul 06 23:04:10.790101 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:10.790083 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-936b5d-openshift-default-6cc64dcc79-7z2hp"] Jul 06 23:04:11.042976 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:11.042898 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8210f79c-df54-4251-9215-4d172196e24f" path="/var/lib/kubelet/pods/8210f79c-df54-4251-9215-4d172196e24f/volumes" Jul 06 23:04:11.885773 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:11.885733 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb"] Jul 06 23:04:11.886182 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:11.885953 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerName="istio-proxy" containerID="cri-o://34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773" gracePeriod=30 Jul 06 23:04:11.899927 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:11.899898 2564 patch_prober.go:28] interesting pod/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 23:04:11.900050 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:11.899974 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 23:04:17.144225 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.144196 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 23:04:17.147363 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.147321 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-data\") pod \"46f26bed-fecd-4312-bbcd-18615156dbc0\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " Jul 06 23:04:17.147363 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.147350 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2gwm\" (UniqueName: \"kubernetes.io/projected/46f26bed-fecd-4312-bbcd-18615156dbc0-kube-api-access-z2gwm\") pod \"46f26bed-fecd-4312-bbcd-18615156dbc0\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " Jul 06 23:04:17.147554 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.147462 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-podinfo\") pod \"46f26bed-fecd-4312-bbcd-18615156dbc0\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " Jul 06 23:04:17.147686 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.147592 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-workload-socket\") pod \"46f26bed-fecd-4312-bbcd-18615156dbc0\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " Jul 06 23:04:17.147686 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.147622 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-token\") pod \"46f26bed-fecd-4312-bbcd-18615156dbc0\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " Jul 06 23:04:17.147686 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.147671 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-workload-certs\") pod \"46f26bed-fecd-4312-bbcd-18615156dbc0\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " Jul 06 23:04:17.147857 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.147697 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f26bed-fecd-4312-bbcd-18615156dbc0-istiod-ca-cert\") pod \"46f26bed-fecd-4312-bbcd-18615156dbc0\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " Jul 06 23:04:17.147857 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.147740 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-envoy\") pod \"46f26bed-fecd-4312-bbcd-18615156dbc0\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " Jul 06 23:04:17.147857 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.147764 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-credential-socket\") pod \"46f26bed-fecd-4312-bbcd-18615156dbc0\" (UID: \"46f26bed-fecd-4312-bbcd-18615156dbc0\") " Jul 06 23:04:17.148023 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.147871 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "46f26bed-fecd-4312-bbcd-18615156dbc0" (UID: "46f26bed-fecd-4312-bbcd-18615156dbc0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:04:17.148023 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.147883 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "46f26bed-fecd-4312-bbcd-18615156dbc0" (UID: "46f26bed-fecd-4312-bbcd-18615156dbc0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:04:17.148023 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.148007 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-workload-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:17.148023 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.148023 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-workload-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:17.148224 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.148076 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "46f26bed-fecd-4312-bbcd-18615156dbc0" (UID: "46f26bed-fecd-4312-bbcd-18615156dbc0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:04:17.148224 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.148123 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f26bed-fecd-4312-bbcd-18615156dbc0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "46f26bed-fecd-4312-bbcd-18615156dbc0" (UID: "46f26bed-fecd-4312-bbcd-18615156dbc0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:04:17.148300 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.148282 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-data" (OuterVolumeSpecName: "istio-data") pod "46f26bed-fecd-4312-bbcd-18615156dbc0" (UID: "46f26bed-fecd-4312-bbcd-18615156dbc0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:04:17.149800 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.149778 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "46f26bed-fecd-4312-bbcd-18615156dbc0" (UID: "46f26bed-fecd-4312-bbcd-18615156dbc0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:04:17.149979 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.149963 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46f26bed-fecd-4312-bbcd-18615156dbc0-kube-api-access-z2gwm" (OuterVolumeSpecName: "kube-api-access-z2gwm") pod "46f26bed-fecd-4312-bbcd-18615156dbc0" (UID: "46f26bed-fecd-4312-bbcd-18615156dbc0"). InnerVolumeSpecName "kube-api-access-z2gwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:04:17.150093 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.150067 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "46f26bed-fecd-4312-bbcd-18615156dbc0" (UID: "46f26bed-fecd-4312-bbcd-18615156dbc0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 23:04:17.150132 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.150086 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-token" (OuterVolumeSpecName: "istio-token") pod "46f26bed-fecd-4312-bbcd-18615156dbc0" (UID: "46f26bed-fecd-4312-bbcd-18615156dbc0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:04:17.248410 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.248375 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-data\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:17.248410 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.248404 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2gwm\" (UniqueName: \"kubernetes.io/projected/46f26bed-fecd-4312-bbcd-18615156dbc0-kube-api-access-z2gwm\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:17.248410 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.248415 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-podinfo\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:17.248671 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.248423 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-token\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:17.248671 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.248431 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46f26bed-fecd-4312-bbcd-18615156dbc0-istiod-ca-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:17.248671 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.248439 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-istio-envoy\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:17.248671 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.248447 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46f26bed-fecd-4312-bbcd-18615156dbc0-credential-socket\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\"" Jul 06 23:04:17.801138 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.801102 2564 generic.go:356] "Generic (PLEG): container finished" podID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerID="34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773" exitCode=0 Jul 06 23:04:17.801320 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.801149 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" Jul 06 23:04:17.801320 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.801178 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" event={"ID":"46f26bed-fecd-4312-bbcd-18615156dbc0","Type":"ContainerDied","Data":"34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773"} Jul 06 23:04:17.801320 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.801227 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb" event={"ID":"46f26bed-fecd-4312-bbcd-18615156dbc0","Type":"ContainerDied","Data":"3c0eba31c94d8e5c151e88d509ddf7c9f5a5b015c12bdc1286bf961d0d0bf939"} Jul 06 23:04:17.801320 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.801247 2564 scope.go:117] "RemoveContainer" containerID="34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773" Jul 06 23:04:17.810312 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.810296 2564 scope.go:117] "RemoveContainer" containerID="068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7" Jul 06 23:04:17.817968 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.817952 2564 scope.go:117] "RemoveContainer" containerID="34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773" Jul 06 23:04:17.818197 ip-10-0-130-224 kubenswrapper[2564]: E0706 23:04:17.818177 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773\": container with ID starting with 34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773 not found: ID does not exist" containerID="34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773" Jul 06 23:04:17.818258 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.818205 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773"} err="failed to get container status \"34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773\": rpc error: code = NotFound desc = could not find container \"34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773\": container with ID starting with 34de4b854267bc10af10ec9057e313bbf82f9db4647caa5c5117ff3aed097773 not found: ID does not exist" Jul 06 23:04:17.818258 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.818221 2564 scope.go:117] "RemoveContainer" containerID="068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7" Jul 06 23:04:17.818461 ip-10-0-130-224 kubenswrapper[2564]: E0706 23:04:17.818445 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7\": container with ID starting with 068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7 not found: ID does not exist" containerID="068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7" Jul 06 23:04:17.818582 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.818466 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7"} err="failed to get container status \"068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7\": rpc error: code = NotFound desc = could not find container \"068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7\": container with ID starting with 068a04165ee229d70e380136b31fbff99a1a163ee15d570fd3552ba6cdd368f7 not found: ID does not exist" Jul 06 23:04:17.822882 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.822862 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb"] Jul 06 23:04:17.826471 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:17.826450 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-cf2b54-openshift-default-7f58b545f-mbpzb"] Jul 06 23:04:18.034803 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:18.034778 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84b8787b6c-j294w_e9ea17c9-93ad-49f8-936f-59e27c59d4f6/copy-manifests/0.log" Jul 06 23:04:18.053767 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:18.053701 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84b8787b6c-j294w_e9ea17c9-93ad-49f8-936f-59e27c59d4f6/manager/0.log" Jul 06 23:04:19.034790 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.034762 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl_b389e69a-a456-446e-b0e1-a85e2cfb1fb3/util/0.log" Jul 06 23:04:19.042414 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.042388 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" path="/var/lib/kubelet/pods/46f26bed-fecd-4312-bbcd-18615156dbc0/volumes" Jul 06 23:04:19.047138 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.047112 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl_b389e69a-a456-446e-b0e1-a85e2cfb1fb3/pull/0.log" Jul 06 23:04:19.062606 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.062588 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl_b389e69a-a456-446e-b0e1-a85e2cfb1fb3/extract/0.log" Jul 06 23:04:19.174890 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.174862 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m_4236c2a0-0b42-45ab-abe6-3d15a9370af4/util/0.log" Jul 06 23:04:19.187101 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.187076 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m_4236c2a0-0b42-45ab-abe6-3d15a9370af4/pull/0.log" Jul 06 23:04:19.196820 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.196800 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m_4236c2a0-0b42-45ab-abe6-3d15a9370af4/extract/0.log" Jul 06 23:04:19.306029 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.305953 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9_bce170c5-6aa2-4993-8439-a29e63db725b/util/0.log" Jul 06 23:04:19.318035 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.318007 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9_bce170c5-6aa2-4993-8439-a29e63db725b/pull/0.log" Jul 06 23:04:19.326986 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.326962 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9_bce170c5-6aa2-4993-8439-a29e63db725b/extract/0.log" Jul 06 23:04:19.444994 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.444944 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk_d41efa55-2bf5-497d-8613-73369e6b26da/util/0.log" Jul 06 23:04:19.456928 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.456902 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk_d41efa55-2bf5-497d-8613-73369e6b26da/pull/0.log" Jul 06 23:04:19.468654 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:19.468630 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk_d41efa55-2bf5-497d-8613-73369e6b26da/extract/0.log" Jul 06 23:04:20.290452 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:20.290422 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jsfmh_2bf56612-f1e6-42f9-ae0a-270ebe5b9493/limitador/0.log" Jul 06 23:04:20.863126 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:20.863099 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-srqtm_af331e8b-3b06-479f-b926-2120fc547d8d/discovery/0.log" Jul 06 23:04:22.220615 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:22.220583 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvvmqv_1b8dd7e9-8e99-429f-8bdb-0c15c87799f6/main/0.log" Jul 06 23:04:29.433825 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:29.433789 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nfsqr_07d32136-31d7-4613-bef2-2d540719426b/global-pull-secret-syncer/0.log" Jul 06 23:04:29.666084 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:29.666052 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xsxb4_e0939ff7-a0de-41ba-a2e0-4a5961c4fb99/konnectivity-agent/0.log" Jul 06 23:04:29.686850 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:29.686782 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-224.ec2.internal_d7a0286b78fb561648d6188aef1e798d/haproxy/0.log" Jul 06 23:04:34.169097 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:34.169055 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl_b389e69a-a456-446e-b0e1-a85e2cfb1fb3/extract/0.log" Jul 06 23:04:34.191158 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:34.191135 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl_b389e69a-a456-446e-b0e1-a85e2cfb1fb3/util/0.log" Jul 06 23:04:34.212130 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:34.212107 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zngpl_b389e69a-a456-446e-b0e1-a85e2cfb1fb3/pull/0.log" Jul 06 23:04:34.243204 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:34.243182 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m_4236c2a0-0b42-45ab-abe6-3d15a9370af4/extract/0.log" Jul 06 23:04:34.269102 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:34.269076 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m_4236c2a0-0b42-45ab-abe6-3d15a9370af4/util/0.log" Jul 06 23:04:34.290138 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:34.290108 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4r7m_4236c2a0-0b42-45ab-abe6-3d15a9370af4/pull/0.log" Jul 06 23:04:34.323849 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:34.323798 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9_bce170c5-6aa2-4993-8439-a29e63db725b/extract/0.log" Jul 06 23:04:34.351643 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:34.351621 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9_bce170c5-6aa2-4993-8439-a29e63db725b/util/0.log" Jul 06 23:04:34.375472 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:34.375448 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372zb9_bce170c5-6aa2-4993-8439-a29e63db725b/pull/0.log" Jul 06 23:04:34.406208 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:34.406182 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk_d41efa55-2bf5-497d-8613-73369e6b26da/extract/0.log" Jul 06 23:04:34.429567 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:34.429510 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk_d41efa55-2bf5-497d-8613-73369e6b26da/util/0.log" Jul 06 23:04:34.456091 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:34.456066 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19hwnk_d41efa55-2bf5-497d-8613-73369e6b26da/pull/0.log" Jul 06 23:04:35.091416 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:35.091390 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jsfmh_2bf56612-f1e6-42f9-ae0a-270ebe5b9493/limitador/0.log" Jul 06 23:04:37.264358 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:37.264328 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-qm426_ad820355-d3fd-40bc-9cfc-ecf47498df29/cluster-monitoring-operator/0.log" Jul 06 23:04:37.394769 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:37.394737 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-5x4n7_1c423f82-8cf7-433f-99fc-31db7a423594/monitoring-plugin/0.log" Jul 06 23:04:37.515524 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:37.515480 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mvthp_4ddf5def-02a2-4cfa-844a-94f7dfb3c624/node-exporter/0.log" Jul 06 23:04:37.538009 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:37.537983 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mvthp_4ddf5def-02a2-4cfa-844a-94f7dfb3c624/kube-rbac-proxy/0.log" Jul 06 23:04:37.561539 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:37.561516 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mvthp_4ddf5def-02a2-4cfa-844a-94f7dfb3c624/init-textfile/0.log" Jul 06 23:04:39.511903 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:39.511860 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-6npjm_478ad560-6302-497f-980d-8e920eebab4e/networking-console-plugin/0.log" Jul 06 23:04:40.102737 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.102687 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/1.log" Jul 06 23:04:40.111976 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.111948 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-4gsbp_b83d6b8c-5f51-4021-b340-da7ae99d4a46/console-operator/2.log" Jul 06 23:04:40.250377 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250343 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf"] Jul 06 23:04:40.250668 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250655 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8210f79c-df54-4251-9215-4d172196e24f" containerName="istio-proxy" Jul 06 23:04:40.250723 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250670 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8210f79c-df54-4251-9215-4d172196e24f" containerName="istio-proxy" Jul 06 23:04:40.250723 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250693 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerName="istio-proxy" Jul 06 23:04:40.250723 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250698 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerName="istio-proxy" Jul 06 23:04:40.250723 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250709 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerName="istio-proxy" Jul 06 23:04:40.250723 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250715 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerName="istio-proxy" Jul 06 23:04:40.250723 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250724 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e760374e-90a6-4cda-91e4-d579ab195bae" containerName="main" Jul 06 23:04:40.250949 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250730 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e760374e-90a6-4cda-91e4-d579ab195bae" containerName="main" Jul 06 23:04:40.250949 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250779 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerName="istio-proxy" Jul 06 23:04:40.250949 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250785 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="46f26bed-fecd-4312-bbcd-18615156dbc0" containerName="istio-proxy" Jul 06 23:04:40.250949 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250793 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8210f79c-df54-4251-9215-4d172196e24f" containerName="istio-proxy" Jul 06 23:04:40.250949 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.250799 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e760374e-90a6-4cda-91e4-d579ab195bae" containerName="main" Jul 06 23:04:40.253832 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.253811 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.256535 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.256518 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-768zc\"/\"openshift-service-ca.crt\"" Jul 06 23:04:40.256637 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.256552 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-768zc\"/\"kube-root-ca.crt\"" Jul 06 23:04:40.257745 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.257731 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-768zc\"/\"default-dockercfg-ks99f\"" Jul 06 23:04:40.265568 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.265548 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf"] Jul 06 23:04:40.334003 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.333968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-proc\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.334218 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.334019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-podres\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.334218 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.334095 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-lib-modules\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.334218 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.334138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntll4\" (UniqueName: \"kubernetes.io/projected/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-kube-api-access-ntll4\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.334218 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.334171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-sys\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.435015 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.434927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntll4\" (UniqueName: \"kubernetes.io/projected/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-kube-api-access-ntll4\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.435015 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.434968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-sys\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.435249 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.435036 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-sys\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.435249 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.435082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-proc\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.435249 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.435136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-podres\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.435249 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.435171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-lib-modules\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.435249 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.435196 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-proc\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.435420 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.435288 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-podres\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.435420 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.435301 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-lib-modules\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.442794 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.442764 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntll4\" (UniqueName: \"kubernetes.io/projected/79c956c8-a2ae-4662-a3d4-d1d8fc358c02-kube-api-access-ntll4\") pod \"perf-node-gather-daemonset-pg8pf\" (UID: \"79c956c8-a2ae-4662-a3d4-d1d8fc358c02\") " pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.564275 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.564217 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.687838 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.687815 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf"] Jul 06 23:04:40.689960 ip-10-0-130-224 kubenswrapper[2564]: W0706 23:04:40.689937 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod79c956c8_a2ae_4662_a3d4_d1d8fc358c02.slice/crio-0f8efec6038612f9e486c797804359b59e2c5343c59531dc672c37aeaa57fce1 WatchSource:0}: Error finding container 0f8efec6038612f9e486c797804359b59e2c5343c59531dc672c37aeaa57fce1: Status 404 returned error can't find the container with id 0f8efec6038612f9e486c797804359b59e2c5343c59531dc672c37aeaa57fce1 Jul 06 23:04:40.775760 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.775734 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-q7fbr_e7d80c93-4f99-459b-9532-4255c1a8edc0/download-server/0.log" Jul 06 23:04:40.910331 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.910293 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" event={"ID":"79c956c8-a2ae-4662-a3d4-d1d8fc358c02","Type":"ContainerStarted","Data":"7d5780b21f32085f5eeec917faf77cd74a254ef9cdf10f10f668068d017161af"} Jul 06 23:04:40.910543 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.910342 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" event={"ID":"79c956c8-a2ae-4662-a3d4-d1d8fc358c02","Type":"ContainerStarted","Data":"0f8efec6038612f9e486c797804359b59e2c5343c59531dc672c37aeaa57fce1"} Jul 06 23:04:40.910543 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.910377 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:40.925206 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:40.925161 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" podStartSLOduration=0.925145733 podStartE2EDuration="925.145733ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:04:40.924479446 +0000 UTC m=+2448.318073259" watchObservedRunningTime="2026-07-06 23:04:40.925145733 +0000 UTC m=+2448.318739544" Jul 06 23:04:42.521761 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:42.521735 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s66th_3559f127-6a66-4abe-a961-a3da19ef7568/dns/0.log" Jul 06 23:04:42.542250 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:42.542219 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s66th_3559f127-6a66-4abe-a961-a3da19ef7568/kube-rbac-proxy/0.log" Jul 06 23:04:42.565400 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:42.565368 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lvssm_f2b1dbbd-9d6a-4745-a6c7-3bb0da589a05/dns-node-resolver/0.log" Jul 06 23:04:43.245576 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:43.245542 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xrgz2_8d87f6ba-b8cc-4b54-8aa8-dd695ae097a8/node-ca/0.log" Jul 06 23:04:44.432024 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:44.431992 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-srqtm_af331e8b-3b06-479f-b926-2120fc547d8d/discovery/0.log" Jul 06 23:04:45.528333 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:45.528300 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w7ps6_7a500ff8-c870-462b-b137-4eeaa777a1db/serve-healthcheck-canary/0.log" Jul 06 23:04:46.017162 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:46.017125 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-zqfpb_fa5ba8dd-b8b9-411b-b61b-eefe3718030e/insights-operator/0.log" Jul 06 23:04:46.017577 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:46.017555 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-zqfpb_fa5ba8dd-b8b9-411b-b61b-eefe3718030e/insights-operator/1.log" Jul 06 23:04:46.106707 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:46.106676 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjtvh_49a462cf-b293-4f41-bb42-a3ed6f6366d8/kube-rbac-proxy/0.log" Jul 06 23:04:46.127358 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:46.127326 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjtvh_49a462cf-b293-4f41-bb42-a3ed6f6366d8/exporter/0.log" Jul 06 23:04:46.148533 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:46.148506 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cjtvh_49a462cf-b293-4f41-bb42-a3ed6f6366d8/extractor/0.log" Jul 06 23:04:46.924354 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:46.924331 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-768zc/perf-node-gather-daemonset-pg8pf" Jul 06 23:04:49.198703 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:49.198623 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84b8787b6c-j294w_e9ea17c9-93ad-49f8-936f-59e27c59d4f6/manager/0.log" Jul 06 23:04:49.220002 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:49.219978 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84b8787b6c-j294w_e9ea17c9-93ad-49f8-936f-59e27c59d4f6/copy-manifests/0.log" Jul 06 23:04:50.795829 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:50.795756 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69b75b5694-hthdt_aedc9a01-0271-48c2-aabd-682be20862dd/manager/0.log" Jul 06 23:04:51.108317 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:51.108288 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-srqtm_af331e8b-3b06-479f-b926-2120fc547d8d/discovery/0.log" Jul 06 23:04:52.728802 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:52.728772 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-srqtm_af331e8b-3b06-479f-b926-2120fc547d8d/discovery/0.log" Jul 06 23:04:55.971477 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:55.971445 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-pb59v_366fbf4a-d6ce-48f7-be59-ac5e2a7e08dc/migrator/0.log" Jul 06 23:04:55.991765 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:55.991742 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-pb59v_366fbf4a-d6ce-48f7-be59-ac5e2a7e08dc/graceful-termination/0.log" Jul 06 23:04:56.363586 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:56.363554 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-bk9q6_52941bfe-7acf-49aa-8678-07377455f1a7/kube-storage-version-migrator-operator/1.log" Jul 06 23:04:56.365080 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:56.365056 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-bk9q6_52941bfe-7acf-49aa-8678-07377455f1a7/kube-storage-version-migrator-operator/0.log" Jul 06 23:04:57.401593 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:57.401563 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gw9t5_f68bc160-fd3d-40f8-98d1-f05505d4c7ef/kube-multus-additional-cni-plugins/0.log" Jul 06 23:04:57.422440 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:57.422407 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gw9t5_f68bc160-fd3d-40f8-98d1-f05505d4c7ef/egress-router-binary-copy/0.log" Jul 06 23:04:57.442773 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:57.442752 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gw9t5_f68bc160-fd3d-40f8-98d1-f05505d4c7ef/cni-plugins/0.log" Jul 06 23:04:57.463746 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:57.463723 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gw9t5_f68bc160-fd3d-40f8-98d1-f05505d4c7ef/bond-cni-plugin/0.log" Jul 06 23:04:57.484834 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:57.484810 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gw9t5_f68bc160-fd3d-40f8-98d1-f05505d4c7ef/routeoverride-cni/0.log" Jul 06 23:04:57.504857 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:57.504831 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gw9t5_f68bc160-fd3d-40f8-98d1-f05505d4c7ef/whereabouts-cni-bincopy/0.log" Jul 06 23:04:57.524772 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:57.524746 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gw9t5_f68bc160-fd3d-40f8-98d1-f05505d4c7ef/whereabouts-cni/0.log" Jul 06 23:04:57.890563 ip-10-0-130-224 kubenswrapper[2564]: I0706 23:04:57.890529 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fvftx_84e85955-5b73-4405-b97a-0d5e3f1544bd/kube-multus/0.log"