Jul 16 17:32:45.811219 ip-10-0-129-222 systemd[1]: Starting Kubernetes Kubelet... Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.137964 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141933 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141946 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141949 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141953 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141956 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141959 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141962 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:32:46.163465 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141965 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141968 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141970 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141973 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141976 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141978 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141981 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141984 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141987 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141990 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.141992 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142000 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142004 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142007 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142010 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142012 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142015 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142018 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142021 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142023 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:32:46.164342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142026 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142028 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142031 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142034 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142038 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142040 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142043 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142045 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142048 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142051 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142053 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142056 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142059 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142061 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142064 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142066 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142069 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142071 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142074 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:32:46.164881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142077 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142079 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142082 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142084 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142088 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142091 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142094 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142097 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142100 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142102 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142105 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142107 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142110 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142114 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142118 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142121 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142124 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142127 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142129 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142132 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:32:46.165411 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142135 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142137 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142140 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142142 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142145 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142148 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142150 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142153 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142155 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142159 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142161 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142164 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142169 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142172 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142176 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142179 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142182 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142185 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142188 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:32:46.166532 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142190 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142193 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142196 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142198 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142201 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142203 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142206 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142208 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142211 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142213 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142215 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142218 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142221 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142223 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142890 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142896 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142899 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142902 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142904 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142907 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:32:46.167107 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142909 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142912 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142914 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142917 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142920 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142922 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142925 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142928 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142931 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142934 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142937 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142940 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142944 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142947 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142950 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142952 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142955 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142957 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142960 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:32:46.262596 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142964 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:32:46.205336 ip-10-0-129-222 systemd[1]: Started Kubernetes Kubelet. Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142968 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142971 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142974 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142976 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142979 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142982 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142984 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142987 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142989 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142992 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142995 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.142998 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143001 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143004 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143006 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143009 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143011 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143014 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143017 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:32:46.263513 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143019 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143022 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143024 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143027 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143030 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143033 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143036 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143039 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143042 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143045 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143047 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143050 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143052 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143055 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143057 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143060 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143064 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143068 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143071 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:32:47.415139 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143074 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143078 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143080 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143083 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143086 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143089 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143091 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143094 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143097 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143099 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143102 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143104 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143108 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143111 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143114 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143117 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143122 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143124 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143127 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:32:47.415830 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143129 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143133 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143135 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143138 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143141 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143143 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143146 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143149 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143152 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143163 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143165 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143168 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143171 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143174 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143176 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143179 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143530 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143534 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143537 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143540 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:32:47.416485 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143543 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143545 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143548 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143550 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143553 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143555 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143558 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143561 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143563 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143566 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143569 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143571 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143578 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143582 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143586 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143589 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143592 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143594 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143597 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143600 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:32:47.417116 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143603 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143607 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143611 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143614 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143617 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143622 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143625 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143627 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143630 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143633 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143636 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143639 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143643 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143646 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143649 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143652 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143654 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143676 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143680 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143683 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:32:47.417697 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143685 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143688 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143691 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143693 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143697 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143700 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143703 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143705 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143709 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143712 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143714 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143717 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143719 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143722 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143724 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143726 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143729 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143733 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143735 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143738 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:32:47.418349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143741 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143743 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143746 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143748 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143751 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143753 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143756 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143759 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143761 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143765 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143767 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143770 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143772 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143775 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143777 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143780 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143784 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143787 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143789 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143792 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:32:47.418916 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143795 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143798 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143800 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143803 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143805 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143808 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143810 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143813 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143816 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143819 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143822 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143824 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143827 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143829 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.143832 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143919 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143926 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143932 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143937 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143940 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 17:32:47.419584 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143943 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143947 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143951 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143954 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143957 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143960 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143964 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143967 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143971 2577 flags.go:64] FLAG: --cgroup-root="" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143974 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143977 2577 flags.go:64] FLAG: --client-ca-file="" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143980 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143983 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143987 2577 flags.go:64] FLAG: --cluster-domain="" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143990 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143993 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143996 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.143999 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144003 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144006 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144009 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144013 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144016 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144019 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 17:32:47.420148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144022 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144025 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144028 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144032 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144035 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144038 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144041 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144044 2577 flags.go:64] FLAG: --enable-server="true" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144047 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144050 2577 flags.go:64] FLAG: --event-burst="100" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144053 2577 flags.go:64] FLAG: --event-qps="50" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144056 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144059 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144062 2577 flags.go:64] FLAG: --eviction-hard="" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144066 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144068 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144074 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144077 2577 flags.go:64] FLAG: --eviction-soft="" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144080 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144083 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144086 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144089 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144092 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144095 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144098 2577 flags.go:64] FLAG: --feature-gates="" Jul 16 17:32:47.420906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144101 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144105 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144108 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144111 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144115 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144118 2577 flags.go:64] FLAG: --help="false" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144121 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144124 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144127 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144130 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144133 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144136 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144139 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144142 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144148 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144151 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144154 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144157 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144160 2577 flags.go:64] FLAG: --kube-reserved="" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144163 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144166 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144169 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144172 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144176 2577 flags.go:64] FLAG: --lock-file="" Jul 16 17:32:47.421661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144178 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144181 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144184 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144189 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144193 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144196 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144199 2577 flags.go:64] FLAG: --logging-format="text" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144201 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144205 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144208 2577 flags.go:64] FLAG: --manifest-url="" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144210 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144214 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144218 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144222 2577 flags.go:64] FLAG: --max-pods="110" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144225 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144228 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144231 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144234 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144237 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144240 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144242 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144249 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144252 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144255 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 17:32:47.422451 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144258 2577 flags.go:64] FLAG: --pod-cidr="" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144261 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144266 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144269 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144272 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144275 2577 flags.go:64] FLAG: --port="10250" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144278 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144280 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-052bf20a42f832a02" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144285 2577 flags.go:64] FLAG: --qos-reserved="" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144288 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144291 2577 flags.go:64] FLAG: --register-node="true" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144294 2577 flags.go:64] FLAG: --register-with-taints="" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144297 2577 flags.go:64] FLAG: --registry-burst="10" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144300 2577 flags.go:64] FLAG: --registry-qps="5" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144303 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144306 2577 flags.go:64] FLAG: --reserved-memory="" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144310 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144313 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144316 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144319 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144323 2577 flags.go:64] FLAG: --runonce="false" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144326 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144329 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144331 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144334 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 17:32:47.423071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144337 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144340 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144343 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144346 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144348 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144351 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144354 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144357 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144360 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144362 2577 flags.go:64] FLAG: --system-cgroups="" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144365 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144370 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144373 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144375 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144379 2577 flags.go:64] FLAG: --tls-min-version="" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144383 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144386 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144388 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144391 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144394 2577 flags.go:64] FLAG: --v="2" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144397 2577 flags.go:64] FLAG: --version="false" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144401 2577 flags.go:64] FLAG: --vmodule="" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144405 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.144408 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 17:32:47.423910 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149794 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149928 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149933 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149936 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149939 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149942 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149945 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149948 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149951 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149954 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149959 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149963 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149966 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149969 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149972 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149975 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149978 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149981 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149984 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149987 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:32:47.424726 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149989 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149995 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.149998 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150003 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150008 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150011 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150015 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150018 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150021 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150024 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150027 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150030 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150033 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150037 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150041 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150044 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150046 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150049 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150052 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:32:47.425342 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150054 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150057 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150060 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150062 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150065 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150068 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150071 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150073 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150076 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150078 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150081 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150084 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150086 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150089 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150094 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150097 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150099 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150102 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150105 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150107 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:32:47.425953 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150110 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150113 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150116 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150119 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150121 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150124 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150126 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150129 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150132 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150135 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150137 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150140 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150142 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150145 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150148 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150150 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150153 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150155 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150158 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150161 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150163 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:32:47.426569 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150166 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150169 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150171 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150182 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150185 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150189 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150191 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150194 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150196 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150200 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150202 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150205 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150208 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150210 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150213 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150215 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150218 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150220 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:32:47.427400 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.150223 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.150228 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.156612 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.156628 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.157188 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.157195 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157252 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157257 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157260 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157263 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157266 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157269 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157272 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157275 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157277 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:32:47.427936 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157280 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157283 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157286 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157289 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157291 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157294 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157297 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157299 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157302 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157305 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157307 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157310 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157313 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157316 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157320 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157323 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157326 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157329 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157332 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157335 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:32:47.579100 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157337 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157340 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157343 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157345 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157348 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157350 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157353 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157356 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157358 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157361 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157363 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157366 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157369 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157374 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157377 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157380 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157383 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157387 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157391 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:32:47.600583 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157394 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157397 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157399 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157402 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157405 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157407 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157410 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157412 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157415 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157417 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157420 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157422 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157425 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157428 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157430 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157433 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157435 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157438 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157440 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157443 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:32:47.601133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157445 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157448 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157451 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157455 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157458 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157460 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157464 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157467 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157470 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157473 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157476 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157478 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157481 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157483 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157486 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157488 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157492 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157496 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157499 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:32:47.601739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157502 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157505 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157507 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157510 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157513 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157515 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157518 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157520 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157523 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157526 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157528 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157531 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.157536 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157648 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157652 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:32:47.602727 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157656 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157672 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157677 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157680 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157684 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157688 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157692 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157695 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157702 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157705 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157708 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157711 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157713 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157716 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157718 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157721 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157723 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157726 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157728 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:32:47.603418 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157731 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157734 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157737 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157739 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157742 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157744 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157746 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157749 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157751 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157754 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157756 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157759 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157762 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157764 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157767 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157771 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157774 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157777 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157780 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157782 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:32:47.604521 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157785 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157788 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157792 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157796 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157799 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157802 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157804 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157807 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157809 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157812 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157814 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157817 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157819 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157822 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157824 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157827 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157829 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157832 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157834 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:32:47.605397 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157837 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157840 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157842 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157845 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157847 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157851 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157853 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157856 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157860 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157862 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157868 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157871 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157874 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157876 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157879 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157882 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157884 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157887 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157890 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157892 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:32:47.606288 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157895 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157897 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157900 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157902 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157905 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157908 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157911 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157914 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157917 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157919 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157922 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157924 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157927 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157930 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157932 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157935 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157937 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157940 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:32:47.607174 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:46.157942 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:32:47.608048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.157947 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 17:32:47.608048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.158045 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 17:32:47.608048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.160726 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 17:32:47.608048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.161904 2577 server.go:1019] "Starting client certificate rotation" Jul 16 17:32:47.608048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.162010 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 17:32:47.608048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.162041 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 17:32:47.608048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.164025 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 17:32:47.608048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.165265 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 17:32:47.608048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.175477 2577 log.go:25] "Validated CRI v1 runtime API" Jul 16 17:32:47.608048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.177567 2577 log.go:25] "Validated CRI v1 image API" Jul 16 17:32:47.608048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.179706 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 17:32:47.608048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.183708 2577 fs.go:135] Filesystem UUIDs: map[156b0e23-f9e2-41c7-a242-a00ddb997758:/dev/nvme0n1p3 585de124-7ecc-43c7-919a-7f552842ea5e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 16 17:32:47.608707 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.183727 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 17:32:47.608924 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.189140 2577 manager.go:216] Machine: {Timestamp:2026-07-16 17:32:46.188169213 +0000 UTC m=+0.279293237 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100002 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f0f412fd9dc4b41910e44d457a065 SystemUUID:ec2f0f41-2fd9-dc4b-4191-0e44d457a065 BootID:0bb63093-da3e-4b95-974d-ad91cd4a2a24 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d2:ae:4e:5a:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d2:ae:4e:5a:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:e6:1c:31:70:0d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 17:32:47.608924 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.189238 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 17:32:47.608924 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.189319 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 17:32:47.608924 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.190146 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 17:32:47.608924 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.190170 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-222.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 17:32:47.608924 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.190787 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 17:32:47.608924 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.190796 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 17:32:47.608924 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.190804 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.191308 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.192519 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.196282 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.196409 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.196442 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.196454 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.196473 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.196485 2577 kubelet.go:398] "Adding apiserver pod source" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.196496 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.196672 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.196911 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.196931 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.198598 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200299 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200326 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200480 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200493 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200499 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200504 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200512 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200517 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200907 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200913 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200919 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200924 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200932 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.200941 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.201513 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.201519 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.204522 2577 server.go:1268] "Started kubelet" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.204594 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.204621 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.204680 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.205677 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.206925 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:46.213411 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.213676 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-222.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:46.213787 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 17:32:47.609589 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:46.214053 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:46.213825 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-222.ec2.internal.18c2d58435a4484b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-222.ec2.internal,UID:ip-10-0-129-222.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-222.ec2.internal,},FirstTimestamp:2026-07-16 17:32:46.204495947 +0000 UTC m=+0.295619971,LastTimestamp:2026-07-16 17:32:46.204495947 +0000 UTC m=+0.295619971,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-222.ec2.internal,}" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.216147 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.216165 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:46.216306 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.216683 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.216689 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.216706 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.216792 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.216805 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.216961 2577 factory.go:55] Registering systemd factory Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.216977 2577 factory.go:223] Registration of the systemd container factory successfully Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.217174 2577 factory.go:153] Registering CRI-O factory Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.217186 2577 factory.go:223] Registration of the crio container factory successfully Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.217229 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.217246 2577 factory.go:103] Registering Raw factory Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.217257 2577 manager.go:1196] Started watching for new ooms in manager Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.217628 2577 manager.go:349] Starting recovery of all containers Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:46.218095 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:46.218366 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.219066 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4t9z7" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.227497 2577 manager.go:354] Recovery completed Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.233819 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.237829 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4t9z7" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.238410 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.238434 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.238447 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.239054 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.239063 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.239074 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.239077 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.241470 2577 policy_none.go:49] "None policy: Start" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.241483 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.241495 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 17:32:47.611572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.243489 2577 policy_none.go:47] "Start" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.246927 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.246950 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:46.246960 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.429916 2577 manager.go:337] "Starting Device Plugin manager" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:47.429948 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.431177 2577 server.go:87] "Starting device plugin registration server" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.431571 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.431594 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.432143 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.432248 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.432273 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:47.433723 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:47.433855 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.532439 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.533371 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.533401 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.533411 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.533437 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.547781 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:47.547804 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-222.ec2.internal\": node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:47.568562 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.571124 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.572641 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.572683 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.572711 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:47.572752 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 17:32:47.613117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.574944 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:47.672760 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.672798 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal"] Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.672871 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.673843 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.673869 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.673879 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.676307 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.676429 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.676455 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.677036 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.677057 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.677069 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.677056 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.677196 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.677205 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.679278 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.679299 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.679965 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.679991 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.680006 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:47.706991 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-222.ec2.internal\" not found" node="ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:47.711378 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-222.ec2.internal\" not found" node="ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:47.773535 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.773609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e896dddf56678d2747fb67ea0c51e7c7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal\" (UID: \"e896dddf56678d2747fb67ea0c51e7c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.773648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e896dddf56678d2747fb67ea0c51e7c7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal\" (UID: \"e896dddf56678d2747fb67ea0c51e7c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.781149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.773671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad0da4cc9750f83a93b2d4592a26c80f-config\") pod \"kube-apiserver-proxy-ip-10-0-129-222.ec2.internal\" (UID: \"ad0da4cc9750f83a93b2d4592a26c80f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.927109 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:47.873751 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:47.927109 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.873806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e896dddf56678d2747fb67ea0c51e7c7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal\" (UID: \"e896dddf56678d2747fb67ea0c51e7c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.927109 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.873831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad0da4cc9750f83a93b2d4592a26c80f-config\") pod \"kube-apiserver-proxy-ip-10-0-129-222.ec2.internal\" (UID: \"ad0da4cc9750f83a93b2d4592a26c80f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.927109 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.873846 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e896dddf56678d2747fb67ea0c51e7c7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal\" (UID: \"e896dddf56678d2747fb67ea0c51e7c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.927109 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.873883 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e896dddf56678d2747fb67ea0c51e7c7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal\" (UID: \"e896dddf56678d2747fb67ea0c51e7c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.927109 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.873906 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e896dddf56678d2747fb67ea0c51e7c7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal\" (UID: \"e896dddf56678d2747fb67ea0c51e7c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 16 17:32:47.927109 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:47.873915 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad0da4cc9750f83a93b2d4592a26c80f-config\") pod \"kube-apiserver-proxy-ip-10-0-129-222.ec2.internal\" (UID: \"ad0da4cc9750f83a93b2d4592a26c80f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" Jul 16 17:32:48.036669 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:47.974111 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:48.036669 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.009322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 16 17:32:48.036669 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.014811 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" Jul 16 17:32:48.163040 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:48.074760 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:48.319825 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:48.175132 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:48.319825 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:48.275490 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:48.319825 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.312640 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 17:32:48.319825 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.312773 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 17:32:48.456397 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:48.375546 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:48.456397 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.397943 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 17:27:47 +0000 UTC" deadline="2028-03-14 10:11:32.854102825 +0000 UTC" Jul 16 17:32:48.456397 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.397964 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14560h38m44.456141887s" Jul 16 17:32:48.592465 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:48.476419 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:48.592465 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.552170 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:32:48.592465 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:48.582455 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-222.ec2.internal\" not found" Jul 16 17:32:48.722571 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.640750 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:32:48.722571 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.657017 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:32:48.722571 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.667727 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" Jul 16 17:32:48.722571 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:48.680015 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0da4cc9750f83a93b2d4592a26c80f.slice/crio-1616ae78df93e49307dd20ee184a32927064bde2e252cc1f920f873c75774881 WatchSource:0}: Error finding container 1616ae78df93e49307dd20ee184a32927064bde2e252cc1f920f873c75774881: Status 404 returned error can't find the container with id 1616ae78df93e49307dd20ee184a32927064bde2e252cc1f920f873c75774881 Jul 16 17:32:48.722571 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.680224 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 17:32:48.722571 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.680989 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" Jul 16 17:32:48.722571 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.688927 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:32:48.722571 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:48.692364 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 17:32:48.845809 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:48.741674 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode896dddf56678d2747fb67ea0c51e7c7.slice/crio-6dbeb5b6eeaf0667a2a9b158c22a9ea0ccb1f71a9eca2e804b23b9d3d9a8f5da WatchSource:0}: Error finding container 6dbeb5b6eeaf0667a2a9b158c22a9ea0ccb1f71a9eca2e804b23b9d3d9a8f5da: Status 404 returned error can't find the container with id 6dbeb5b6eeaf0667a2a9b158c22a9ea0ccb1f71a9eca2e804b23b9d3d9a8f5da Jul 16 17:32:49.348837 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.348642 2577 apiserver.go:52] "Watching apiserver" Jul 16 17:32:49.357595 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.357145 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 17:32:49.358959 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.358928 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-2chxv","openshift-multus/multus-tbhgf","openshift-multus/network-metrics-daemon-4vsmt","kube-system/global-pull-secret-syncer-p7p9n","openshift-cluster-node-tuning-operator/tuned-llg9s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal","openshift-network-diagnostics/network-check-target-rbrnn","openshift-network-operator/iptables-alerter-95bmx","openshift-ovn-kubernetes/ovnkube-node-sqlkj","kube-system/konnectivity-agent-hcmhf","kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm","openshift-dns/node-resolver-6tpzc","openshift-image-registry/node-ca-mxbdc"] Jul 16 17:32:49.361631 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.361564 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:32:49.361752 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:49.361660 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:32:49.363848 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.363641 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6tpzc" Jul 16 17:32:49.366571 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.366537 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:49.366705 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:49.366661 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:32:49.370357 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.367009 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jfrh9\"" Jul 16 17:32:49.370357 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.367108 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 17:32:49.370357 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.367540 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 17:32:49.370357 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.368026 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 17:32:49.370357 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.369074 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:49.370357 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:49.369161 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:32:49.371927 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.371903 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.374440 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.374418 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tjzhr\"" Jul 16 17:32:49.374946 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.374744 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:32:49.374946 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.374755 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 17:32:49.374946 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.374916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mxbdc" Jul 16 17:32:49.377058 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.377041 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.378778 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.378761 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 17:32:49.379039 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.378995 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 17:32:49.379245 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.379226 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2mngw\"" Jul 16 17:32:49.379368 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.379345 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 17:32:49.379627 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.379609 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 17:32:49.379776 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.379759 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 17:32:49.379950 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.379930 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.382376 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.382355 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.383140 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.383123 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 17:32:49.385159 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.384755 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 17:32:49.385503 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.385486 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hcmhf" Jul 16 17:32:49.385570 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.385509 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 17:32:49.385948 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.385930 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 17:32:49.386022 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.385969 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 17:32:49.386072 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.386029 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 17:32:49.386137 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.386119 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 17:32:49.386227 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.386196 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 17:32:49.386304 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.386240 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 17:32:49.386364 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.386303 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 17:32:49.386416 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.386389 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9d7w5\"" Jul 16 17:32:49.387114 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.386934 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rlj96\"" Jul 16 17:32:49.387114 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.387050 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-frhwv\"" Jul 16 17:32:49.387746 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.387727 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-95bmx" Jul 16 17:32:49.390162 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.390120 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 17:32:49.390657 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.390344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1173efa3-a211-4936-a680-60ba616fdbb8-dbus\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:49.390657 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.390376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c7914f1-c169-4959-9d39-56a6d052f692-hosts-file\") pod \"node-resolver-6tpzc\" (UID: \"0c7914f1-c169-4959-9d39-56a6d052f692\") " pod="openshift-dns/node-resolver-6tpzc" Jul 16 17:32:49.390657 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.390398 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c7914f1-c169-4959-9d39-56a6d052f692-tmp-dir\") pod \"node-resolver-6tpzc\" (UID: \"0c7914f1-c169-4959-9d39-56a6d052f692\") " pod="openshift-dns/node-resolver-6tpzc" Jul 16 17:32:49.390657 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.390424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k6nk\" (UniqueName: \"kubernetes.io/projected/2b85996d-3bd9-427a-a197-5f43ca288506-kube-api-access-8k6nk\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:49.390657 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.390452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:49.390657 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.390477 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vds4q\" (UniqueName: \"kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q\") pod \"network-check-target-rbrnn\" (UID: \"a911b203-d93f-48d7-a80e-4e32d5206ad9\") " pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:32:49.390657 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.390501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw5nv\" (UniqueName: \"kubernetes.io/projected/0c7914f1-c169-4959-9d39-56a6d052f692-kube-api-access-gw5nv\") pod \"node-resolver-6tpzc\" (UID: \"0c7914f1-c169-4959-9d39-56a6d052f692\") " pod="openshift-dns/node-resolver-6tpzc" Jul 16 17:32:49.390657 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.390524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:49.390657 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.390551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1173efa3-a211-4936-a680-60ba616fdbb8-kubelet-config\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:49.391121 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.390964 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qlk7n\"" Jul 16 17:32:49.391327 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.391312 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 17:32:49.391824 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.391778 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.394185 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.394013 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 17:32:49.394185 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.394080 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 17:32:49.394356 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.394338 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 17:32:49.394418 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.394366 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 17:32:49.394471 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.394425 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z8lwh\"" Jul 16 17:32:49.395035 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.394672 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 17:32:49.395035 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.394738 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:32:49.395035 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.394881 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 17:32:49.395035 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.394936 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tz2c9\"" Jul 16 17:32:49.438649 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.438555 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vpw8m" Jul 16 17:32:49.455408 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.455387 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vpw8m" Jul 16 17:32:49.468174 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.468127 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 17:32:49.491023 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.490992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-sysconfig\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.491193 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-system-cni-dir\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.491193 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491060 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f55f400-d31e-4974-bb5e-bcb9a2176c34-env-overrides\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.491193 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491080 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.491193 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1173efa3-a211-4936-a680-60ba616fdbb8-dbus\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:49.491193 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c7914f1-c169-4959-9d39-56a6d052f692-tmp-dir\") pod \"node-resolver-6tpzc\" (UID: \"0c7914f1-c169-4959-9d39-56a6d052f692\") " pod="openshift-dns/node-resolver-6tpzc" Jul 16 17:32:49.491193 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-run-netns\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.491193 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491171 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-etc-openvswitch\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-var-lib-cni-multus\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-var-lib-kubelet\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ccrb\" (UniqueName: \"kubernetes.io/projected/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-kube-api-access-2ccrb\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa41f90e-2f65-4314-b287-d9411e8b6260-konnectivity-ca\") pod \"konnectivity-agent-hcmhf\" (UID: \"aa41f90e-2f65-4314-b287-d9411e8b6260\") " pod="kube-system/konnectivity-agent-hcmhf" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491305 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9e81f6f-1eb9-411e-a067-c85ac1fa24eb-iptables-alerter-script\") pod \"iptables-alerter-95bmx\" (UID: \"d9e81f6f-1eb9-411e-a067-c85ac1fa24eb\") " pod="openshift-network-operator/iptables-alerter-95bmx" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491325 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69hzh\" (UniqueName: \"kubernetes.io/projected/26a79d40-1b3d-4683-9fdf-07f374b976b9-kube-api-access-69hzh\") pod \"node-ca-mxbdc\" (UID: \"26a79d40-1b3d-4683-9fdf-07f374b976b9\") " pod="openshift-image-registry/node-ca-mxbdc" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491343 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-var-lib-openvswitch\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-cni-netd\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12c74104-9489-49e0-a2d9-383c53e6cb53-cni-binary-copy\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c7914f1-c169-4959-9d39-56a6d052f692-hosts-file\") pod \"node-resolver-6tpzc\" (UID: \"0c7914f1-c169-4959-9d39-56a6d052f692\") " pod="openshift-dns/node-resolver-6tpzc" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491425 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-sys\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491442 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-host\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-tuned\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.492779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491506 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1173efa3-a211-4936-a680-60ba616fdbb8-dbus\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491520 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77zdb\" (UniqueName: \"kubernetes.io/projected/9f55f400-d31e-4974-bb5e-bcb9a2176c34-kube-api-access-77zdb\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491555 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-system-cni-dir\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491581 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-run-k8s-cni-cncf-io\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491625 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c7914f1-c169-4959-9d39-56a6d052f692-hosts-file\") pod \"node-resolver-6tpzc\" (UID: \"0c7914f1-c169-4959-9d39-56a6d052f692\") " pod="openshift-dns/node-resolver-6tpzc" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-os-release\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491662 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-multus-conf-dir\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-etc-selinux\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k6nk\" (UniqueName: \"kubernetes.io/projected/2b85996d-3bd9-427a-a197-5f43ca288506-kube-api-access-8k6nk\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491736 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-kubernetes\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-systemd\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-cnibin\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.493444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-systemd-units\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-run-systemd\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-var-lib-cni-bin\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f5vn\" (UniqueName: \"kubernetes.io/projected/12c74104-9489-49e0-a2d9-383c53e6cb53-kube-api-access-4f5vn\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-modprobe-d\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-os-release\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-cni-bin\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-cnibin\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-var-lib-kubelet\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ddfe8c-af0d-4393-9d54-02ab886caf4f-tmp\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26a79d40-1b3d-4683-9fdf-07f374b976b9-serviceca\") pod \"node-ca-mxbdc\" (UID: \"26a79d40-1b3d-4683-9fdf-07f374b976b9\") " pod="openshift-image-registry/node-ca-mxbdc" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-kubelet\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-run-openvswitch\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:49.494097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492153 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-sysctl-d\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-run\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492202 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa41f90e-2f65-4314-b287-d9411e8b6260-agent-certs\") pod \"konnectivity-agent-hcmhf\" (UID: \"aa41f90e-2f65-4314-b287-d9411e8b6260\") " pod="kube-system/konnectivity-agent-hcmhf" Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6r6v\" (UniqueName: \"kubernetes.io/projected/d9e81f6f-1eb9-411e-a067-c85ac1fa24eb-kube-api-access-c6r6v\") pod \"iptables-alerter-95bmx\" (UID: \"d9e81f6f-1eb9-411e-a067-c85ac1fa24eb\") " pod="openshift-network-operator/iptables-alerter-95bmx" Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.491861 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c7914f1-c169-4959-9d39-56a6d052f692-tmp-dir\") pod \"node-resolver-6tpzc\" (UID: \"0c7914f1-c169-4959-9d39-56a6d052f692\") " pod="openshift-dns/node-resolver-6tpzc" Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492269 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-log-socket\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-run-ovn-kubernetes\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492361 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-hostroot\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:49.492387 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/12c74104-9489-49e0-a2d9-383c53e6cb53-multus-daemon-config\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:49.492454 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs podName:2b85996d-3bd9-427a-a197-5f43ca288506 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:49.992433632 +0000 UTC m=+2.932965531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs") pod "network-metrics-daemon-4vsmt" (UID: "2b85996d-3bd9-427a-a197-5f43ca288506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:49.494740 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:49.492548 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:49.492604 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret podName:1173efa3-a211-4936-a680-60ba616fdbb8 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:49.992588814 +0000 UTC m=+2.933120705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret") pod "global-pull-secret-syncer-p7p9n" (UID: "1173efa3-a211-4936-a680-60ba616fdbb8") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-device-dir\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-lib-modules\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26a79d40-1b3d-4683-9fdf-07f374b976b9-host\") pod \"node-ca-mxbdc\" (UID: \"26a79d40-1b3d-4683-9fdf-07f374b976b9\") " pod="openshift-image-registry/node-ca-mxbdc" Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-node-log\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f55f400-d31e-4974-bb5e-bcb9a2176c34-ovnkube-config\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-socket-dir\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-registration-dir\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds4q\" (UniqueName: \"kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q\") pod \"network-check-target-rbrnn\" (UID: \"a911b203-d93f-48d7-a80e-4e32d5206ad9\") " pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492859 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f55f400-d31e-4974-bb5e-bcb9a2176c34-ovnkube-script-lib\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492884 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-multus-socket-dir-parent\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.495422 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1173efa3-a211-4936-a680-60ba616fdbb8-kubelet-config\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.492942 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-sysctl-conf\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493007 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1173efa3-a211-4936-a680-60ba616fdbb8-kubelet-config\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f55f400-d31e-4974-bb5e-bcb9a2176c34-ovn-node-metrics-cert\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493064 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-etc-kubernetes\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-sys-fs\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf747\" (UniqueName: \"kubernetes.io/projected/12ddfe8c-af0d-4393-9d54-02ab886caf4f-kube-api-access-nf747\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-cni-binary-copy\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9e81f6f-1eb9-411e-a067-c85ac1fa24eb-host-slash\") pod \"iptables-alerter-95bmx\" (UID: \"d9e81f6f-1eb9-411e-a067-c85ac1fa24eb\") " pod="openshift-network-operator/iptables-alerter-95bmx" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493213 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-run-ovn\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493237 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-run-multus-certs\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpcb4\" (UniqueName: \"kubernetes.io/projected/f763c34e-c8c9-457b-ab66-23e7579de36e-kube-api-access-vpcb4\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-slash\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-multus-cni-dir\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.496026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-run-netns\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.496682 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.493414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw5nv\" (UniqueName: \"kubernetes.io/projected/0c7914f1-c169-4959-9d39-56a6d052f692-kube-api-access-gw5nv\") pod \"node-resolver-6tpzc\" (UID: \"0c7914f1-c169-4959-9d39-56a6d052f692\") " pod="openshift-dns/node-resolver-6tpzc" Jul 16 17:32:49.502895 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:49.502641 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:32:49.502895 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:49.502665 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:32:49.502895 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:49.502679 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vds4q for pod openshift-network-diagnostics/network-check-target-rbrnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:32:49.502895 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.502707 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 17:32:49.502895 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:49.502759 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q podName:a911b203-d93f-48d7-a80e-4e32d5206ad9 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:50.00274158 +0000 UTC m=+2.943273477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vds4q" (UniqueName: "kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q") pod "network-check-target-rbrnn" (UID: "a911b203-d93f-48d7-a80e-4e32d5206ad9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:32:49.508137 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.507857 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k6nk\" (UniqueName: \"kubernetes.io/projected/2b85996d-3bd9-427a-a197-5f43ca288506-kube-api-access-8k6nk\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:49.508610 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.508592 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw5nv\" (UniqueName: \"kubernetes.io/projected/0c7914f1-c169-4959-9d39-56a6d052f692-kube-api-access-gw5nv\") pod \"node-resolver-6tpzc\" (UID: \"0c7914f1-c169-4959-9d39-56a6d052f692\") " pod="openshift-dns/node-resolver-6tpzc" Jul 16 17:32:49.533217 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.533191 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:32:49.578766 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.578710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" event={"ID":"e896dddf56678d2747fb67ea0c51e7c7","Type":"ContainerStarted","Data":"6dbeb5b6eeaf0667a2a9b158c22a9ea0ccb1f71a9eca2e804b23b9d3d9a8f5da"} Jul 16 17:32:49.580291 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.580247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" event={"ID":"ad0da4cc9750f83a93b2d4592a26c80f","Type":"ContainerStarted","Data":"1616ae78df93e49307dd20ee184a32927064bde2e252cc1f920f873c75774881"} Jul 16 17:32:49.594466 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.594591 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-run-netns\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.594591 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-etc-openvswitch\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.594591 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-var-lib-cni-multus\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.594591 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-var-lib-kubelet\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.594591 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ccrb\" (UniqueName: \"kubernetes.io/projected/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-kube-api-access-2ccrb\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.594591 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594578 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-etc-openvswitch\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.594906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa41f90e-2f65-4314-b287-d9411e8b6260-konnectivity-ca\") pod \"konnectivity-agent-hcmhf\" (UID: \"aa41f90e-2f65-4314-b287-d9411e8b6260\") " pod="kube-system/konnectivity-agent-hcmhf" Jul 16 17:32:49.594906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594602 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-var-lib-cni-multus\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.594906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594602 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.594906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9e81f6f-1eb9-411e-a067-c85ac1fa24eb-iptables-alerter-script\") pod \"iptables-alerter-95bmx\" (UID: \"d9e81f6f-1eb9-411e-a067-c85ac1fa24eb\") " pod="openshift-network-operator/iptables-alerter-95bmx" Jul 16 17:32:49.594906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594632 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-run-netns\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.594906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594659 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-var-lib-kubelet\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.594906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594799 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69hzh\" (UniqueName: \"kubernetes.io/projected/26a79d40-1b3d-4683-9fdf-07f374b976b9-kube-api-access-69hzh\") pod \"node-ca-mxbdc\" (UID: \"26a79d40-1b3d-4683-9fdf-07f374b976b9\") " pod="openshift-image-registry/node-ca-mxbdc" Jul 16 17:32:49.594906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-var-lib-openvswitch\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.594906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-cni-netd\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.594906 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12c74104-9489-49e0-a2d9-383c53e6cb53-cni-binary-copy\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-sys\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-host\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-tuned\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.594994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77zdb\" (UniqueName: \"kubernetes.io/projected/9f55f400-d31e-4974-bb5e-bcb9a2176c34-kube-api-access-77zdb\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-system-cni-dir\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-run-k8s-cni-cncf-io\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-os-release\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-multus-conf-dir\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-etc-selinux\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-kubernetes\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595203 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9e81f6f-1eb9-411e-a067-c85ac1fa24eb-iptables-alerter-script\") pod \"iptables-alerter-95bmx\" (UID: \"d9e81f6f-1eb9-411e-a067-c85ac1fa24eb\") " pod="openshift-network-operator/iptables-alerter-95bmx" Jul 16 17:32:49.595391 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-systemd\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-cnibin\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-systemd-units\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595300 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-var-lib-openvswitch\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-run-systemd\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-var-lib-cni-bin\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595353 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f5vn\" (UniqueName: \"kubernetes.io/projected/12c74104-9489-49e0-a2d9-383c53e6cb53-kube-api-access-4f5vn\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595353 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa41f90e-2f65-4314-b287-d9411e8b6260-konnectivity-ca\") pod \"konnectivity-agent-hcmhf\" (UID: \"aa41f90e-2f65-4314-b287-d9411e8b6260\") " pod="kube-system/konnectivity-agent-hcmhf" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595395 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-modprobe-d\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-os-release\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-cni-bin\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595477 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-multus-conf-dir\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595489 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-cnibin\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595499 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-cni-netd\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.596007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-var-lib-kubelet\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595520 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-systemd-units\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ddfe8c-af0d-4393-9d54-02ab886caf4f-tmp\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595574 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-system-cni-dir\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595602 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-os-release\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26a79d40-1b3d-4683-9fdf-07f374b976b9-serviceca\") pod \"node-ca-mxbdc\" (UID: \"26a79d40-1b3d-4683-9fdf-07f374b976b9\") " pod="openshift-image-registry/node-ca-mxbdc" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595616 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-run-systemd\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595626 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-run-k8s-cni-cncf-io\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595613 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-etc-selinux\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595645 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-cni-bin\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-kubelet\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595665 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-cnibin\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595688 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-var-lib-cni-bin\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595693 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-var-lib-kubelet\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595722 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-run-openvswitch\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.596828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595726 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-kubelet\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-run-openvswitch\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595742 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-os-release\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-sysctl-d\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595792 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-kubernetes\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-run\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595803 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-systemd\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa41f90e-2f65-4314-b287-d9411e8b6260-agent-certs\") pod \"konnectivity-agent-hcmhf\" (UID: \"aa41f90e-2f65-4314-b287-d9411e8b6260\") " pod="kube-system/konnectivity-agent-hcmhf" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6r6v\" (UniqueName: \"kubernetes.io/projected/d9e81f6f-1eb9-411e-a067-c85ac1fa24eb-kube-api-access-c6r6v\") pod \"iptables-alerter-95bmx\" (UID: \"d9e81f6f-1eb9-411e-a067-c85ac1fa24eb\") " pod="openshift-network-operator/iptables-alerter-95bmx" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-log-socket\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595922 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-modprobe-d\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-run-ovn-kubernetes\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.595982 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-run-ovn-kubernetes\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596076 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26a79d40-1b3d-4683-9fdf-07f374b976b9-serviceca\") pod \"node-ca-mxbdc\" (UID: \"26a79d40-1b3d-4683-9fdf-07f374b976b9\") " pod="openshift-image-registry/node-ca-mxbdc" Jul 16 17:32:49.597520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596097 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596136 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-cnibin\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596142 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-host\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596179 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-log-socket\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596193 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-run\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596225 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-sysctl-d\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596301 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-sys\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-hostroot\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596327 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596345 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-hostroot\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/12c74104-9489-49e0-a2d9-383c53e6cb53-multus-daemon-config\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-device-dir\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-lib-modules\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596473 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-device-dir\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.598215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26a79d40-1b3d-4683-9fdf-07f374b976b9-host\") pod \"node-ca-mxbdc\" (UID: \"26a79d40-1b3d-4683-9fdf-07f374b976b9\") " pod="openshift-image-registry/node-ca-mxbdc" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596523 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-node-log\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596550 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12c74104-9489-49e0-a2d9-383c53e6cb53-cni-binary-copy\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f55f400-d31e-4974-bb5e-bcb9a2176c34-ovnkube-config\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596589 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-lib-modules\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-socket-dir\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596617 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26a79d40-1b3d-4683-9fdf-07f374b976b9-host\") pod \"node-ca-mxbdc\" (UID: \"26a79d40-1b3d-4683-9fdf-07f374b976b9\") " pod="openshift-image-registry/node-ca-mxbdc" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-registration-dir\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596636 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-node-log\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f55f400-d31e-4974-bb5e-bcb9a2176c34-ovnkube-script-lib\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-multus-socket-dir-parent\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-sysctl-conf\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596738 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-socket-dir\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596747 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f55f400-d31e-4974-bb5e-bcb9a2176c34-ovn-node-metrics-cert\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596792 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-etc-kubernetes\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.598954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-sys-fs\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf747\" (UniqueName: \"kubernetes.io/projected/12ddfe8c-af0d-4393-9d54-02ab886caf4f-kube-api-access-nf747\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-cni-binary-copy\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596889 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/12c74104-9489-49e0-a2d9-383c53e6cb53-multus-daemon-config\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9e81f6f-1eb9-411e-a067-c85ac1fa24eb-host-slash\") pod \"iptables-alerter-95bmx\" (UID: \"d9e81f6f-1eb9-411e-a067-c85ac1fa24eb\") " pod="openshift-network-operator/iptables-alerter-95bmx" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596932 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9e81f6f-1eb9-411e-a067-c85ac1fa24eb-host-slash\") pod \"iptables-alerter-95bmx\" (UID: \"d9e81f6f-1eb9-411e-a067-c85ac1fa24eb\") " pod="openshift-network-operator/iptables-alerter-95bmx" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-run-ovn\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.596964 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-run-multus-certs\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597016 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-run-ovn\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597025 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-registration-dir\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597089 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597075 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-multus-socket-dir-parent\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597301 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-sysctl-conf\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597338 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f55f400-d31e-4974-bb5e-bcb9a2176c34-ovnkube-script-lib\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.599670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpcb4\" (UniqueName: \"kubernetes.io/projected/f763c34e-c8c9-457b-ab66-23e7579de36e-kube-api-access-vpcb4\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597398 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-etc-kubernetes\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-slash\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597471 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f763c34e-c8c9-457b-ab66-23e7579de36e-sys-fs\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597544 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f55f400-d31e-4974-bb5e-bcb9a2176c34-ovnkube-config\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597650 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-run-multus-certs\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597659 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f55f400-d31e-4974-bb5e-bcb9a2176c34-host-slash\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-multus-cni-dir\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-run-netns\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597765 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-multus-cni-dir\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-sysconfig\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-system-cni-dir\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597805 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12c74104-9489-49e0-a2d9-383c53e6cb53-host-run-netns\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597814 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-cni-binary-copy\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f55f400-d31e-4974-bb5e-bcb9a2176c34-env-overrides\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.600349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597839 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-sysconfig\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.601081 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.597846 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-system-cni-dir\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.601081 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.598223 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f55f400-d31e-4974-bb5e-bcb9a2176c34-env-overrides\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.601081 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.598592 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12ddfe8c-af0d-4393-9d54-02ab886caf4f-etc-tuned\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.601081 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.598738 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12ddfe8c-af0d-4393-9d54-02ab886caf4f-tmp\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.601081 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.600042 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f55f400-d31e-4974-bb5e-bcb9a2176c34-ovn-node-metrics-cert\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.601081 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.600396 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa41f90e-2f65-4314-b287-d9411e8b6260-agent-certs\") pod \"konnectivity-agent-hcmhf\" (UID: \"aa41f90e-2f65-4314-b287-d9411e8b6260\") " pod="kube-system/konnectivity-agent-hcmhf" Jul 16 17:32:49.605433 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.605359 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77zdb\" (UniqueName: \"kubernetes.io/projected/9f55f400-d31e-4974-bb5e-bcb9a2176c34-kube-api-access-77zdb\") pod \"ovnkube-node-sqlkj\" (UID: \"9f55f400-d31e-4974-bb5e-bcb9a2176c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.605433 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.605361 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69hzh\" (UniqueName: \"kubernetes.io/projected/26a79d40-1b3d-4683-9fdf-07f374b976b9-kube-api-access-69hzh\") pod \"node-ca-mxbdc\" (UID: \"26a79d40-1b3d-4683-9fdf-07f374b976b9\") " pod="openshift-image-registry/node-ca-mxbdc" Jul 16 17:32:49.607207 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.607177 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6r6v\" (UniqueName: \"kubernetes.io/projected/d9e81f6f-1eb9-411e-a067-c85ac1fa24eb-kube-api-access-c6r6v\") pod \"iptables-alerter-95bmx\" (UID: \"d9e81f6f-1eb9-411e-a067-c85ac1fa24eb\") " pod="openshift-network-operator/iptables-alerter-95bmx" Jul 16 17:32:49.607958 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.607923 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf747\" (UniqueName: \"kubernetes.io/projected/12ddfe8c-af0d-4393-9d54-02ab886caf4f-kube-api-access-nf747\") pod \"tuned-llg9s\" (UID: \"12ddfe8c-af0d-4393-9d54-02ab886caf4f\") " pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.608053 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.608037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f5vn\" (UniqueName: \"kubernetes.io/projected/12c74104-9489-49e0-a2d9-383c53e6cb53-kube-api-access-4f5vn\") pod \"multus-tbhgf\" (UID: \"12c74104-9489-49e0-a2d9-383c53e6cb53\") " pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.608195 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.608149 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ccrb\" (UniqueName: \"kubernetes.io/projected/c30c8ef6-b06d-4ff9-a7bd-610545897f8e-kube-api-access-2ccrb\") pod \"multus-additional-cni-plugins-2chxv\" (UID: \"c30c8ef6-b06d-4ff9-a7bd-610545897f8e\") " pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.609553 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.609526 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpcb4\" (UniqueName: \"kubernetes.io/projected/f763c34e-c8c9-457b-ab66-23e7579de36e-kube-api-access-vpcb4\") pod \"aws-ebs-csi-driver-node-bvjzm\" (UID: \"f763c34e-c8c9-457b-ab66-23e7579de36e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:49.681440 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.681402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6tpzc" Jul 16 17:32:49.689547 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.689522 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-llg9s" Jul 16 17:32:49.698535 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.698512 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mxbdc" Jul 16 17:32:49.706171 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.706152 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:32:49.714789 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.714772 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2chxv" Jul 16 17:32:49.722360 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.722344 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tbhgf" Jul 16 17:32:49.729899 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.729880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hcmhf" Jul 16 17:32:49.738495 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.738477 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-95bmx" Jul 16 17:32:49.745183 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:49.745162 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" Jul 16 17:32:50.000168 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.000077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:50.000168 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.000119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:50.000379 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:50.000229 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:32:50.000379 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:50.000235 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:32:50.000379 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:50.000308 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret podName:1173efa3-a211-4936-a680-60ba616fdbb8 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:51.000289987 +0000 UTC m=+3.940821912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret") pod "global-pull-secret-syncer-p7p9n" (UID: "1173efa3-a211-4936-a680-60ba616fdbb8") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:32:50.000379 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:50.000366 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs podName:2b85996d-3bd9-427a-a197-5f43ca288506 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:51.000358147 +0000 UTC m=+3.940890040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs") pod "network-metrics-daemon-4vsmt" (UID: "2b85996d-3bd9-427a-a197-5f43ca288506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:32:50.101294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.101240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds4q\" (UniqueName: \"kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q\") pod \"network-check-target-rbrnn\" (UID: \"a911b203-d93f-48d7-a80e-4e32d5206ad9\") " pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:32:50.101476 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:50.101434 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:32:50.101476 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:50.101462 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:32:50.101476 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:50.101477 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vds4q for pod openshift-network-diagnostics/network-check-target-rbrnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:32:50.101625 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:50.101568 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q podName:a911b203-d93f-48d7-a80e-4e32d5206ad9 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:51.101548018 +0000 UTC m=+4.042079921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vds4q" (UniqueName: "kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q") pod "network-check-target-rbrnn" (UID: "a911b203-d93f-48d7-a80e-4e32d5206ad9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:32:50.458590 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.458496 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:27:49 +0000 UTC" deadline="2028-02-15 14:17:34.265156933 +0000 UTC" Jul 16 17:32:50.458590 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.458530 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13892h44m43.806631413s" Jul 16 17:32:50.561133 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:50.561100 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf763c34e_c8c9_457b_ab66_23e7579de36e.slice/crio-0ded4fb48b11e105f7ae3440c9d3ff48b5b84fe3427c92a67680b91240f8b21a WatchSource:0}: Error finding container 0ded4fb48b11e105f7ae3440c9d3ff48b5b84fe3427c92a67680b91240f8b21a: Status 404 returned error can't find the container with id 0ded4fb48b11e105f7ae3440c9d3ff48b5b84fe3427c92a67680b91240f8b21a Jul 16 17:32:50.562002 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:50.561974 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7914f1_c169_4959_9d39_56a6d052f692.slice/crio-4d08888553e248ee70c6317755f3de4fb1db10fbe2d434606d4dc5508595f6e3 WatchSource:0}: Error finding container 4d08888553e248ee70c6317755f3de4fb1db10fbe2d434606d4dc5508595f6e3: Status 404 returned error can't find the container with id 4d08888553e248ee70c6317755f3de4fb1db10fbe2d434606d4dc5508595f6e3 Jul 16 17:32:50.563025 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:50.563001 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f55f400_d31e_4974_bb5e_bcb9a2176c34.slice/crio-e6f345e0bc9084d21f8307adfbca17a3a67915bc8f1d102e8f83df205ddc5326 WatchSource:0}: Error finding container e6f345e0bc9084d21f8307adfbca17a3a67915bc8f1d102e8f83df205ddc5326: Status 404 returned error can't find the container with id e6f345e0bc9084d21f8307adfbca17a3a67915bc8f1d102e8f83df205ddc5326 Jul 16 17:32:50.566451 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:50.566425 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e81f6f_1eb9_411e_a067_c85ac1fa24eb.slice/crio-75193a1d9dfaa14071172af4a0ef0937dfaaa0ccf2635c6ec076ad6e56391f60 WatchSource:0}: Error finding container 75193a1d9dfaa14071172af4a0ef0937dfaaa0ccf2635c6ec076ad6e56391f60: Status 404 returned error can't find the container with id 75193a1d9dfaa14071172af4a0ef0937dfaaa0ccf2635c6ec076ad6e56391f60 Jul 16 17:32:50.567094 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:50.567072 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a79d40_1b3d_4683_9fdf_07f374b976b9.slice/crio-37e93ff5b9c58d1871c70b32b9eebd1153e85debf5ffc8e179ea706b0a8cf721 WatchSource:0}: Error finding container 37e93ff5b9c58d1871c70b32b9eebd1153e85debf5ffc8e179ea706b0a8cf721: Status 404 returned error can't find the container with id 37e93ff5b9c58d1871c70b32b9eebd1153e85debf5ffc8e179ea706b0a8cf721 Jul 16 17:32:50.568536 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:50.568510 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc30c8ef6_b06d_4ff9_a7bd_610545897f8e.slice/crio-add40deed61d913935cbaae8cd2b8ad15850918bd2b124488ec8f4f9439e50f0 WatchSource:0}: Error finding container add40deed61d913935cbaae8cd2b8ad15850918bd2b124488ec8f4f9439e50f0: Status 404 returned error can't find the container with id add40deed61d913935cbaae8cd2b8ad15850918bd2b124488ec8f4f9439e50f0 Jul 16 17:32:50.569463 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:50.569129 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa41f90e_2f65_4314_b287_d9411e8b6260.slice/crio-9fe82d27ac1cc260f2e14d7c4342f39381603772126f7184e8b242c920836ff9 WatchSource:0}: Error finding container 9fe82d27ac1cc260f2e14d7c4342f39381603772126f7184e8b242c920836ff9: Status 404 returned error can't find the container with id 9fe82d27ac1cc260f2e14d7c4342f39381603772126f7184e8b242c920836ff9 Jul 16 17:32:50.571405 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:50.571332 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c74104_9489_49e0_a2d9_383c53e6cb53.slice/crio-dd107fec64f04909ee827a51bc09c562ae5c9e4d0201528359e878aef681a140 WatchSource:0}: Error finding container dd107fec64f04909ee827a51bc09c562ae5c9e4d0201528359e878aef681a140: Status 404 returned error can't find the container with id dd107fec64f04909ee827a51bc09c562ae5c9e4d0201528359e878aef681a140 Jul 16 17:32:50.572347 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:32:50.572325 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ddfe8c_af0d_4393_9d54_02ab886caf4f.slice/crio-0d8f4bfe2ec6d2d2a94b83b334b072262042af4800ac02ded1999129ebd8991c WatchSource:0}: Error finding container 0d8f4bfe2ec6d2d2a94b83b334b072262042af4800ac02ded1999129ebd8991c: Status 404 returned error can't find the container with id 0d8f4bfe2ec6d2d2a94b83b334b072262042af4800ac02ded1999129ebd8991c Jul 16 17:32:50.583103 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.583077 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-llg9s" event={"ID":"12ddfe8c-af0d-4393-9d54-02ab886caf4f","Type":"ContainerStarted","Data":"0d8f4bfe2ec6d2d2a94b83b334b072262042af4800ac02ded1999129ebd8991c"} Jul 16 17:32:50.584305 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.584282 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tbhgf" event={"ID":"12c74104-9489-49e0-a2d9-383c53e6cb53","Type":"ContainerStarted","Data":"dd107fec64f04909ee827a51bc09c562ae5c9e4d0201528359e878aef681a140"} Jul 16 17:32:50.585785 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.585760 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hcmhf" event={"ID":"aa41f90e-2f65-4314-b287-d9411e8b6260","Type":"ContainerStarted","Data":"9fe82d27ac1cc260f2e14d7c4342f39381603772126f7184e8b242c920836ff9"} Jul 16 17:32:50.586970 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.586919 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2chxv" event={"ID":"c30c8ef6-b06d-4ff9-a7bd-610545897f8e","Type":"ContainerStarted","Data":"add40deed61d913935cbaae8cd2b8ad15850918bd2b124488ec8f4f9439e50f0"} Jul 16 17:32:50.588029 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.588010 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-95bmx" event={"ID":"d9e81f6f-1eb9-411e-a067-c85ac1fa24eb","Type":"ContainerStarted","Data":"75193a1d9dfaa14071172af4a0ef0937dfaaa0ccf2635c6ec076ad6e56391f60"} Jul 16 17:32:50.589162 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.589130 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6tpzc" event={"ID":"0c7914f1-c169-4959-9d39-56a6d052f692","Type":"ContainerStarted","Data":"4d08888553e248ee70c6317755f3de4fb1db10fbe2d434606d4dc5508595f6e3"} Jul 16 17:32:50.590930 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.590873 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mxbdc" event={"ID":"26a79d40-1b3d-4683-9fdf-07f374b976b9","Type":"ContainerStarted","Data":"37e93ff5b9c58d1871c70b32b9eebd1153e85debf5ffc8e179ea706b0a8cf721"} Jul 16 17:32:50.593106 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.593089 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" event={"ID":"9f55f400-d31e-4974-bb5e-bcb9a2176c34","Type":"ContainerStarted","Data":"e6f345e0bc9084d21f8307adfbca17a3a67915bc8f1d102e8f83df205ddc5326"} Jul 16 17:32:50.594115 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:50.594097 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" event={"ID":"f763c34e-c8c9-457b-ab66-23e7579de36e","Type":"ContainerStarted","Data":"0ded4fb48b11e105f7ae3440c9d3ff48b5b84fe3427c92a67680b91240f8b21a"} Jul 16 17:32:51.008061 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:51.007694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:51.008061 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:51.007982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:51.008061 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:51.007895 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:32:51.008344 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:51.008099 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs podName:2b85996d-3bd9-427a-a197-5f43ca288506 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:53.008067729 +0000 UTC m=+5.948599634 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs") pod "network-metrics-daemon-4vsmt" (UID: "2b85996d-3bd9-427a-a197-5f43ca288506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:32:51.008344 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:51.008136 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:32:51.008344 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:51.008187 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret podName:1173efa3-a211-4936-a680-60ba616fdbb8 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:53.008171784 +0000 UTC m=+5.948703679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret") pod "global-pull-secret-syncer-p7p9n" (UID: "1173efa3-a211-4936-a680-60ba616fdbb8") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:32:51.109532 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:51.108857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds4q\" (UniqueName: \"kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q\") pod \"network-check-target-rbrnn\" (UID: \"a911b203-d93f-48d7-a80e-4e32d5206ad9\") " pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:32:51.109532 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:51.109074 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:32:51.109532 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:51.109096 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:32:51.109532 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:51.109108 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vds4q for pod openshift-network-diagnostics/network-check-target-rbrnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:32:51.109532 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:51.109167 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q podName:a911b203-d93f-48d7-a80e-4e32d5206ad9 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:53.109150506 +0000 UTC m=+6.049682391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vds4q" (UniqueName: "kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q") pod "network-check-target-rbrnn" (UID: "a911b203-d93f-48d7-a80e-4e32d5206ad9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:32:51.461379 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:51.461234 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:27:49 +0000 UTC" deadline="2028-04-01 00:38:29.623268928 +0000 UTC" Jul 16 17:32:51.461379 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:51.461310 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14983h5m38.161962771s" Jul 16 17:32:51.575004 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:51.574300 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:32:51.575004 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:51.574429 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:32:51.575004 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:51.574849 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:51.575004 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:51.574958 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:32:51.575569 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:51.575440 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:51.575569 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:51.575534 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:32:51.601624 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:51.601591 2577 generic.go:356] "Generic (PLEG): container finished" podID="e896dddf56678d2747fb67ea0c51e7c7" containerID="b944c831a62ad0075532f73c2e6c5b3ddbe554505b266c51a60fd8a5789e74fe" exitCode=0 Jul 16 17:32:51.601766 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:51.601683 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" event={"ID":"e896dddf56678d2747fb67ea0c51e7c7","Type":"ContainerDied","Data":"b944c831a62ad0075532f73c2e6c5b3ddbe554505b266c51a60fd8a5789e74fe"} Jul 16 17:32:51.605183 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:51.605097 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" event={"ID":"ad0da4cc9750f83a93b2d4592a26c80f","Type":"ContainerStarted","Data":"7613ee14b77900aa7286c821552f187254a28dc3584359bf9669673e58047d1d"} Jul 16 17:32:52.622386 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:52.622312 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" event={"ID":"e896dddf56678d2747fb67ea0c51e7c7","Type":"ContainerStarted","Data":"f75122f147052e8d11f6223deb3b8cbbe7904d01eeaabb0b37ccaf3c6f9b4b1f"} Jul 16 17:32:52.639838 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:52.638582 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-222.ec2.internal" podStartSLOduration=4.638558372 podStartE2EDuration="4.638558372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:32:51.637440999 +0000 UTC m=+4.577972912" watchObservedRunningTime="2026-07-16 17:32:52.638558372 +0000 UTC m=+5.579090267" Jul 16 17:32:53.023774 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:53.023687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:53.023774 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:53.023738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:53.024017 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:53.023883 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:32:53.024017 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:53.023943 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret podName:1173efa3-a211-4936-a680-60ba616fdbb8 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:57.023923535 +0000 UTC m=+9.964455419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret") pod "global-pull-secret-syncer-p7p9n" (UID: "1173efa3-a211-4936-a680-60ba616fdbb8") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:32:53.024376 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:53.024355 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:32:53.024484 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:53.024413 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs podName:2b85996d-3bd9-427a-a197-5f43ca288506 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:57.024397485 +0000 UTC m=+9.964929369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs") pod "network-metrics-daemon-4vsmt" (UID: "2b85996d-3bd9-427a-a197-5f43ca288506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:32:53.124455 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:53.124412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds4q\" (UniqueName: \"kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q\") pod \"network-check-target-rbrnn\" (UID: \"a911b203-d93f-48d7-a80e-4e32d5206ad9\") " pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:32:53.124644 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:53.124625 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:32:53.124644 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:53.124645 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:32:53.124754 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:53.124657 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vds4q for pod openshift-network-diagnostics/network-check-target-rbrnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:32:53.124754 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:53.124716 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q podName:a911b203-d93f-48d7-a80e-4e32d5206ad9 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:57.124698342 +0000 UTC m=+10.065230230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vds4q" (UniqueName: "kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q") pod "network-check-target-rbrnn" (UID: "a911b203-d93f-48d7-a80e-4e32d5206ad9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:32:53.574385 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:53.574351 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:53.574572 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:53.574492 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:32:53.574902 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:53.574883 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:32:53.575005 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:53.574981 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:32:53.575133 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:53.575116 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:53.575245 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:53.575226 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:32:55.573921 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:55.573360 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:32:55.573921 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:55.573492 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:32:55.573921 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:55.573507 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:55.573921 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:55.573591 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:32:55.573921 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:55.573676 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:55.573921 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:55.573743 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:32:57.059505 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:57.059467 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:57.059505 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:57.059522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:57.060020 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:57.059646 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:32:57.060020 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:57.059731 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs podName:2b85996d-3bd9-427a-a197-5f43ca288506 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:05.059710283 +0000 UTC m=+18.000242183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs") pod "network-metrics-daemon-4vsmt" (UID: "2b85996d-3bd9-427a-a197-5f43ca288506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:32:57.060020 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:57.059656 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:32:57.060020 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:57.059803 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret podName:1173efa3-a211-4936-a680-60ba616fdbb8 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:05.059790251 +0000 UTC m=+18.000322134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret") pod "global-pull-secret-syncer-p7p9n" (UID: "1173efa3-a211-4936-a680-60ba616fdbb8") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:32:57.160987 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:57.160942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds4q\" (UniqueName: \"kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q\") pod \"network-check-target-rbrnn\" (UID: \"a911b203-d93f-48d7-a80e-4e32d5206ad9\") " pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:32:57.161215 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:57.161121 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:32:57.161215 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:57.161150 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:32:57.161215 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:57.161164 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vds4q for pod openshift-network-diagnostics/network-check-target-rbrnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:32:57.161376 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:57.161238 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q podName:a911b203-d93f-48d7-a80e-4e32d5206ad9 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:05.161218936 +0000 UTC m=+18.101750821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vds4q" (UniqueName: "kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q") pod "network-check-target-rbrnn" (UID: "a911b203-d93f-48d7-a80e-4e32d5206ad9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:32:57.575666 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:57.574908 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:32:57.575666 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:57.575012 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:32:57.575666 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:57.575192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:57.575666 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:57.575356 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:32:57.575666 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:57.575385 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:57.575666 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:57.575487 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:32:59.574645 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:59.574597 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:32:59.575109 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:59.574725 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:32:59.575109 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:59.574739 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:32:59.575109 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:32:59.574793 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:32:59.575109 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:59.574883 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:32:59.575109 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:32:59.574945 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:33:01.573816 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:01.573786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:01.574323 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:01.573786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:01.574323 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:01.573914 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:33:01.574323 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:01.573799 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:01.574323 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:01.573986 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:33:01.574323 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:01.574064 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:33:03.573535 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:03.573464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:03.573971 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:03.573464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:03.573971 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:03.573618 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:03.573971 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:03.573620 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:33:03.573971 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:03.573732 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:33:03.573971 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:03.573865 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:33:05.126334 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:05.126304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:05.126746 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:05.126343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:05.126746 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:05.126458 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:05.126746 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:05.126463 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:05.126746 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:05.126522 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs podName:2b85996d-3bd9-427a-a197-5f43ca288506 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:21.12650721 +0000 UTC m=+34.067039096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs") pod "network-metrics-daemon-4vsmt" (UID: "2b85996d-3bd9-427a-a197-5f43ca288506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:05.126746 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:05.126537 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret podName:1173efa3-a211-4936-a680-60ba616fdbb8 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:21.126530736 +0000 UTC m=+34.067062618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret") pod "global-pull-secret-syncer-p7p9n" (UID: "1173efa3-a211-4936-a680-60ba616fdbb8") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:05.227039 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:05.227005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds4q\" (UniqueName: \"kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q\") pod \"network-check-target-rbrnn\" (UID: \"a911b203-d93f-48d7-a80e-4e32d5206ad9\") " pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:05.227200 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:05.227165 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:33:05.227200 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:05.227189 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:33:05.227321 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:05.227203 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vds4q for pod openshift-network-diagnostics/network-check-target-rbrnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:05.227321 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:05.227288 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q podName:a911b203-d93f-48d7-a80e-4e32d5206ad9 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:21.227245584 +0000 UTC m=+34.167777468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vds4q" (UniqueName: "kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q") pod "network-check-target-rbrnn" (UID: "a911b203-d93f-48d7-a80e-4e32d5206ad9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:05.573969 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:05.573935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:05.574149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:05.573935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:05.574149 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:05.574077 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:33:05.574149 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:05.573953 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:05.574331 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:05.574178 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:33:05.574331 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:05.574273 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:33:07.574500 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:07.574468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:07.575029 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:07.574572 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:33:07.575029 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:07.574592 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:07.575029 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:07.574716 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:33:07.575029 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:07.574747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:07.575029 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:07.574827 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:33:09.573981 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.573804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:09.574712 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.573804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:09.574712 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:09.574062 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:33:09.574712 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.573850 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:09.574712 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:09.574143 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:33:09.574712 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:09.574203 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:33:09.660209 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.660180 2577 generic.go:356] "Generic (PLEG): container finished" podID="c30c8ef6-b06d-4ff9-a7bd-610545897f8e" containerID="6e3e60d672b9f510a7aaa79c36e840b389311ae53844c30641a66384e7cb8d75" exitCode=0 Jul 16 17:33:09.660339 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.660292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2chxv" event={"ID":"c30c8ef6-b06d-4ff9-a7bd-610545897f8e","Type":"ContainerDied","Data":"6e3e60d672b9f510a7aaa79c36e840b389311ae53844c30641a66384e7cb8d75"} Jul 16 17:33:09.662387 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.662018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6tpzc" event={"ID":"0c7914f1-c169-4959-9d39-56a6d052f692","Type":"ContainerStarted","Data":"c47a9001d3e2c5ce5f6cbb112c340e2dba7923bce4def60cb9cba9df0bdf3f78"} Jul 16 17:33:09.664546 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.664490 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mxbdc" event={"ID":"26a79d40-1b3d-4683-9fdf-07f374b976b9","Type":"ContainerStarted","Data":"c8ba885fb17ffdcfb60cf75729e27f75ce1f0c846b1fb394e0d2e8c436f60807"} Jul 16 17:33:09.666991 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.666952 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:33:09.667618 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.667594 2577 generic.go:356] "Generic (PLEG): container finished" podID="9f55f400-d31e-4974-bb5e-bcb9a2176c34" containerID="e3efbc94a7ce77da940f7e6daa209ca40d342253d413fa4e3607a1eb47653fb9" exitCode=1 Jul 16 17:33:09.667702 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.667653 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" event={"ID":"9f55f400-d31e-4974-bb5e-bcb9a2176c34","Type":"ContainerStarted","Data":"71b47310a036c89afaf03d7cf9c6ee042078236f1a2e46af1868ed5ddae18247"} Jul 16 17:33:09.667762 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.667705 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" event={"ID":"9f55f400-d31e-4974-bb5e-bcb9a2176c34","Type":"ContainerStarted","Data":"2438b6728f361a86e27da1fa435bd1ec8930beedee1ade765c46a6b001c29d71"} Jul 16 17:33:09.667762 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.667735 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" event={"ID":"9f55f400-d31e-4974-bb5e-bcb9a2176c34","Type":"ContainerDied","Data":"e3efbc94a7ce77da940f7e6daa209ca40d342253d413fa4e3607a1eb47653fb9"} Jul 16 17:33:09.667878 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.667765 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" event={"ID":"9f55f400-d31e-4974-bb5e-bcb9a2176c34","Type":"ContainerStarted","Data":"9a14a40af478a5138b5575d9519e3a2d3a4189cf3bd1a0a442cd0a02531a221d"} Jul 16 17:33:09.669316 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.669292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" event={"ID":"f763c34e-c8c9-457b-ab66-23e7579de36e","Type":"ContainerStarted","Data":"f826a5892b329dd636d6d18c5beb6a345d6a1af7a7b2a8a50241bda5111b7048"} Jul 16 17:33:09.670779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.670756 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-llg9s" event={"ID":"12ddfe8c-af0d-4393-9d54-02ab886caf4f","Type":"ContainerStarted","Data":"fe0482dc8d6fc247cc265c9dc3c3d53da226f5bee7a022a45902797c5026f286"} Jul 16 17:33:09.674015 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.672585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tbhgf" event={"ID":"12c74104-9489-49e0-a2d9-383c53e6cb53","Type":"ContainerStarted","Data":"11601185abd151ebde070ec63c27ce99ebdb05e7ddce1b138b444ff6d5668fbc"} Jul 16 17:33:09.675963 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.675803 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hcmhf" event={"ID":"aa41f90e-2f65-4314-b287-d9411e8b6260","Type":"ContainerStarted","Data":"848943d2f7a1823209449ebb0f06f4eed016e0564b805941d511d77446845019"} Jul 16 17:33:09.683174 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.683133 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-222.ec2.internal" podStartSLOduration=21.683122399 podStartE2EDuration="21.683122399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:32:52.639788949 +0000 UTC m=+5.580320856" watchObservedRunningTime="2026-07-16 17:33:09.683122399 +0000 UTC m=+22.623654304" Jul 16 17:33:09.700269 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.700213 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-llg9s" podStartSLOduration=4.144908954 podStartE2EDuration="22.700199691s" totalImagesPullingTime="18.555290737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:09.699718185 +0000 UTC m=+22.640250088" watchObservedRunningTime="2026-07-16 17:33:09.700199691 +0000 UTC m=+22.640731594" Jul 16 17:33:09.713841 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.713790 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mxbdc" podStartSLOduration=4.168382435 podStartE2EDuration="22.713771153s" totalImagesPullingTime="18.545388718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:09.713413552 +0000 UTC m=+22.653945455" watchObservedRunningTime="2026-07-16 17:33:09.713771153 +0000 UTC m=+22.654303040" Jul 16 17:33:09.730628 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.730576 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tbhgf" podStartSLOduration=4.140466029 podStartE2EDuration="22.730557686s" totalImagesPullingTime="18.590091657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:09.730144953 +0000 UTC m=+22.670676857" watchObservedRunningTime="2026-07-16 17:33:09.730557686 +0000 UTC m=+22.671089590" Jul 16 17:33:09.744900 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.744867 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hcmhf" podStartSLOduration=4.188688369 podStartE2EDuration="22.744855157s" totalImagesPullingTime="18.556166788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:09.744587813 +0000 UTC m=+22.685119718" watchObservedRunningTime="2026-07-16 17:33:09.744855157 +0000 UTC m=+22.685387061" Jul 16 17:33:09.761265 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:09.759397 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6tpzc" podStartSLOduration=4.194699023 podStartE2EDuration="22.759381781s" totalImagesPullingTime="18.564682758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:09.75912011 +0000 UTC m=+22.699652014" watchObservedRunningTime="2026-07-16 17:33:09.759381781 +0000 UTC m=+22.699913690" Jul 16 17:33:10.681737 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:10.681711 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:33:10.682493 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:10.682206 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" event={"ID":"9f55f400-d31e-4974-bb5e-bcb9a2176c34","Type":"ContainerStarted","Data":"b7fbb6edb0968055c989a8e2c28ad0e1c78698505a0e53015fc22ac8c28b087d"} Jul 16 17:33:10.682493 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:10.682329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" event={"ID":"9f55f400-d31e-4974-bb5e-bcb9a2176c34","Type":"ContainerStarted","Data":"85e750550a4d66d8b626def92bb9818b4c3305833f862e0e49ce4e1c7b06f94e"} Jul 16 17:33:10.683990 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:10.683941 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-95bmx" event={"ID":"d9e81f6f-1eb9-411e-a067-c85ac1fa24eb","Type":"ContainerStarted","Data":"38acef17c1ac2f708feb9453c4cdcdcea5c313bdea6adb54703c4f789603bcf5"} Jul 16 17:33:10.703633 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:10.703586 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-95bmx" podStartSLOduration=5.157200549 podStartE2EDuration="23.7035682s" totalImagesPullingTime="18.546367651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:10.702929345 +0000 UTC m=+23.643461251" watchObservedRunningTime="2026-07-16 17:33:10.7035682 +0000 UTC m=+23.644100105" Jul 16 17:33:11.188584 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:11.188528 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 17:33:11.444118 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:11.443979 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T17:33:11.188549653Z","UUID":"e1f3e90b-942e-4917-b788-1b9ae08b4b9a","Handler":null,"Name":"","Endpoint":""} Jul 16 17:33:11.445646 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:11.445622 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 17:33:11.445779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:11.445662 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 17:33:11.573736 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:11.573711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:11.573736 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:11.573738 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:11.573962 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:11.573719 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:11.573962 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:11.573824 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:33:11.573962 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:11.573901 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:33:11.574121 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:11.573985 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:33:11.688621 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:11.688587 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" event={"ID":"f763c34e-c8c9-457b-ab66-23e7579de36e","Type":"ContainerStarted","Data":"fd0dd4fb2bb22078ae8da4d654353932d0cae4ba893afd5da96df79c02fe5c03"} Jul 16 17:33:12.007525 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:12.007485 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcmhf_aa41f90e-2f65-4314-b287-d9411e8b6260/konnectivity-agent/0.log" limit=1024 Jul 16 17:33:12.122886 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:12.122853 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcmhf_aa41f90e-2f65-4314-b287-d9411e8b6260/konnectivity-agent/0.log" limit=1024 Jul 16 17:33:12.394213 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:12.394134 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hcmhf" Jul 16 17:33:12.394792 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:12.394772 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hcmhf" Jul 16 17:33:12.690854 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:12.690767 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hcmhf" Jul 16 17:33:12.691279 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:12.691242 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hcmhf" Jul 16 17:33:12.777775 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:12.777733 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcmhf_aa41f90e-2f65-4314-b287-d9411e8b6260/konnectivity-agent/0.log" limit=1024 Jul 16 17:33:13.573951 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:13.573918 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:13.573951 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:13.573931 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:13.574185 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:13.573925 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:13.574185 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:13.574031 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:33:13.574185 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:13.574112 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:33:13.574368 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:13.574199 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:33:14.696336 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:14.696135 2577 generic.go:356] "Generic (PLEG): container finished" podID="c30c8ef6-b06d-4ff9-a7bd-610545897f8e" containerID="923bc8a447f5362c7a094ffeb0dfa03a705392f9c370b3f42dbcfced0b44df60" exitCode=0 Jul 16 17:33:14.696953 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:14.696202 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2chxv" event={"ID":"c30c8ef6-b06d-4ff9-a7bd-610545897f8e","Type":"ContainerDied","Data":"923bc8a447f5362c7a094ffeb0dfa03a705392f9c370b3f42dbcfced0b44df60"} Jul 16 17:33:14.699544 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:14.699527 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:33:14.699926 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:14.699905 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" event={"ID":"9f55f400-d31e-4974-bb5e-bcb9a2176c34","Type":"ContainerStarted","Data":"513bfb540cead4ee599452358d6501c8241db1ae651168a05ef3c894248fc18e"} Jul 16 17:33:14.701912 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:14.701893 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" event={"ID":"f763c34e-c8c9-457b-ab66-23e7579de36e","Type":"ContainerStarted","Data":"7240856f1b4dc23090c8e7b5915ffaa420353c637d85bb87df246fa0c5522f59"} Jul 16 17:33:15.573419 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:15.573350 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:15.573596 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:15.573352 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:15.573596 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:15.573461 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:33:15.573596 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:15.573560 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:33:15.573596 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:15.573354 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:15.573760 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:15.573660 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:33:16.457328 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:16.457096 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcmhf_aa41f90e-2f65-4314-b287-d9411e8b6260/konnectivity-agent/0.log" limit=1024 Jul 16 17:33:16.564049 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:16.564007 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcmhf_aa41f90e-2f65-4314-b287-d9411e8b6260/konnectivity-agent/0.log" limit=1024 Jul 16 17:33:16.709453 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:16.709360 2577 generic.go:356] "Generic (PLEG): container finished" podID="c30c8ef6-b06d-4ff9-a7bd-610545897f8e" containerID="1947ee5b1cace83c1abdcfc7960a9a6ba0f82103d33257a8a3547f09b7031d39" exitCode=0 Jul 16 17:33:16.709453 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:16.709402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2chxv" event={"ID":"c30c8ef6-b06d-4ff9-a7bd-610545897f8e","Type":"ContainerDied","Data":"1947ee5b1cace83c1abdcfc7960a9a6ba0f82103d33257a8a3547f09b7031d39"} Jul 16 17:33:16.713031 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:16.713015 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:33:16.713415 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:16.713397 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" event={"ID":"9f55f400-d31e-4974-bb5e-bcb9a2176c34","Type":"ContainerStarted","Data":"e03738c001e503c00b725d6f621bbfd045d779797df1f9fb6cafcb54bb845b58"} Jul 16 17:33:16.713610 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:16.713596 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:33:16.713662 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:16.713656 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:33:16.713848 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:16.713832 2577 scope.go:117] "RemoveContainer" containerID="e3efbc94a7ce77da940f7e6daa209ca40d342253d413fa4e3607a1eb47653fb9" Jul 16 17:33:16.730875 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:16.730855 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:33:16.743083 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:16.743044 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvjzm" podStartSLOduration=10.59784253 podStartE2EDuration="29.743030997s" totalImagesPullingTime="19.145188467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:14.756117471 +0000 UTC m=+27.696649386" watchObservedRunningTime="2026-07-16 17:33:16.743030997 +0000 UTC m=+29.683562901" Jul 16 17:33:17.242720 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:17.242677 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcmhf_aa41f90e-2f65-4314-b287-d9411e8b6260/konnectivity-agent/0.log" limit=1024 Jul 16 17:33:17.383096 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:17.383060 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcmhf_aa41f90e-2f65-4314-b287-d9411e8b6260/konnectivity-agent/0.log" limit=1024 Jul 16 17:33:17.574314 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:17.574217 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:17.574785 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:17.574341 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:33:17.574785 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:17.574400 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:17.574785 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:17.574485 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:33:17.574785 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:17.574530 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:17.574785 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:17.574589 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:33:17.721373 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:17.721346 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:33:17.721812 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:17.721780 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" event={"ID":"9f55f400-d31e-4974-bb5e-bcb9a2176c34","Type":"ContainerStarted","Data":"3c086ce20f5076d276bd1ac576ed847ac024205b0ac80b25f344e741fc8690dc"} Jul 16 17:33:17.722050 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:17.722028 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:33:17.737828 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:17.737810 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:33:17.855912 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:17.855866 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" podStartSLOduration=12.20683048 podStartE2EDuration="30.855850013s" totalImagesPullingTime="18.649019533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:17.791710827 +0000 UTC m=+30.732242731" watchObservedRunningTime="2026-07-16 17:33:17.855850013 +0000 UTC m=+30.796381916" Jul 16 17:33:18.725962 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:18.725930 2577 generic.go:356] "Generic (PLEG): container finished" podID="c30c8ef6-b06d-4ff9-a7bd-610545897f8e" containerID="24a630fec33320d49503ee6dc0b3d977903ba789afed4fdc9568458d61ac8f2c" exitCode=0 Jul 16 17:33:18.726394 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:18.726016 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2chxv" event={"ID":"c30c8ef6-b06d-4ff9-a7bd-610545897f8e","Type":"ContainerDied","Data":"24a630fec33320d49503ee6dc0b3d977903ba789afed4fdc9568458d61ac8f2c"} Jul 16 17:33:19.371042 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:19.371011 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rbrnn"] Jul 16 17:33:19.371210 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:19.371142 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:19.371296 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:19.371216 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:33:19.379980 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:19.379902 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4vsmt"] Jul 16 17:33:19.380085 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:19.380021 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:19.380176 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:19.380150 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:33:19.380623 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:19.380598 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p7p9n"] Jul 16 17:33:19.380722 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:19.380686 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:19.380776 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:19.380758 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:33:21.144986 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:21.144742 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:21.145378 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:21.145012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:21.145378 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:21.144893 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:21.145378 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:21.145115 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:21.145378 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:21.145127 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs podName:2b85996d-3bd9-427a-a197-5f43ca288506 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:53.145109373 +0000 UTC m=+66.085641255 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs") pod "network-metrics-daemon-4vsmt" (UID: "2b85996d-3bd9-427a-a197-5f43ca288506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:33:21.145378 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:21.145162 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret podName:1173efa3-a211-4936-a680-60ba616fdbb8 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:53.145150316 +0000 UTC m=+66.085682198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret") pod "global-pull-secret-syncer-p7p9n" (UID: "1173efa3-a211-4936-a680-60ba616fdbb8") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:33:21.245411 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:21.245377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds4q\" (UniqueName: \"kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q\") pod \"network-check-target-rbrnn\" (UID: \"a911b203-d93f-48d7-a80e-4e32d5206ad9\") " pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:21.245559 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:21.245537 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:33:21.245559 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:21.245555 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:33:21.245672 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:21.245565 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vds4q for pod openshift-network-diagnostics/network-check-target-rbrnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:21.245672 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:21.245626 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q podName:a911b203-d93f-48d7-a80e-4e32d5206ad9 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:53.245605869 +0000 UTC m=+66.186137769 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vds4q" (UniqueName: "kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q") pod "network-check-target-rbrnn" (UID: "a911b203-d93f-48d7-a80e-4e32d5206ad9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:33:21.573758 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:21.573669 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:21.573914 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:21.573669 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:21.573914 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:21.573810 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p7p9n" podUID="1173efa3-a211-4936-a680-60ba616fdbb8" Jul 16 17:33:21.573914 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:21.573682 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:21.573914 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:21.573897 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbrnn" podUID="a911b203-d93f-48d7-a80e-4e32d5206ad9" Jul 16 17:33:21.574097 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:21.573964 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vsmt" podUID="2b85996d-3bd9-427a-a197-5f43ca288506" Jul 16 17:33:22.802671 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.802639 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-222.ec2.internal" event="NodeReady" Jul 16 17:33:22.803099 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.802811 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 17:33:22.878931 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.878882 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7d46w"] Jul 16 17:33:22.884245 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.884175 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wk7j4"] Jul 16 17:33:22.884385 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.884298 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:22.887506 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.887484 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7tn9x\"" Jul 16 17:33:22.887651 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.887614 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 17:33:22.887810 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.887788 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wk7j4" Jul 16 17:33:22.888055 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.887948 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 17:33:22.890055 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.890026 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 17:33:22.890150 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.890080 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 17:33:22.890674 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.890654 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 17:33:22.890975 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.890957 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4ccwt\"" Jul 16 17:33:22.897778 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.897759 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wk7j4"] Jul 16 17:33:22.899572 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:22.899514 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7d46w"] Jul 16 17:33:23.058841 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.058805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:23.059007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.058853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5895f08-d52d-4dc1-9921-e4523fd27d58-tmp-dir\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:23.059007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.058895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk5m2\" (UniqueName: \"kubernetes.io/projected/b5895f08-d52d-4dc1-9921-e4523fd27d58-kube-api-access-qk5m2\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:23.059007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.058934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5895f08-d52d-4dc1-9921-e4523fd27d58-config-volume\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:23.059007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.058961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/680b111a-3188-4fc7-9719-a81a6fdbdd45-cert\") pod \"ingress-canary-wk7j4\" (UID: \"680b111a-3188-4fc7-9719-a81a6fdbdd45\") " pod="openshift-ingress-canary/ingress-canary-wk7j4" Jul 16 17:33:23.059007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.058985 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7mqr\" (UniqueName: \"kubernetes.io/projected/680b111a-3188-4fc7-9719-a81a6fdbdd45-kube-api-access-c7mqr\") pod \"ingress-canary-wk7j4\" (UID: \"680b111a-3188-4fc7-9719-a81a6fdbdd45\") " pod="openshift-ingress-canary/ingress-canary-wk7j4" Jul 16 17:33:23.159820 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.159736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:23.159820 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.159791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5895f08-d52d-4dc1-9921-e4523fd27d58-tmp-dir\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:23.160043 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.159833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk5m2\" (UniqueName: \"kubernetes.io/projected/b5895f08-d52d-4dc1-9921-e4523fd27d58-kube-api-access-qk5m2\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:23.160043 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.159869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5895f08-d52d-4dc1-9921-e4523fd27d58-config-volume\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:23.160043 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.159896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/680b111a-3188-4fc7-9719-a81a6fdbdd45-cert\") pod \"ingress-canary-wk7j4\" (UID: \"680b111a-3188-4fc7-9719-a81a6fdbdd45\") " pod="openshift-ingress-canary/ingress-canary-wk7j4" Jul 16 17:33:23.160043 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:23.159917 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:33:23.160043 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:23.159994 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls podName:b5895f08-d52d-4dc1-9921-e4523fd27d58 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:23.659971456 +0000 UTC m=+36.600503360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls") pod "dns-default-7d46w" (UID: "b5895f08-d52d-4dc1-9921-e4523fd27d58") : secret "dns-default-metrics-tls" not found Jul 16 17:33:23.160329 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.159920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7mqr\" (UniqueName: \"kubernetes.io/projected/680b111a-3188-4fc7-9719-a81a6fdbdd45-kube-api-access-c7mqr\") pod \"ingress-canary-wk7j4\" (UID: \"680b111a-3188-4fc7-9719-a81a6fdbdd45\") " pod="openshift-ingress-canary/ingress-canary-wk7j4" Jul 16 17:33:23.160329 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.160224 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5895f08-d52d-4dc1-9921-e4523fd27d58-tmp-dir\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:23.160590 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.160565 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5895f08-d52d-4dc1-9921-e4523fd27d58-config-volume\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:23.164670 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.164647 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/680b111a-3188-4fc7-9719-a81a6fdbdd45-cert\") pod \"ingress-canary-wk7j4\" (UID: \"680b111a-3188-4fc7-9719-a81a6fdbdd45\") " pod="openshift-ingress-canary/ingress-canary-wk7j4" Jul 16 17:33:23.181946 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.181922 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7mqr\" (UniqueName: \"kubernetes.io/projected/680b111a-3188-4fc7-9719-a81a6fdbdd45-kube-api-access-c7mqr\") pod \"ingress-canary-wk7j4\" (UID: \"680b111a-3188-4fc7-9719-a81a6fdbdd45\") " pod="openshift-ingress-canary/ingress-canary-wk7j4" Jul 16 17:33:23.183711 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.183687 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk5m2\" (UniqueName: \"kubernetes.io/projected/b5895f08-d52d-4dc1-9921-e4523fd27d58-kube-api-access-qk5m2\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:23.203717 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.203683 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wk7j4" Jul 16 17:33:23.574074 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.573989 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:23.574225 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.573994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:23.574225 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.573994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:23.577196 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.577018 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 17:33:23.577196 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.577031 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 17:33:23.577196 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.577045 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 17:33:23.577196 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.577086 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ck2g5\"" Jul 16 17:33:23.577196 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.577031 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-455gg\"" Jul 16 17:33:23.577196 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.577031 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 17:33:23.663305 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:23.663247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:23.663475 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:23.663424 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:33:23.663542 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:23.663493 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls podName:b5895f08-d52d-4dc1-9921-e4523fd27d58 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:24.663475203 +0000 UTC m=+37.604007085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls") pod "dns-default-7d46w" (UID: "b5895f08-d52d-4dc1-9921-e4523fd27d58") : secret "dns-default-metrics-tls" not found Jul 16 17:33:24.258439 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:24.258286 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wk7j4"] Jul 16 17:33:24.261637 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:33:24.261608 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod680b111a_3188_4fc7_9719_a81a6fdbdd45.slice/crio-1feda1f99d4118e27c2470d00ba3df6732be5cc92ea5253cffc2aef01361a228 WatchSource:0}: Error finding container 1feda1f99d4118e27c2470d00ba3df6732be5cc92ea5253cffc2aef01361a228: Status 404 returned error can't find the container with id 1feda1f99d4118e27c2470d00ba3df6732be5cc92ea5253cffc2aef01361a228 Jul 16 17:33:24.670927 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:24.670836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:24.671063 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:24.670993 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:33:24.671063 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:24.671049 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls podName:b5895f08-d52d-4dc1-9921-e4523fd27d58 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:26.67103533 +0000 UTC m=+39.611567215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls") pod "dns-default-7d46w" (UID: "b5895f08-d52d-4dc1-9921-e4523fd27d58") : secret "dns-default-metrics-tls" not found Jul 16 17:33:24.744597 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:24.744551 2577 generic.go:356] "Generic (PLEG): container finished" podID="c30c8ef6-b06d-4ff9-a7bd-610545897f8e" containerID="d18ebaa3878216575098f5b5c6a20052b96003c852f95b5e01a0e3f57d6e4f66" exitCode=0 Jul 16 17:33:24.744747 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:24.744593 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2chxv" event={"ID":"c30c8ef6-b06d-4ff9-a7bd-610545897f8e","Type":"ContainerDied","Data":"d18ebaa3878216575098f5b5c6a20052b96003c852f95b5e01a0e3f57d6e4f66"} Jul 16 17:33:24.746183 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:24.746149 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wk7j4" event={"ID":"680b111a-3188-4fc7-9719-a81a6fdbdd45","Type":"ContainerStarted","Data":"1feda1f99d4118e27c2470d00ba3df6732be5cc92ea5253cffc2aef01361a228"} Jul 16 17:33:25.751522 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:25.751490 2577 generic.go:356] "Generic (PLEG): container finished" podID="c30c8ef6-b06d-4ff9-a7bd-610545897f8e" containerID="2b7141aac69dbc8d578eddb416791740e2b425a19f176371898bdac61a23f26e" exitCode=0 Jul 16 17:33:25.751936 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:25.751553 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2chxv" event={"ID":"c30c8ef6-b06d-4ff9-a7bd-610545897f8e","Type":"ContainerDied","Data":"2b7141aac69dbc8d578eddb416791740e2b425a19f176371898bdac61a23f26e"} Jul 16 17:33:26.687956 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:26.687922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:26.688150 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:26.688033 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:33:26.688150 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:26.688085 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls podName:b5895f08-d52d-4dc1-9921-e4523fd27d58 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:30.688071074 +0000 UTC m=+43.628602956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls") pod "dns-default-7d46w" (UID: "b5895f08-d52d-4dc1-9921-e4523fd27d58") : secret "dns-default-metrics-tls" not found Jul 16 17:33:26.757000 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:26.756961 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2chxv" event={"ID":"c30c8ef6-b06d-4ff9-a7bd-610545897f8e","Type":"ContainerStarted","Data":"406ecc4bbae656a920ac194dc50a8cb9864b0534fd29b2a034f7d2039985b658"} Jul 16 17:33:26.782030 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:26.781969 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2chxv" podStartSLOduration=9.247731561 podStartE2EDuration="39.78194936s" totalImagesPullingTime="30.534217799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:26.780780557 +0000 UTC m=+39.721312475" watchObservedRunningTime="2026-07-16 17:33:26.78194936 +0000 UTC m=+39.722481264" Jul 16 17:33:27.760695 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:27.760648 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wk7j4" event={"ID":"680b111a-3188-4fc7-9719-a81a6fdbdd45","Type":"ContainerStarted","Data":"00d0337c57bf2a27c5eddb84f306274211334c3b1ee6a6a05c60b7c141edf1cb"} Jul 16 17:33:27.785665 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:27.785618 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wk7j4" podStartSLOduration=2.984457621 podStartE2EDuration="5.785603553s" totalImagesPullingTime="2.801145932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:27.785389643 +0000 UTC m=+40.725921547" watchObservedRunningTime="2026-07-16 17:33:27.785603553 +0000 UTC m=+40.726135457" Jul 16 17:33:30.717737 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:30.717698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:30.718117 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:30.717825 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:33:30.718117 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:30.717878 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls podName:b5895f08-d52d-4dc1-9921-e4523fd27d58 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:38.717864896 +0000 UTC m=+51.658396779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls") pod "dns-default-7d46w" (UID: "b5895f08-d52d-4dc1-9921-e4523fd27d58") : secret "dns-default-metrics-tls" not found Jul 16 17:33:38.772977 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:38.772941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:38.773395 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:38.773089 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:33:38.773395 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:38.773151 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls podName:b5895f08-d52d-4dc1-9921-e4523fd27d58 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:54.773132631 +0000 UTC m=+67.713664520 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls") pod "dns-default-7d46w" (UID: "b5895f08-d52d-4dc1-9921-e4523fd27d58") : secret "dns-default-metrics-tls" not found Jul 16 17:33:49.738988 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:49.738955 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sqlkj" Jul 16 17:33:53.168971 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.168933 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:53.169361 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.168997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:33:53.171788 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.171771 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 17:33:53.171845 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.171776 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 17:33:53.179551 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:53.179536 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 17:33:53.179612 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:53.179602 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs podName:2b85996d-3bd9-427a-a197-5f43ca288506 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:57.179586389 +0000 UTC m=+130.120118270 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs") pod "network-metrics-daemon-4vsmt" (UID: "2b85996d-3bd9-427a-a197-5f43ca288506") : secret "metrics-daemon-secret" not found Jul 16 17:33:53.182914 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.182884 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1173efa3-a211-4936-a680-60ba616fdbb8-original-pull-secret\") pod \"global-pull-secret-syncer-p7p9n\" (UID: \"1173efa3-a211-4936-a680-60ba616fdbb8\") " pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:53.269846 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.269795 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds4q\" (UniqueName: \"kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q\") pod \"network-check-target-rbrnn\" (UID: \"a911b203-d93f-48d7-a80e-4e32d5206ad9\") " pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:53.272503 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.272486 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 17:33:53.282655 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.282634 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 17:33:53.292917 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.292884 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vds4q\" (UniqueName: \"kubernetes.io/projected/a911b203-d93f-48d7-a80e-4e32d5206ad9-kube-api-access-vds4q\") pod \"network-check-target-rbrnn\" (UID: \"a911b203-d93f-48d7-a80e-4e32d5206ad9\") " pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:53.297659 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.297633 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p7p9n" Jul 16 17:33:53.419887 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.419818 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p7p9n"] Jul 16 17:33:53.423395 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:33:53.423368 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1173efa3_a211_4936_a680_60ba616fdbb8.slice/crio-59546be0362d1a70a2a61610efbb2a2c9aaa9417cc025774d4fd345d40180b46 WatchSource:0}: Error finding container 59546be0362d1a70a2a61610efbb2a2c9aaa9417cc025774d4fd345d40180b46: Status 404 returned error can't find the container with id 59546be0362d1a70a2a61610efbb2a2c9aaa9417cc025774d4fd345d40180b46 Jul 16 17:33:53.588420 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.588389 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ck2g5\"" Jul 16 17:33:53.596506 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.596484 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:53.718397 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.718369 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rbrnn"] Jul 16 17:33:53.723856 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:33:53.723827 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda911b203_d93f_48d7_a80e_4e32d5206ad9.slice/crio-98fc250dea3f5a7587ce27f9cb41a21f1f6daa66ed97791949d818ba18152f75 WatchSource:0}: Error finding container 98fc250dea3f5a7587ce27f9cb41a21f1f6daa66ed97791949d818ba18152f75: Status 404 returned error can't find the container with id 98fc250dea3f5a7587ce27f9cb41a21f1f6daa66ed97791949d818ba18152f75 Jul 16 17:33:53.826556 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.826521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p7p9n" event={"ID":"1173efa3-a211-4936-a680-60ba616fdbb8","Type":"ContainerStarted","Data":"59546be0362d1a70a2a61610efbb2a2c9aaa9417cc025774d4fd345d40180b46"} Jul 16 17:33:53.827503 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:53.827480 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rbrnn" event={"ID":"a911b203-d93f-48d7-a80e-4e32d5206ad9","Type":"ContainerStarted","Data":"98fc250dea3f5a7587ce27f9cb41a21f1f6daa66ed97791949d818ba18152f75"} Jul 16 17:33:54.778371 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:54.778332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:33:54.778805 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:54.778482 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:33:54.778805 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:33:54.778552 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls podName:b5895f08-d52d-4dc1-9921-e4523fd27d58 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:26.778532623 +0000 UTC m=+99.719064506 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls") pod "dns-default-7d46w" (UID: "b5895f08-d52d-4dc1-9921-e4523fd27d58") : secret "dns-default-metrics-tls" not found Jul 16 17:33:57.840052 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:57.840005 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p7p9n" event={"ID":"1173efa3-a211-4936-a680-60ba616fdbb8","Type":"ContainerStarted","Data":"f4795ae19cd439b10c4cfc217a62d98a95eb681094d1e274ae64f3d2cc65180d"} Jul 16 17:33:57.863066 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:57.862992 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p7p9n" podStartSLOduration=66.8360456 podStartE2EDuration="1m10.862972626s" totalImagesPullingTime="4.026927026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:57.862127415 +0000 UTC m=+70.802659310" watchObservedRunningTime="2026-07-16 17:33:57.862972626 +0000 UTC m=+70.803504534" Jul 16 17:33:59.847361 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:59.847322 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rbrnn" event={"ID":"a911b203-d93f-48d7-a80e-4e32d5206ad9","Type":"ContainerStarted","Data":"5e5757d3116268da232034b9f3e9f1693c65137849e1339e0a64e98c76cc8ac8"} Jul 16 17:33:59.847702 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:59.847476 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:33:59.866108 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:33:59.866065 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rbrnn" podStartSLOduration=66.844675069 podStartE2EDuration="1m12.866050808s" totalImagesPullingTime="6.021375739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:59.865274852 +0000 UTC m=+72.805806746" watchObservedRunningTime="2026-07-16 17:33:59.866050808 +0000 UTC m=+72.806582711" Jul 16 17:34:13.422565 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.422447 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-59wcz"] Jul 16 17:34:13.426361 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.426339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-59wcz" Jul 16 17:34:13.441985 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.441966 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-t6rdr\"" Jul 16 17:34:13.442073 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.441968 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 16 17:34:13.442073 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.442026 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:34:13.465038 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.465016 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-59wcz"] Jul 16 17:34:13.492630 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.492606 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw"] Jul 16 17:34:13.495432 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.495414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:13.499343 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.499326 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 16 17:34:13.499574 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.499560 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 16 17:34:13.499621 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.499564 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:34:13.500000 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.499983 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6tc44\"" Jul 16 17:34:13.500952 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.500932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtr49\" (UniqueName: \"kubernetes.io/projected/324b5cb9-1cd4-4c83-ab85-276957f8d6ef-kube-api-access-wtr49\") pod \"volume-data-source-validator-78495597f6-59wcz\" (UID: \"324b5cb9-1cd4-4c83-ab85-276957f8d6ef\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-59wcz" Jul 16 17:34:13.520139 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.520075 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw"] Jul 16 17:34:13.540544 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.540518 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74955c86c4-qcfb5"] Jul 16 17:34:13.543211 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.543196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.549573 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.549557 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 17:34:13.549746 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.549724 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 17:34:13.549866 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.549852 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dx8hw\"" Jul 16 17:34:13.557462 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.557441 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 17:34:13.577801 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.577774 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 17:34:13.578680 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.578662 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74955c86c4-qcfb5"] Jul 16 17:34:13.602015 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.601979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cad8c8fc-85a3-4855-94ba-95549f5a0419-image-registry-private-configuration\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.602145 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.602024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cad8c8fc-85a3-4855-94ba-95549f5a0419-installation-pull-secrets\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.602145 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.602055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cad8c8fc-85a3-4855-94ba-95549f5a0419-ca-trust-extracted\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.602145 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.602111 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.602325 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.602158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-certificates\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.602325 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.602192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-bound-sa-token\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.602325 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.602299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cad8c8fc-85a3-4855-94ba-95549f5a0419-trusted-ca\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.602325 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.602323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-ssqcw\" (UID: \"072cde45-4049-4434-9d7a-031a00ddb67d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:13.602506 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.602341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wt7d\" (UniqueName: \"kubernetes.io/projected/072cde45-4049-4434-9d7a-031a00ddb67d-kube-api-access-6wt7d\") pod \"cluster-samples-operator-65db858894-ssqcw\" (UID: \"072cde45-4049-4434-9d7a-031a00ddb67d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:13.602506 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.602363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtr49\" (UniqueName: \"kubernetes.io/projected/324b5cb9-1cd4-4c83-ab85-276957f8d6ef-kube-api-access-wtr49\") pod \"volume-data-source-validator-78495597f6-59wcz\" (UID: \"324b5cb9-1cd4-4c83-ab85-276957f8d6ef\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-59wcz" Jul 16 17:34:13.602506 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.602411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz2q7\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-kube-api-access-wz2q7\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.623808 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.623788 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-888fdc5b4-t2mnk"] Jul 16 17:34:13.626615 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.626600 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.628460 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.628441 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtr49\" (UniqueName: \"kubernetes.io/projected/324b5cb9-1cd4-4c83-ab85-276957f8d6ef-kube-api-access-wtr49\") pod \"volume-data-source-validator-78495597f6-59wcz\" (UID: \"324b5cb9-1cd4-4c83-ab85-276957f8d6ef\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-59wcz" Jul 16 17:34:13.632920 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.632904 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 16 17:34:13.632920 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.632911 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 16 17:34:13.637028 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.637006 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 16 17:34:13.637518 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.637502 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 17:34:13.637879 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.637862 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 17:34:13.637967 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.637940 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 16 17:34:13.638376 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.638358 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-42gdx\"" Jul 16 17:34:13.647208 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.647188 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-888fdc5b4-t2mnk"] Jul 16 17:34:13.703079 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.702947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cad8c8fc-85a3-4855-94ba-95549f5a0419-ca-trust-extracted\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.703079 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.703295 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703089 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-certificates\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.703295 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-bound-sa-token\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.703295 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.703295 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.703295 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cad8c8fc-85a3-4855-94ba-95549f5a0419-trusted-ca\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.703295 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-ssqcw\" (UID: \"072cde45-4049-4434-9d7a-031a00ddb67d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:13.703540 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703305 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wt7d\" (UniqueName: \"kubernetes.io/projected/072cde45-4049-4434-9d7a-031a00ddb67d-kube-api-access-6wt7d\") pod \"cluster-samples-operator-65db858894-ssqcw\" (UID: \"072cde45-4049-4434-9d7a-031a00ddb67d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:13.703540 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:13.703281 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:34:13.703540 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703330 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cad8c8fc-85a3-4855-94ba-95549f5a0419-ca-trust-extracted\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.703540 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:13.703344 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 17:34:13.703540 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:13.703355 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74955c86c4-qcfb5: secret "image-registry-tls" not found Jul 16 17:34:13.703540 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-default-certificate\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.703540 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:13.703420 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls podName:072cde45-4049-4434-9d7a-031a00ddb67d nodeName:}" failed. No retries permitted until 2026-07-16 17:34:14.203398484 +0000 UTC m=+87.143930366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls") pod "cluster-samples-operator-65db858894-ssqcw" (UID: "072cde45-4049-4434-9d7a-031a00ddb67d") : secret "samples-operator-tls" not found Jul 16 17:34:13.703540 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:13.703518 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls podName:cad8c8fc-85a3-4855-94ba-95549f5a0419 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:14.203496435 +0000 UTC m=+87.144028323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls") pod "image-registry-74955c86c4-qcfb5" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419") : secret "image-registry-tls" not found Jul 16 17:34:13.703879 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz2q7\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-kube-api-access-wz2q7\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.703879 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m22zz\" (UniqueName: \"kubernetes.io/projected/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-kube-api-access-m22zz\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.703879 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cad8c8fc-85a3-4855-94ba-95549f5a0419-image-registry-private-configuration\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.703879 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cad8c8fc-85a3-4855-94ba-95549f5a0419-installation-pull-secrets\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.703879 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-stats-auth\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.703879 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.703717 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-certificates\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.704128 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.704002 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cad8c8fc-85a3-4855-94ba-95549f5a0419-trusted-ca\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.705923 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.705901 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cad8c8fc-85a3-4855-94ba-95549f5a0419-image-registry-private-configuration\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.706034 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.705931 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cad8c8fc-85a3-4855-94ba-95549f5a0419-installation-pull-secrets\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.719875 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.719854 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-bound-sa-token\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.719991 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.719962 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wt7d\" (UniqueName: \"kubernetes.io/projected/072cde45-4049-4434-9d7a-031a00ddb67d-kube-api-access-6wt7d\") pod \"cluster-samples-operator-65db858894-ssqcw\" (UID: \"072cde45-4049-4434-9d7a-031a00ddb67d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:13.720220 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.720199 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz2q7\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-kube-api-access-wz2q7\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:13.734293 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.734272 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-59wcz" Jul 16 17:34:13.804851 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.804820 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.804851 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.804854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.805385 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:13.805361 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 17:34:13.805462 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:13.805367 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle podName:2cc3e58e-979d-4b16-ac6c-0ecbfba2218a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:14.305333017 +0000 UTC m=+87.245864898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle") pod "router-default-888fdc5b4-t2mnk" (UID: "2cc3e58e-979d-4b16-ac6c-0ecbfba2218a") : configmap references non-existent config key: service-ca.crt Jul 16 17:34:13.805526 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.805486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-default-certificate\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.805526 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:13.805496 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs podName:2cc3e58e-979d-4b16-ac6c-0ecbfba2218a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:14.305479967 +0000 UTC m=+87.246011848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs") pod "router-default-888fdc5b4-t2mnk" (UID: "2cc3e58e-979d-4b16-ac6c-0ecbfba2218a") : secret "router-metrics-certs-default" not found Jul 16 17:34:13.805632 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.805540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m22zz\" (UniqueName: \"kubernetes.io/projected/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-kube-api-access-m22zz\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.805829 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.805811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-stats-auth\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.809425 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.808644 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-default-certificate\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.810243 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.810200 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-stats-auth\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.830374 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.830351 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m22zz\" (UniqueName: \"kubernetes.io/projected/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-kube-api-access-m22zz\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:13.872199 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:13.872169 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-59wcz"] Jul 16 17:34:13.875230 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:34:13.875202 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324b5cb9_1cd4_4c83_ab85_276957f8d6ef.slice/crio-257cb50e614ad54058443b19560222371f1366eaa324108784a8a0fc4159e8c0 WatchSource:0}: Error finding container 257cb50e614ad54058443b19560222371f1366eaa324108784a8a0fc4159e8c0: Status 404 returned error can't find the container with id 257cb50e614ad54058443b19560222371f1366eaa324108784a8a0fc4159e8c0 Jul 16 17:34:14.208617 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:14.208582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-ssqcw\" (UID: \"072cde45-4049-4434-9d7a-031a00ddb67d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:14.208787 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:14.208643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:14.208787 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:14.208735 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 17:34:14.208787 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:14.208757 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:34:14.208787 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:14.208768 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74955c86c4-qcfb5: secret "image-registry-tls" not found Jul 16 17:34:14.208911 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:14.208805 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls podName:072cde45-4049-4434-9d7a-031a00ddb67d nodeName:}" failed. No retries permitted until 2026-07-16 17:34:15.208788358 +0000 UTC m=+88.149320239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls") pod "cluster-samples-operator-65db858894-ssqcw" (UID: "072cde45-4049-4434-9d7a-031a00ddb67d") : secret "samples-operator-tls" not found Jul 16 17:34:14.208911 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:14.208820 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls podName:cad8c8fc-85a3-4855-94ba-95549f5a0419 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:15.20881334 +0000 UTC m=+88.149345223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls") pod "image-registry-74955c86c4-qcfb5" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419") : secret "image-registry-tls" not found Jul 16 17:34:14.309168 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:14.309126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:14.309168 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:14.309162 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:14.309399 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:14.309304 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 17:34:14.309399 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:14.309357 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle podName:2cc3e58e-979d-4b16-ac6c-0ecbfba2218a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:15.309333562 +0000 UTC m=+88.249865462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle") pod "router-default-888fdc5b4-t2mnk" (UID: "2cc3e58e-979d-4b16-ac6c-0ecbfba2218a") : configmap references non-existent config key: service-ca.crt Jul 16 17:34:14.309399 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:14.309386 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs podName:2cc3e58e-979d-4b16-ac6c-0ecbfba2218a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:15.309374062 +0000 UTC m=+88.249905950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs") pod "router-default-888fdc5b4-t2mnk" (UID: "2cc3e58e-979d-4b16-ac6c-0ecbfba2218a") : secret "router-metrics-certs-default" not found Jul 16 17:34:14.880759 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:14.880716 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-59wcz" event={"ID":"324b5cb9-1cd4-4c83-ab85-276957f8d6ef","Type":"ContainerStarted","Data":"ec1738a4003fbda2d5a370ba05da7f67c830e1572654a161690644d410b47a58"} Jul 16 17:34:14.881161 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:14.880770 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-59wcz" event={"ID":"324b5cb9-1cd4-4c83-ab85-276957f8d6ef","Type":"ContainerStarted","Data":"257cb50e614ad54058443b19560222371f1366eaa324108784a8a0fc4159e8c0"} Jul 16 17:34:14.898620 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:14.898486 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-59wcz" podStartSLOduration=0.983718212 podStartE2EDuration="1.898466453s" totalImagesPullingTime="914.748241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:14.897898151 +0000 UTC m=+87.838430059" watchObservedRunningTime="2026-07-16 17:34:14.898466453 +0000 UTC m=+87.838998357" Jul 16 17:34:15.215508 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:15.215409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-ssqcw\" (UID: \"072cde45-4049-4434-9d7a-031a00ddb67d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:15.215508 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:15.215478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:15.215738 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:15.215574 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:34:15.215738 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:15.215577 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 17:34:15.215738 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:15.215650 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls podName:072cde45-4049-4434-9d7a-031a00ddb67d nodeName:}" failed. No retries permitted until 2026-07-16 17:34:17.215631588 +0000 UTC m=+90.156163476 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls") pod "cluster-samples-operator-65db858894-ssqcw" (UID: "072cde45-4049-4434-9d7a-031a00ddb67d") : secret "samples-operator-tls" not found Jul 16 17:34:15.215738 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:15.215585 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74955c86c4-qcfb5: secret "image-registry-tls" not found Jul 16 17:34:15.215738 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:15.215705 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls podName:cad8c8fc-85a3-4855-94ba-95549f5a0419 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:17.215694932 +0000 UTC m=+90.156226818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls") pod "image-registry-74955c86c4-qcfb5" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419") : secret "image-registry-tls" not found Jul 16 17:34:15.316661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:15.316611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:15.316661 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:15.316663 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:15.316869 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:15.316765 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 17:34:15.316869 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:15.316778 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle podName:2cc3e58e-979d-4b16-ac6c-0ecbfba2218a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:17.316760573 +0000 UTC m=+90.257292456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle") pod "router-default-888fdc5b4-t2mnk" (UID: "2cc3e58e-979d-4b16-ac6c-0ecbfba2218a") : configmap references non-existent config key: service-ca.crt Jul 16 17:34:15.316869 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:15.316805 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs podName:2cc3e58e-979d-4b16-ac6c-0ecbfba2218a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:17.316794146 +0000 UTC m=+90.257326028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs") pod "router-default-888fdc5b4-t2mnk" (UID: "2cc3e58e-979d-4b16-ac6c-0ecbfba2218a") : secret "router-metrics-certs-default" not found Jul 16 17:34:17.229277 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:17.229211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:17.229659 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:17.229332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-ssqcw\" (UID: \"072cde45-4049-4434-9d7a-031a00ddb67d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:17.229659 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:17.229373 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:34:17.229659 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:17.229393 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74955c86c4-qcfb5: secret "image-registry-tls" not found Jul 16 17:34:17.229659 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:17.229438 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 17:34:17.229659 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:17.229449 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls podName:cad8c8fc-85a3-4855-94ba-95549f5a0419 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:21.229433661 +0000 UTC m=+94.169965548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls") pod "image-registry-74955c86c4-qcfb5" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419") : secret "image-registry-tls" not found Jul 16 17:34:17.229659 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:17.229481 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls podName:072cde45-4049-4434-9d7a-031a00ddb67d nodeName:}" failed. No retries permitted until 2026-07-16 17:34:21.229470277 +0000 UTC m=+94.170002159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls") pod "cluster-samples-operator-65db858894-ssqcw" (UID: "072cde45-4049-4434-9d7a-031a00ddb67d") : secret "samples-operator-tls" not found Jul 16 17:34:17.330013 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:17.329978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:17.330180 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:17.330021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:17.330180 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:17.330154 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle podName:2cc3e58e-979d-4b16-ac6c-0ecbfba2218a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:21.330136858 +0000 UTC m=+94.270668741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle") pod "router-default-888fdc5b4-t2mnk" (UID: "2cc3e58e-979d-4b16-ac6c-0ecbfba2218a") : configmap references non-existent config key: service-ca.crt Jul 16 17:34:17.330302 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:17.330194 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 17:34:17.330302 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:17.330268 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs podName:2cc3e58e-979d-4b16-ac6c-0ecbfba2218a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:21.330238279 +0000 UTC m=+94.270770164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs") pod "router-default-888fdc5b4-t2mnk" (UID: "2cc3e58e-979d-4b16-ac6c-0ecbfba2218a") : secret "router-metrics-certs-default" not found Jul 16 17:34:18.650959 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.650926 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kmbnr"] Jul 16 17:34:18.653561 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.653545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.658191 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.658156 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 17:34:18.658191 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.658172 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 17:34:18.658366 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.658349 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 17:34:18.658481 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.658463 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 17:34:18.658552 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.658536 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vxz8n\"" Jul 16 17:34:18.670206 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.670187 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kmbnr"] Jul 16 17:34:18.741891 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.741860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-data-volume\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.742040 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.741952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-crio-socket\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.742040 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.741991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv966\" (UniqueName: \"kubernetes.io/projected/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-api-access-hv966\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.742040 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.742014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.742160 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.742046 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.842701 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.842673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-crio-socket\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.842815 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.842710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv966\" (UniqueName: \"kubernetes.io/projected/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-api-access-hv966\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.842815 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.842734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.842815 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.842762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.842815 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.842797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-data-volume\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.842815 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.842804 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-crio-socket\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.843040 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:18.842843 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:34:18.843040 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:18.842873 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:34:18.843040 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:18.842899 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls podName:b0ec04eb-15ab-4513-a103-30a8bdcd66cf nodeName:}" failed. No retries permitted until 2026-07-16 17:34:19.342884483 +0000 UTC m=+92.283416365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmbnr" (UID: "b0ec04eb-15ab-4513-a103-30a8bdcd66cf") : secret "insights-runtime-extractor-tls" not found Jul 16 17:34:18.843040 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:18.842917 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm podName:b0ec04eb-15ab-4513-a103-30a8bdcd66cf nodeName:}" failed. No retries permitted until 2026-07-16 17:34:19.342904325 +0000 UTC m=+92.283436207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmbnr" (UID: "b0ec04eb-15ab-4513-a103-30a8bdcd66cf") : configmap "kube-rbac-proxy" not found Jul 16 17:34:18.843220 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.843046 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-data-volume\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:18.852585 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:18.852560 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv966\" (UniqueName: \"kubernetes.io/projected/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-api-access-hv966\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:19.346062 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:19.346025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:19.346234 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:19.346155 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:34:19.346298 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:19.346235 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm podName:b0ec04eb-15ab-4513-a103-30a8bdcd66cf nodeName:}" failed. No retries permitted until 2026-07-16 17:34:20.346217082 +0000 UTC m=+93.286748963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmbnr" (UID: "b0ec04eb-15ab-4513-a103-30a8bdcd66cf") : configmap "kube-rbac-proxy" not found Jul 16 17:34:19.346298 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:19.346282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:19.346395 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:19.346383 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:34:19.346429 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:19.346421 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls podName:b0ec04eb-15ab-4513-a103-30a8bdcd66cf nodeName:}" failed. No retries permitted until 2026-07-16 17:34:20.346412619 +0000 UTC m=+93.286944500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmbnr" (UID: "b0ec04eb-15ab-4513-a103-30a8bdcd66cf") : secret "insights-runtime-extractor-tls" not found Jul 16 17:34:20.353836 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:20.353775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:20.354281 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:20.353865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:20.354281 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:20.353940 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:34:20.354281 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:20.353980 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:34:20.354281 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:20.354005 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls podName:b0ec04eb-15ab-4513-a103-30a8bdcd66cf nodeName:}" failed. No retries permitted until 2026-07-16 17:34:22.353989221 +0000 UTC m=+95.294521123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmbnr" (UID: "b0ec04eb-15ab-4513-a103-30a8bdcd66cf") : secret "insights-runtime-extractor-tls" not found Jul 16 17:34:20.354281 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:20.354032 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm podName:b0ec04eb-15ab-4513-a103-30a8bdcd66cf nodeName:}" failed. No retries permitted until 2026-07-16 17:34:22.354019109 +0000 UTC m=+95.294550990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmbnr" (UID: "b0ec04eb-15ab-4513-a103-30a8bdcd66cf") : configmap "kube-rbac-proxy" not found Jul 16 17:34:21.229958 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:21.229930 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6tpzc_0c7914f1-c169-4959-9d39-56a6d052f692/dns-node-resolver/0.log" Jul 16 17:34:21.261368 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:21.261340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-ssqcw\" (UID: \"072cde45-4049-4434-9d7a-031a00ddb67d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:21.261532 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:21.261436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:21.261532 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:21.261491 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 17:34:21.261532 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:21.261529 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:34:21.261630 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:21.261539 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74955c86c4-qcfb5: secret "image-registry-tls" not found Jul 16 17:34:21.261630 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:21.261556 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls podName:072cde45-4049-4434-9d7a-031a00ddb67d nodeName:}" failed. No retries permitted until 2026-07-16 17:34:29.261538553 +0000 UTC m=+102.202070438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls") pod "cluster-samples-operator-65db858894-ssqcw" (UID: "072cde45-4049-4434-9d7a-031a00ddb67d") : secret "samples-operator-tls" not found Jul 16 17:34:21.261630 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:21.261575 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls podName:cad8c8fc-85a3-4855-94ba-95549f5a0419 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:29.261562715 +0000 UTC m=+102.202094596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls") pod "image-registry-74955c86c4-qcfb5" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419") : secret "image-registry-tls" not found Jul 16 17:34:21.362234 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:21.362200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:21.362600 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:21.362300 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:21.362600 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:21.362361 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle podName:2cc3e58e-979d-4b16-ac6c-0ecbfba2218a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:29.362344622 +0000 UTC m=+102.302876504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle") pod "router-default-888fdc5b4-t2mnk" (UID: "2cc3e58e-979d-4b16-ac6c-0ecbfba2218a") : configmap references non-existent config key: service-ca.crt Jul 16 17:34:21.362600 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:21.362417 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 17:34:21.362600 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:21.362465 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs podName:2cc3e58e-979d-4b16-ac6c-0ecbfba2218a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:29.362453691 +0000 UTC m=+102.302985573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs") pod "router-default-888fdc5b4-t2mnk" (UID: "2cc3e58e-979d-4b16-ac6c-0ecbfba2218a") : secret "router-metrics-certs-default" not found Jul 16 17:34:22.369409 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:22.369368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:22.369409 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:22.369418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:22.369841 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:22.369499 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:34:22.369841 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:22.369503 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:34:22.369841 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:22.369550 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm podName:b0ec04eb-15ab-4513-a103-30a8bdcd66cf nodeName:}" failed. No retries permitted until 2026-07-16 17:34:26.369537078 +0000 UTC m=+99.310068960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmbnr" (UID: "b0ec04eb-15ab-4513-a103-30a8bdcd66cf") : configmap "kube-rbac-proxy" not found Jul 16 17:34:22.369841 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:22.369562 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls podName:b0ec04eb-15ab-4513-a103-30a8bdcd66cf nodeName:}" failed. No retries permitted until 2026-07-16 17:34:26.369556735 +0000 UTC m=+99.310088617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmbnr" (UID: "b0ec04eb-15ab-4513-a103-30a8bdcd66cf") : secret "insights-runtime-extractor-tls" not found Jul 16 17:34:22.423331 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:22.423311 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mxbdc_26a79d40-1b3d-4683-9fdf-07f374b976b9/node-ca/0.log" Jul 16 17:34:23.424164 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:23.424127 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wk7j4_680b111a-3188-4fc7-9719-a81a6fdbdd45/serve-healthcheck-canary/0.log" Jul 16 17:34:26.401925 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:26.401881 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:26.402370 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:26.401938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:26.402370 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:26.402000 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:34:26.402370 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:26.402033 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:34:26.402370 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:26.402092 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls podName:b0ec04eb-15ab-4513-a103-30a8bdcd66cf nodeName:}" failed. No retries permitted until 2026-07-16 17:34:34.402076642 +0000 UTC m=+107.342608525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmbnr" (UID: "b0ec04eb-15ab-4513-a103-30a8bdcd66cf") : secret "insights-runtime-extractor-tls" not found Jul 16 17:34:26.402370 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:26.402160 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm podName:b0ec04eb-15ab-4513-a103-30a8bdcd66cf nodeName:}" failed. No retries permitted until 2026-07-16 17:34:34.40214172 +0000 UTC m=+107.342673603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmbnr" (UID: "b0ec04eb-15ab-4513-a103-30a8bdcd66cf") : configmap "kube-rbac-proxy" not found Jul 16 17:34:26.805527 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:26.805492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:34:26.805691 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:26.805637 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:34:26.805744 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:26.805693 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls podName:b5895f08-d52d-4dc1-9921-e4523fd27d58 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:30.805679006 +0000 UTC m=+163.746210888 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls") pod "dns-default-7d46w" (UID: "b5895f08-d52d-4dc1-9921-e4523fd27d58") : secret "dns-default-metrics-tls" not found Jul 16 17:34:29.326292 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.326240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:29.326709 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.326328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-ssqcw\" (UID: \"072cde45-4049-4434-9d7a-031a00ddb67d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:29.328698 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.328674 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/072cde45-4049-4434-9d7a-031a00ddb67d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-ssqcw\" (UID: \"072cde45-4049-4434-9d7a-031a00ddb67d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:29.328815 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.328676 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls\") pod \"image-registry-74955c86c4-qcfb5\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:29.404437 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.404399 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" Jul 16 17:34:29.427241 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.427211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:29.427377 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.427293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:29.427377 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:29.427361 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 17:34:29.427450 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:29.427423 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs podName:2cc3e58e-979d-4b16-ac6c-0ecbfba2218a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:45.427403657 +0000 UTC m=+118.367935538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs") pod "router-default-888fdc5b4-t2mnk" (UID: "2cc3e58e-979d-4b16-ac6c-0ecbfba2218a") : secret "router-metrics-certs-default" not found Jul 16 17:34:29.427450 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:29.427441 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle podName:2cc3e58e-979d-4b16-ac6c-0ecbfba2218a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:45.427432851 +0000 UTC m=+118.367964733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle") pod "router-default-888fdc5b4-t2mnk" (UID: "2cc3e58e-979d-4b16-ac6c-0ecbfba2218a") : configmap references non-existent config key: service-ca.crt Jul 16 17:34:29.451452 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.451427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:29.583396 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.583304 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw"] Jul 16 17:34:29.600163 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.600138 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74955c86c4-qcfb5"] Jul 16 17:34:29.603276 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:34:29.603228 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad8c8fc_85a3_4855_94ba_95549f5a0419.slice/crio-3a927aa087f4d191dcbf354cd153437a9d8e88436db624971471596d2f7f2388 WatchSource:0}: Error finding container 3a927aa087f4d191dcbf354cd153437a9d8e88436db624971471596d2f7f2388: Status 404 returned error can't find the container with id 3a927aa087f4d191dcbf354cd153437a9d8e88436db624971471596d2f7f2388 Jul 16 17:34:29.918362 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.918274 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" event={"ID":"cad8c8fc-85a3-4855-94ba-95549f5a0419","Type":"ContainerStarted","Data":"2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891"} Jul 16 17:34:29.918525 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.918372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" event={"ID":"cad8c8fc-85a3-4855-94ba-95549f5a0419","Type":"ContainerStarted","Data":"3a927aa087f4d191dcbf354cd153437a9d8e88436db624971471596d2f7f2388"} Jul 16 17:34:29.918525 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.918418 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:29.919390 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.919367 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" event={"ID":"072cde45-4049-4434-9d7a-031a00ddb67d","Type":"ContainerStarted","Data":"232dceab38a3b4e08f09ba657c95bb60890f6d0b3ae59606ae2a80a4a93752ad"} Jul 16 17:34:29.948483 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:29.948412 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" podStartSLOduration=16.948396367 podStartE2EDuration="16.948396367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:29.947699034 +0000 UTC m=+102.888230940" watchObservedRunningTime="2026-07-16 17:34:29.948396367 +0000 UTC m=+102.888928271" Jul 16 17:34:30.852152 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:30.852122 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rbrnn" Jul 16 17:34:31.928603 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:31.928568 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" event={"ID":"072cde45-4049-4434-9d7a-031a00ddb67d","Type":"ContainerStarted","Data":"1b4c5704a0804c7f73e81b9afd01eabd0d97a91f9121b0804523cfdea95ffd2f"} Jul 16 17:34:31.928982 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:31.928630 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" event={"ID":"072cde45-4049-4434-9d7a-031a00ddb67d","Type":"ContainerStarted","Data":"018bd8f3966d5dbc84038461d9a6c88ef3571947b289a815bfb7887c01f33702"} Jul 16 17:34:31.947448 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:31.947398 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-ssqcw" podStartSLOduration=16.800615161 podStartE2EDuration="18.947378402s" totalImagesPullingTime="2.146763241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:31.947002497 +0000 UTC m=+104.887534411" watchObservedRunningTime="2026-07-16 17:34:31.947378402 +0000 UTC m=+104.887910301" Jul 16 17:34:34.471689 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:34.471652 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:34.472271 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:34.471711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:34.472271 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:34.471850 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:34:34.472271 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:34:34.471938 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls podName:b0ec04eb-15ab-4513-a103-30a8bdcd66cf nodeName:}" failed. No retries permitted until 2026-07-16 17:34:50.471915767 +0000 UTC m=+123.412447665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmbnr" (UID: "b0ec04eb-15ab-4513-a103-30a8bdcd66cf") : secret "insights-runtime-extractor-tls" not found Jul 16 17:34:34.472737 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:34.472720 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:43.249082 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:43.249053 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74955c86c4-qcfb5"] Jul 16 17:34:45.461033 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:45.460994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:45.461473 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:45.461058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:45.461653 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:45.461632 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-service-ca-bundle\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:45.463426 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:45.463408 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc3e58e-979d-4b16-ac6c-0ecbfba2218a-metrics-certs\") pod \"router-default-888fdc5b4-t2mnk\" (UID: \"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a\") " pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:45.739872 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:45.739839 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:45.877064 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:45.877031 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-888fdc5b4-t2mnk"] Jul 16 17:34:45.881058 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:34:45.881030 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc3e58e_979d_4b16_ac6c_0ecbfba2218a.slice/crio-2546592271a48b77cc00aef7f30f67085441b1d3abfebc90df6c6abd4418afde WatchSource:0}: Error finding container 2546592271a48b77cc00aef7f30f67085441b1d3abfebc90df6c6abd4418afde: Status 404 returned error can't find the container with id 2546592271a48b77cc00aef7f30f67085441b1d3abfebc90df6c6abd4418afde Jul 16 17:34:45.968653 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:45.968616 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-888fdc5b4-t2mnk" event={"ID":"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a","Type":"ContainerStarted","Data":"d1b173f94d090edb1109aaab3213973c23c132ab6d11422a3d67343a2dd02841"} Jul 16 17:34:45.968822 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:45.968709 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-888fdc5b4-t2mnk" event={"ID":"2cc3e58e-979d-4b16-ac6c-0ecbfba2218a","Type":"ContainerStarted","Data":"2546592271a48b77cc00aef7f30f67085441b1d3abfebc90df6c6abd4418afde"} Jul 16 17:34:45.992016 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:45.991926 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-888fdc5b4-t2mnk" podStartSLOduration=32.991912914 podStartE2EDuration="32.991912914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:45.990912035 +0000 UTC m=+118.931443949" watchObservedRunningTime="2026-07-16 17:34:45.991912914 +0000 UTC m=+118.932444817" Jul 16 17:34:46.740478 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:46.740437 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:46.742774 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:46.742752 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:46.971654 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:46.971622 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:46.972907 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:46.972881 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-888fdc5b4-t2mnk" Jul 16 17:34:50.497036 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:50.496998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:50.499316 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:50.499294 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b0ec04eb-15ab-4513-a103-30a8bdcd66cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmbnr\" (UID: \"b0ec04eb-15ab-4513-a103-30a8bdcd66cf\") " pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:50.767635 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:50.767553 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vxz8n\"" Jul 16 17:34:50.775555 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:50.775535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kmbnr" Jul 16 17:34:50.902473 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:50.902444 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kmbnr"] Jul 16 17:34:50.906102 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:34:50.906070 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ec04eb_15ab_4513_a103_30a8bdcd66cf.slice/crio-8438543d762e6f8a8412d85c6987f71698f1ab26437f41c3a409bdb5ea17405a WatchSource:0}: Error finding container 8438543d762e6f8a8412d85c6987f71698f1ab26437f41c3a409bdb5ea17405a: Status 404 returned error can't find the container with id 8438543d762e6f8a8412d85c6987f71698f1ab26437f41c3a409bdb5ea17405a Jul 16 17:34:50.983452 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:50.983420 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kmbnr" event={"ID":"b0ec04eb-15ab-4513-a103-30a8bdcd66cf","Type":"ContainerStarted","Data":"8438543d762e6f8a8412d85c6987f71698f1ab26437f41c3a409bdb5ea17405a"} Jul 16 17:34:53.256032 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.256003 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:34:53.300899 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.300866 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59bb7dc6fd-9czfz"] Jul 16 17:34:53.304033 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.304006 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.309066 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.308864 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 17:34:53.309553 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.309312 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 17:34:53.309553 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.309415 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 17:34:53.309553 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.309468 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-crnhs\"" Jul 16 17:34:53.309553 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.309470 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 17:34:53.309816 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.309707 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 17:34:53.309816 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.309792 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 17:34:53.309935 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.309845 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 17:34:53.320392 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.320367 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59bb7dc6fd-9czfz"] Jul 16 17:34:53.420360 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.420328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-oauth-config\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.420537 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.420400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-serving-cert\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.420537 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.420472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-config\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.420537 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.420488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-service-ca\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.420537 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.420504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-oauth-serving-cert\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.420745 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.420542 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqw8l\" (UniqueName: \"kubernetes.io/projected/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-kube-api-access-tqw8l\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.521744 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.521652 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-serving-cert\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.521928 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.521750 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-config\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.521928 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.521768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-service-ca\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.521928 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.521784 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-oauth-serving-cert\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.521928 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.521808 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqw8l\" (UniqueName: \"kubernetes.io/projected/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-kube-api-access-tqw8l\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.521928 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.521912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-oauth-config\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.522712 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.522673 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-oauth-serving-cert\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.522848 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.522716 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-config\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.522848 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.522716 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-service-ca\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.524545 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.524521 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-oauth-config\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.524666 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.524571 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-serving-cert\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.532368 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.532347 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqw8l\" (UniqueName: \"kubernetes.io/projected/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-kube-api-access-tqw8l\") pod \"console-59bb7dc6fd-9czfz\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:53.615419 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:53.615384 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:34:55.084365 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.084320 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cc8f85575-6sgzf"] Jul 16 17:34:55.112301 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.112236 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc8f85575-6sgzf"] Jul 16 17:34:55.112476 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.112359 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.125372 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.125348 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 17:34:55.235570 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.235534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-oauth-serving-cert\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.235762 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.235607 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-serving-cert\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.235762 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.235630 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-trusted-ca-bundle\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.235762 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.235670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h9kg\" (UniqueName: \"kubernetes.io/projected/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-kube-api-access-6h9kg\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.235762 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.235714 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-service-ca\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.235762 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.235744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-oauth-config\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.236054 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.235815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-config\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.336883 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.336804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-serving-cert\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.336883 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.336839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-trusted-ca-bundle\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.336883 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.336858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h9kg\" (UniqueName: \"kubernetes.io/projected/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-kube-api-access-6h9kg\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.336883 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.336883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-service-ca\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.337307 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.337280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-oauth-config\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.337463 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.337362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-config\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.337463 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.337429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-oauth-serving-cert\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.337714 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.337664 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-service-ca\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.337804 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.337717 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-trusted-ca-bundle\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.338097 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.338075 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-oauth-serving-cert\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.338188 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.338169 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-config\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.339944 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.339923 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-oauth-config\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.340109 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.340091 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-serving-cert\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.352168 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.352135 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h9kg\" (UniqueName: \"kubernetes.io/projected/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-kube-api-access-6h9kg\") pod \"console-5cc8f85575-6sgzf\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:55.423133 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:55.423088 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:34:56.361611 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:56.361536 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59bb7dc6fd-9czfz"] Jul 16 17:34:56.365541 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:34:56.365519 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf32b3ea3_83dc_4bd1_87ac_b5e45a2dbe47.slice/crio-34526d5cc725d68caad24b83add1120be8e1a0d2ab2995f81ed09c04623cf9b9 WatchSource:0}: Error finding container 34526d5cc725d68caad24b83add1120be8e1a0d2ab2995f81ed09c04623cf9b9: Status 404 returned error can't find the container with id 34526d5cc725d68caad24b83add1120be8e1a0d2ab2995f81ed09c04623cf9b9 Jul 16 17:34:56.385643 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:56.385607 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc8f85575-6sgzf"] Jul 16 17:34:56.389315 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:34:56.389287 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3e99e8_73f2_442a_8628_2df5bd41f0d9.slice/crio-d98d37d65b14d985db18847780ac51a39d045013f1204dfe11cd74c39d0c4412 WatchSource:0}: Error finding container d98d37d65b14d985db18847780ac51a39d045013f1204dfe11cd74c39d0c4412: Status 404 returned error can't find the container with id d98d37d65b14d985db18847780ac51a39d045013f1204dfe11cd74c39d0c4412 Jul 16 17:34:57.010634 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:57.010560 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc8f85575-6sgzf" event={"ID":"aa3e99e8-73f2-442a-8628-2df5bd41f0d9","Type":"ContainerStarted","Data":"d98d37d65b14d985db18847780ac51a39d045013f1204dfe11cd74c39d0c4412"} Jul 16 17:34:57.012402 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:57.012324 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kmbnr" event={"ID":"b0ec04eb-15ab-4513-a103-30a8bdcd66cf","Type":"ContainerStarted","Data":"b66479dce8be0b6ebc3486adcf43682e0f3cbffdd9181acd3ca59d53a941afe9"} Jul 16 17:34:57.014030 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:57.014004 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bb7dc6fd-9czfz" event={"ID":"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47","Type":"ContainerStarted","Data":"34526d5cc725d68caad24b83add1120be8e1a0d2ab2995f81ed09c04623cf9b9"} Jul 16 17:34:57.252225 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:57.252145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:34:57.255082 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:57.255049 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b85996d-3bd9-427a-a197-5f43ca288506-metrics-certs\") pod \"network-metrics-daemon-4vsmt\" (UID: \"2b85996d-3bd9-427a-a197-5f43ca288506\") " pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:34:57.506190 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:57.506155 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-455gg\"" Jul 16 17:34:57.512815 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:57.512781 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vsmt" Jul 16 17:34:57.738914 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:57.738873 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4vsmt"] Jul 16 17:34:57.743498 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:34:57.743468 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b85996d_3bd9_427a_a197_5f43ca288506.slice/crio-6cb02756724aec1a0b3036719973b7f87e12f40f2de622aad5816d3701e7ae4f WatchSource:0}: Error finding container 6cb02756724aec1a0b3036719973b7f87e12f40f2de622aad5816d3701e7ae4f: Status 404 returned error can't find the container with id 6cb02756724aec1a0b3036719973b7f87e12f40f2de622aad5816d3701e7ae4f Jul 16 17:34:58.020350 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:34:58.020294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vsmt" event={"ID":"2b85996d-3bd9-427a-a197-5f43ca288506","Type":"ContainerStarted","Data":"6cb02756724aec1a0b3036719973b7f87e12f40f2de622aad5816d3701e7ae4f"} Jul 16 17:35:02.037265 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:02.037212 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kmbnr" event={"ID":"b0ec04eb-15ab-4513-a103-30a8bdcd66cf","Type":"ContainerStarted","Data":"75fe9e0dea9c0fb45ae5303e8965ce30cfc951c7d9ee44ecfa4d7f6ccd40e6ef"} Jul 16 17:35:02.039189 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:02.039146 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bb7dc6fd-9czfz" event={"ID":"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47","Type":"ContainerStarted","Data":"0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f"} Jul 16 17:35:02.041287 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:02.041135 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc8f85575-6sgzf" event={"ID":"aa3e99e8-73f2-442a-8628-2df5bd41f0d9","Type":"ContainerStarted","Data":"b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39"} Jul 16 17:35:02.043570 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:02.043538 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vsmt" event={"ID":"2b85996d-3bd9-427a-a197-5f43ca288506","Type":"ContainerStarted","Data":"08eab6f1e6df92ecd780af8f2029950700c74ce52e44ff83bdc05c05081f272d"} Jul 16 17:35:02.043693 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:02.043605 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vsmt" event={"ID":"2b85996d-3bd9-427a-a197-5f43ca288506","Type":"ContainerStarted","Data":"9068b997cd5d8b073b3bb2e60bfd48826297a916f90fda9a16ebfc83ddf799d1"} Jul 16 17:35:02.130669 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:02.130613 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59bb7dc6fd-9czfz" podStartSLOduration=4.232426166 podStartE2EDuration="9.13059786s" totalImagesPullingTime="4.898171694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:02.130160646 +0000 UTC m=+135.070692551" watchObservedRunningTime="2026-07-16 17:35:02.13059786 +0000 UTC m=+135.071129764" Jul 16 17:35:02.246407 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:02.246344 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cc8f85575-6sgzf" podStartSLOduration=2.6248154379999997 podStartE2EDuration="7.246326966s" totalImagesPullingTime="4.621511528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:02.17373303 +0000 UTC m=+135.114264935" watchObservedRunningTime="2026-07-16 17:35:02.246326966 +0000 UTC m=+135.186858847" Jul 16 17:35:02.246778 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:02.246728 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4vsmt" podStartSLOduration=131.694000543 podStartE2EDuration="2m15.246714753s" totalImagesPullingTime="3.55271421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:02.245700599 +0000 UTC m=+135.186232504" watchObservedRunningTime="2026-07-16 17:35:02.246714753 +0000 UTC m=+135.187246658" Jul 16 17:35:03.616444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:03.616400 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:35:03.616931 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:03.616474 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:35:03.621835 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:03.621804 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:35:04.058016 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:04.057980 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:35:05.058191 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:05.058152 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kmbnr" event={"ID":"b0ec04eb-15ab-4513-a103-30a8bdcd66cf","Type":"ContainerStarted","Data":"782014b9ebc20e10da955ea024bbece1195009e787a4038b191b987be9634cef"} Jul 16 17:35:05.084939 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:05.084886 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kmbnr" podStartSLOduration=33.301476162 podStartE2EDuration="47.08486778s" totalImagesPullingTime="13.783391618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:05.083610475 +0000 UTC m=+138.024142379" watchObservedRunningTime="2026-07-16 17:35:05.08486778 +0000 UTC m=+138.025399683" Jul 16 17:35:05.423714 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:05.423673 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:35:05.423877 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:05.423734 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:35:05.428187 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:05.428166 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:35:06.065340 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.065307 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:35:06.164486 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.164454 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59bb7dc6fd-9czfz"] Jul 16 17:35:06.312142 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.312112 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pxf68"] Jul 16 17:35:06.315406 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.315363 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.324595 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.324551 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kmqhb\"" Jul 16 17:35:06.325352 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.325311 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 17:35:06.325881 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.325818 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 17:35:06.326309 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.326219 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 17:35:06.326721 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.326621 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 17:35:06.327185 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.327139 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 17:35:06.331026 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.331004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59064270-e550-4975-8463-6b228ed49015-root\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.331881 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.331860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vjd5\" (UniqueName: \"kubernetes.io/projected/59064270-e550-4975-8463-6b228ed49015-kube-api-access-8vjd5\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.332012 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.331998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59064270-e550-4975-8463-6b228ed49015-sys\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.332287 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.332105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59064270-e550-4975-8463-6b228ed49015-node-exporter-tls\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.332287 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.332132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59064270-e550-4975-8463-6b228ed49015-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.332287 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.332167 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59064270-e550-4975-8463-6b228ed49015-node-exporter-textfile\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.332287 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.332219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59064270-e550-4975-8463-6b228ed49015-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.332725 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.332560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59064270-e550-4975-8463-6b228ed49015-node-exporter-wtmp\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.332725 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.332596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59064270-e550-4975-8463-6b228ed49015-metrics-client-ca\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.338764 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.338746 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 17:35:06.433570 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.433543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59064270-e550-4975-8463-6b228ed49015-node-exporter-tls\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.433570 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.433572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59064270-e550-4975-8463-6b228ed49015-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.433801 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.433595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59064270-e550-4975-8463-6b228ed49015-node-exporter-textfile\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.433801 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.433642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59064270-e550-4975-8463-6b228ed49015-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.433801 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.433705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59064270-e550-4975-8463-6b228ed49015-node-exporter-wtmp\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.433801 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.433721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59064270-e550-4975-8463-6b228ed49015-metrics-client-ca\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.433801 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.433752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59064270-e550-4975-8463-6b228ed49015-root\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.433801 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.433771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vjd5\" (UniqueName: \"kubernetes.io/projected/59064270-e550-4975-8463-6b228ed49015-kube-api-access-8vjd5\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.433801 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:35:06.433775 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 16 17:35:06.434297 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.433853 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59064270-e550-4975-8463-6b228ed49015-root\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.434297 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:35:06.433907 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59064270-e550-4975-8463-6b228ed49015-node-exporter-tls podName:59064270-e550-4975-8463-6b228ed49015 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:06.933884318 +0000 UTC m=+139.874416217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/59064270-e550-4975-8463-6b228ed49015-node-exporter-tls") pod "node-exporter-pxf68" (UID: "59064270-e550-4975-8463-6b228ed49015") : secret "node-exporter-tls" not found Jul 16 17:35:06.434297 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.433946 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59064270-e550-4975-8463-6b228ed49015-node-exporter-wtmp\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.434297 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.434004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59064270-e550-4975-8463-6b228ed49015-sys\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.434297 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.434078 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59064270-e550-4975-8463-6b228ed49015-sys\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.434297 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.434160 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59064270-e550-4975-8463-6b228ed49015-node-exporter-textfile\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.434297 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.434247 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59064270-e550-4975-8463-6b228ed49015-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.434297 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.434299 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59064270-e550-4975-8463-6b228ed49015-metrics-client-ca\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.436002 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.435978 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59064270-e550-4975-8463-6b228ed49015-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.446378 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.446355 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vjd5\" (UniqueName: \"kubernetes.io/projected/59064270-e550-4975-8463-6b228ed49015-kube-api-access-8vjd5\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.938205 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.938164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59064270-e550-4975-8463-6b228ed49015-node-exporter-tls\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:06.940706 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:06.940674 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59064270-e550-4975-8463-6b228ed49015-node-exporter-tls\") pod \"node-exporter-pxf68\" (UID: \"59064270-e550-4975-8463-6b228ed49015\") " pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:07.224112 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:07.224032 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pxf68" Jul 16 17:35:07.235725 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:35:07.235696 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59064270_e550_4975_8463_6b228ed49015.slice/crio-24edbaacd5a9dda0e6fd53c0355cf6c07096ace76c4dbc92afd504d3eaa50656 WatchSource:0}: Error finding container 24edbaacd5a9dda0e6fd53c0355cf6c07096ace76c4dbc92afd504d3eaa50656: Status 404 returned error can't find the container with id 24edbaacd5a9dda0e6fd53c0355cf6c07096ace76c4dbc92afd504d3eaa50656 Jul 16 17:35:08.070439 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.070402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxf68" event={"ID":"59064270-e550-4975-8463-6b228ed49015","Type":"ContainerStarted","Data":"24edbaacd5a9dda0e6fd53c0355cf6c07096ace76c4dbc92afd504d3eaa50656"} Jul 16 17:35:08.268542 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.268495 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" podUID="cad8c8fc-85a3-4855-94ba-95549f5a0419" containerName="registry" containerID="cri-o://2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891" gracePeriod=30 Jul 16 17:35:08.522217 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.522188 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:35:08.552074 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.552024 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz2q7\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-kube-api-access-wz2q7\") pod \"cad8c8fc-85a3-4855-94ba-95549f5a0419\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " Jul 16 17:35:08.552074 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.552067 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-certificates\") pod \"cad8c8fc-85a3-4855-94ba-95549f5a0419\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " Jul 16 17:35:08.552359 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.552109 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cad8c8fc-85a3-4855-94ba-95549f5a0419-trusted-ca\") pod \"cad8c8fc-85a3-4855-94ba-95549f5a0419\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " Jul 16 17:35:08.552359 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.552137 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cad8c8fc-85a3-4855-94ba-95549f5a0419-ca-trust-extracted\") pod \"cad8c8fc-85a3-4855-94ba-95549f5a0419\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " Jul 16 17:35:08.552359 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.552176 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cad8c8fc-85a3-4855-94ba-95549f5a0419-installation-pull-secrets\") pod \"cad8c8fc-85a3-4855-94ba-95549f5a0419\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " Jul 16 17:35:08.552518 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.552410 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls\") pod \"cad8c8fc-85a3-4855-94ba-95549f5a0419\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " Jul 16 17:35:08.552518 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.552469 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-bound-sa-token\") pod \"cad8c8fc-85a3-4855-94ba-95549f5a0419\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " Jul 16 17:35:08.552624 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.552530 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cad8c8fc-85a3-4855-94ba-95549f5a0419-image-registry-private-configuration\") pod \"cad8c8fc-85a3-4855-94ba-95549f5a0419\" (UID: \"cad8c8fc-85a3-4855-94ba-95549f5a0419\") " Jul 16 17:35:08.553018 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.552762 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cad8c8fc-85a3-4855-94ba-95549f5a0419" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:35:08.553018 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.552879 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-certificates\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:08.555464 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.555435 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cad8c8fc-85a3-4855-94ba-95549f5a0419-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cad8c8fc-85a3-4855-94ba-95549f5a0419" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:35:08.555890 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.555859 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cad8c8fc-85a3-4855-94ba-95549f5a0419" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:35:08.555984 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.555950 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cad8c8fc-85a3-4855-94ba-95549f5a0419-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cad8c8fc-85a3-4855-94ba-95549f5a0419" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:35:08.556027 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.556004 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cad8c8fc-85a3-4855-94ba-95549f5a0419-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cad8c8fc-85a3-4855-94ba-95549f5a0419" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:35:08.556078 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.556060 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-kube-api-access-wz2q7" (OuterVolumeSpecName: "kube-api-access-wz2q7") pod "cad8c8fc-85a3-4855-94ba-95549f5a0419" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419"). InnerVolumeSpecName "kube-api-access-wz2q7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:35:08.556167 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.556146 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cad8c8fc-85a3-4855-94ba-95549f5a0419" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:35:08.561663 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.561639 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cad8c8fc-85a3-4855-94ba-95549f5a0419-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cad8c8fc-85a3-4855-94ba-95549f5a0419" (UID: "cad8c8fc-85a3-4855-94ba-95549f5a0419"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:35:08.654243 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.654164 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-registry-tls\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:08.654243 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.654199 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-bound-sa-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:08.654243 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.654214 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cad8c8fc-85a3-4855-94ba-95549f5a0419-image-registry-private-configuration\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:08.654243 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.654228 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz2q7\" (UniqueName: \"kubernetes.io/projected/cad8c8fc-85a3-4855-94ba-95549f5a0419-kube-api-access-wz2q7\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:08.654243 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.654241 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cad8c8fc-85a3-4855-94ba-95549f5a0419-trusted-ca\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:08.654520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.654275 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cad8c8fc-85a3-4855-94ba-95549f5a0419-ca-trust-extracted\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:08.654520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:08.654288 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cad8c8fc-85a3-4855-94ba-95549f5a0419-installation-pull-secrets\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:09.074701 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.074665 2577 generic.go:356] "Generic (PLEG): container finished" podID="cad8c8fc-85a3-4855-94ba-95549f5a0419" containerID="2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891" exitCode=0 Jul 16 17:35:09.074871 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.074729 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" Jul 16 17:35:09.074871 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.074736 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" event={"ID":"cad8c8fc-85a3-4855-94ba-95549f5a0419","Type":"ContainerDied","Data":"2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891"} Jul 16 17:35:09.074871 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.074790 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74955c86c4-qcfb5" event={"ID":"cad8c8fc-85a3-4855-94ba-95549f5a0419","Type":"ContainerDied","Data":"3a927aa087f4d191dcbf354cd153437a9d8e88436db624971471596d2f7f2388"} Jul 16 17:35:09.074871 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.074811 2577 scope.go:117] "RemoveContainer" containerID="2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891" Jul 16 17:35:09.076437 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.076409 2577 generic.go:356] "Generic (PLEG): container finished" podID="59064270-e550-4975-8463-6b228ed49015" containerID="a9f11f4ba42ad2f38d3ff4e89ebd545e3095b65c628044b69b3350e355419abc" exitCode=0 Jul 16 17:35:09.076586 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.076447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxf68" event={"ID":"59064270-e550-4975-8463-6b228ed49015","Type":"ContainerDied","Data":"a9f11f4ba42ad2f38d3ff4e89ebd545e3095b65c628044b69b3350e355419abc"} Jul 16 17:35:09.083223 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.083207 2577 scope.go:117] "RemoveContainer" containerID="2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891" Jul 16 17:35:09.083560 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:35:09.083533 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891\": container with ID starting with 2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891 not found: ID does not exist" containerID="2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891" Jul 16 17:35:09.083651 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.083565 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891"} err="failed to get container status \"2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891\": rpc error: code = NotFound desc = could not find container \"2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891\": container with ID starting with 2e46797193bc2574e15691ba081d7e9cbea9c46b83983eeab8d2c2dd17ae2891 not found: ID does not exist" Jul 16 17:35:09.126211 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.126183 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74955c86c4-qcfb5"] Jul 16 17:35:09.130437 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.130412 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74955c86c4-qcfb5"] Jul 16 17:35:09.293116 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.293083 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68fd4c6647-tb5fb"] Jul 16 17:35:09.293486 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.293328 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad8c8fc-85a3-4855-94ba-95549f5a0419" containerName="registry" Jul 16 17:35:09.293486 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.293338 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad8c8fc-85a3-4855-94ba-95549f5a0419" containerName="registry" Jul 16 17:35:09.293486 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.293391 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cad8c8fc-85a3-4855-94ba-95549f5a0419" containerName="registry" Jul 16 17:35:09.296565 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.296542 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.298982 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.298959 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 16 17:35:09.299160 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.299140 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 16 17:35:09.299245 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.299193 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 16 17:35:09.299245 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.299193 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bdv6h\"" Jul 16 17:35:09.299806 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.299790 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 16 17:35:09.299844 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.299835 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-31dh39gckkiba\"" Jul 16 17:35:09.299965 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.299952 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 16 17:35:09.311770 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.311743 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68fd4c6647-tb5fb"] Jul 16 17:35:09.359784 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.359706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjlnk\" (UniqueName: \"kubernetes.io/projected/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-kube-api-access-sjlnk\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.359784 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.359744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.359784 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.359781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.360031 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.359833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.360031 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.359872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-tls\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.360031 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.359915 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.360031 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.359991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-metrics-client-ca\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.360031 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.360008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-grpc-tls\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.461330 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.461294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-metrics-client-ca\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.461330 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.461330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-grpc-tls\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.461554 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.461350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjlnk\" (UniqueName: \"kubernetes.io/projected/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-kube-api-access-sjlnk\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.461554 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.461411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.461656 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.461565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.461656 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.461606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.461656 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.461639 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-tls\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.461817 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.461688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.462289 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.462221 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-metrics-client-ca\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.464103 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.464079 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.464217 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.464120 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.464427 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.464403 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.464489 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.464424 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.464489 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.464443 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-thanos-querier-tls\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.464489 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.464449 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-secret-grpc-tls\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.473916 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.473898 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjlnk\" (UniqueName: \"kubernetes.io/projected/d08a3099-62b3-484c-bfa7-5e3e369ed7ec-kube-api-access-sjlnk\") pod \"thanos-querier-68fd4c6647-tb5fb\" (UID: \"d08a3099-62b3-484c-bfa7-5e3e369ed7ec\") " pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.578080 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.578048 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cad8c8fc-85a3-4855-94ba-95549f5a0419" path="/var/lib/kubelet/pods/cad8c8fc-85a3-4855-94ba-95549f5a0419/volumes" Jul 16 17:35:09.606845 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.606820 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:09.751491 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:09.751455 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68fd4c6647-tb5fb"] Jul 16 17:35:09.755713 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:35:09.755689 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08a3099_62b3_484c_bfa7_5e3e369ed7ec.slice/crio-357863ce76c1bb524f028d85198cafb8c0f1eb9f49576588164845060564954c WatchSource:0}: Error finding container 357863ce76c1bb524f028d85198cafb8c0f1eb9f49576588164845060564954c: Status 404 returned error can't find the container with id 357863ce76c1bb524f028d85198cafb8c0f1eb9f49576588164845060564954c Jul 16 17:35:10.080772 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.080737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" event={"ID":"d08a3099-62b3-484c-bfa7-5e3e369ed7ec","Type":"ContainerStarted","Data":"357863ce76c1bb524f028d85198cafb8c0f1eb9f49576588164845060564954c"} Jul 16 17:35:10.083509 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.083484 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxf68" event={"ID":"59064270-e550-4975-8463-6b228ed49015","Type":"ContainerStarted","Data":"dd89b68871c445847c203c210a8c077e9a7f8b239392f346bba53bc11fe6338f"} Jul 16 17:35:10.083630 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.083528 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxf68" event={"ID":"59064270-e550-4975-8463-6b228ed49015","Type":"ContainerStarted","Data":"74a2fc1019adc0cc0795c71497a58ac2a8e8ac571e99a18f815bae84d403c354"} Jul 16 17:35:10.107162 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.107086 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pxf68" podStartSLOduration=2.8431015090000002 podStartE2EDuration="4.107069677s" totalImagesPullingTime="1.194230747s" totalInitContainerRuntime="69.737421ms" isStatefulPod=true podCreationTimestamp="2026-07-16 17:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:10.106220875 +0000 UTC m=+143.046752779" watchObservedRunningTime="2026-07-16 17:35:10.107069677 +0000 UTC m=+143.047601581" Jul 16 17:35:10.929035 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.928995 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fd45c5557-4jdbk"] Jul 16 17:35:10.933429 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.933396 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:10.952499 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.952475 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fd45c5557-4jdbk"] Jul 16 17:35:10.975122 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.975085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-oauth-config\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:10.975305 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.975138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-serving-cert\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:10.975305 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.975181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv76c\" (UniqueName: \"kubernetes.io/projected/93a073f8-c01b-4e9a-87e0-18b51c40da44-kube-api-access-jv76c\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:10.975305 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.975217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-trusted-ca-bundle\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:10.975305 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.975288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-oauth-serving-cert\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:10.975512 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.975338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-config\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:10.975512 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:10.975399 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-service-ca\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.076056 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.076022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-oauth-config\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.076237 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.076064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-serving-cert\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.076237 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.076099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv76c\" (UniqueName: \"kubernetes.io/projected/93a073f8-c01b-4e9a-87e0-18b51c40da44-kube-api-access-jv76c\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.076396 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.076371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-trusted-ca-bundle\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.076452 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.076423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-oauth-serving-cert\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.076452 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.076442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-config\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.076559 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.076471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-service-ca\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.077513 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.077441 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-trusted-ca-bundle\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.077513 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.077445 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-oauth-serving-cert\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.078110 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.078019 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-service-ca\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.078206 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.078188 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-config\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.079119 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.079096 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-oauth-config\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.079696 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.079671 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-serving-cert\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.087704 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.087684 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv76c\" (UniqueName: \"kubernetes.io/projected/93a073f8-c01b-4e9a-87e0-18b51c40da44-kube-api-access-jv76c\") pod \"console-5fd45c5557-4jdbk\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.245965 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.245927 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:11.379943 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:11.379863 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fd45c5557-4jdbk"] Jul 16 17:35:11.383866 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:35:11.383835 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a073f8_c01b_4e9a_87e0_18b51c40da44.slice/crio-df7140111fc58d3f0e262918a7d6c03f8a521e537cebdefeed650e179f9952e8 WatchSource:0}: Error finding container df7140111fc58d3f0e262918a7d6c03f8a521e537cebdefeed650e179f9952e8: Status 404 returned error can't find the container with id df7140111fc58d3f0e262918a7d6c03f8a521e537cebdefeed650e179f9952e8 Jul 16 17:35:12.096951 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.096913 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" event={"ID":"d08a3099-62b3-484c-bfa7-5e3e369ed7ec","Type":"ContainerStarted","Data":"c14de0a8d42f045feec2d80e8018837ff14d6cb50bae840067cdb4f13e380205"} Jul 16 17:35:12.097331 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.097006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" event={"ID":"d08a3099-62b3-484c-bfa7-5e3e369ed7ec","Type":"ContainerStarted","Data":"41548911d7d582d4851737f5e67e51653d3f5c17cd1ad7ef5f4272d5179d1d55"} Jul 16 17:35:12.098738 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.098711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd45c5557-4jdbk" event={"ID":"93a073f8-c01b-4e9a-87e0-18b51c40da44","Type":"ContainerStarted","Data":"26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e"} Jul 16 17:35:12.098849 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.098759 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd45c5557-4jdbk" event={"ID":"93a073f8-c01b-4e9a-87e0-18b51c40da44","Type":"ContainerStarted","Data":"df7140111fc58d3f0e262918a7d6c03f8a521e537cebdefeed650e179f9952e8"} Jul 16 17:35:12.125882 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.125690 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fd45c5557-4jdbk" podStartSLOduration=2.125673155 podStartE2EDuration="2.125673155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:12.124605528 +0000 UTC m=+145.065137432" watchObservedRunningTime="2026-07-16 17:35:12.125673155 +0000 UTC m=+145.066205059" Jul 16 17:35:12.639082 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.639048 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 17:35:12.642709 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.642693 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.648981 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.648930 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 17:35:12.649065 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.649048 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 17:35:12.649162 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.649145 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 17:35:12.650645 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.650625 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2a3k8tev8nseq\"" Jul 16 17:35:12.650773 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.650727 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 17:35:12.650840 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.650787 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 17:35:12.650908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.650872 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 17:35:12.651784 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.651767 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 17:35:12.651881 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.651770 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wc2gs\"" Jul 16 17:35:12.652538 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.652526 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 17:35:12.653283 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.653265 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 17:35:12.653414 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.653302 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 17:35:12.653480 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.653468 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 17:35:12.653532 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.653500 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 17:35:12.654471 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.654455 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 17:35:12.665082 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.665064 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 17:35:12.667825 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.667803 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 17:35:12.679429 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.679402 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 17:35:12.691496 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691599 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/929b3d71-de06-4835-a999-ed1dd938291d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691599 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691599 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-web-config\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691599 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mpb2\" (UniqueName: \"kubernetes.io/projected/929b3d71-de06-4835-a999-ed1dd938291d-kube-api-access-4mpb2\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691770 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691770 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691666 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691770 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691690 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691770 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691770 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691943 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691943 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691943 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691943 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.691943 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.692130 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.691977 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.692130 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.692019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-config\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.692130 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.692043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/929b3d71-de06-4835-a999-ed1dd938291d-config-out\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.692130 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.692066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.692130 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.692093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.792973 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.792935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.792973 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.792976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793189 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793189 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793189 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-config\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793189 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/929b3d71-de06-4835-a999-ed1dd938291d-config-out\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793189 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793189 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793189 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793189 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/929b3d71-de06-4835-a999-ed1dd938291d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793624 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793624 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-web-config\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793624 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mpb2\" (UniqueName: \"kubernetes.io/projected/929b3d71-de06-4835-a999-ed1dd938291d-kube-api-access-4mpb2\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793624 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793624 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793624 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793384 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793624 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793624 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793624 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.793624 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.794099 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.793994 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.794228 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.794205 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.795279 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.795227 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.795542 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.795520 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.796844 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.796650 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.796844 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.796679 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.798159 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.796991 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.798159 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.797092 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.798159 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.797412 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.798159 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.797537 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-config\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.798159 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.797551 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.798159 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.797603 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.798159 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.797983 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.798159 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.798090 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.798159 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.798122 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/929b3d71-de06-4835-a999-ed1dd938291d-config-out\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.798991 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.798967 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.799222 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.799205 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-web-config\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.799641 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.799616 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.799764 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.799744 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/929b3d71-de06-4835-a999-ed1dd938291d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.819632 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.819606 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mpb2\" (UniqueName: \"kubernetes.io/projected/929b3d71-de06-4835-a999-ed1dd938291d-kube-api-access-4mpb2\") pod \"prometheus-k8s-0\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:12.952323 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:12.952226 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:13.105347 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:13.105293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" event={"ID":"d08a3099-62b3-484c-bfa7-5e3e369ed7ec","Type":"ContainerStarted","Data":"b617b03c91b03cbab71fd46fb35cad97d5e253e95482a7e7075a723ede224951"} Jul 16 17:35:13.106036 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:13.106017 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 17:35:13.108881 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:35:13.108855 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod929b3d71_de06_4835_a999_ed1dd938291d.slice/crio-24d937ef26fd52351fb8b518cac9f2b6f659fb85a08c819712aa924bac2972aa WatchSource:0}: Error finding container 24d937ef26fd52351fb8b518cac9f2b6f659fb85a08c819712aa924bac2972aa: Status 404 returned error can't find the container with id 24d937ef26fd52351fb8b518cac9f2b6f659fb85a08c819712aa924bac2972aa Jul 16 17:35:14.113531 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:14.113483 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" event={"ID":"d08a3099-62b3-484c-bfa7-5e3e369ed7ec","Type":"ContainerStarted","Data":"09ff98e1d1193d63216ed09d618dd232a524500419682581ee1b1ba6a170c8d9"} Jul 16 17:35:14.114028 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:14.113565 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" event={"ID":"d08a3099-62b3-484c-bfa7-5e3e369ed7ec","Type":"ContainerStarted","Data":"4bef6d20ddebda2901bd638b1df5e460b89acba6c87c7ca85bfe70de05a34906"} Jul 16 17:35:14.114028 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:14.113604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" event={"ID":"d08a3099-62b3-484c-bfa7-5e3e369ed7ec","Type":"ContainerStarted","Data":"3a5103fea5eb24146f963060d00b8ff9cbb854649fa35539c9260772bd04bcad"} Jul 16 17:35:14.114028 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:14.113649 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:14.114930 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:14.114899 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerStarted","Data":"24d937ef26fd52351fb8b518cac9f2b6f659fb85a08c819712aa924bac2972aa"} Jul 16 17:35:14.149787 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:14.149734 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" podStartSLOduration=1.602967952 podStartE2EDuration="5.149716034s" totalImagesPullingTime="3.546748082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:14.14764594 +0000 UTC m=+147.088177872" watchObservedRunningTime="2026-07-16 17:35:14.149716034 +0000 UTC m=+147.090247939" Jul 16 17:35:15.120371 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:15.120336 2577 generic.go:356] "Generic (PLEG): container finished" podID="929b3d71-de06-4835-a999-ed1dd938291d" containerID="acfe30c93268222912b0f332f1f589cb8c6ce115c8f0f686f22fa783ad8a76b0" exitCode=0 Jul 16 17:35:15.120746 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:15.120418 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerDied","Data":"acfe30c93268222912b0f332f1f589cb8c6ce115c8f0f686f22fa783ad8a76b0"} Jul 16 17:35:18.135587 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:18.135542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerStarted","Data":"3055dd1ca65052248a97739dfbd843b3be8bdf16efc74117887a8f9b364e0a5e"} Jul 16 17:35:19.142674 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:19.142637 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerStarted","Data":"20a46ab5be1fa86332f9709ed74111bade7f0682f7cf7405b57f17ea40c98715"} Jul 16 17:35:19.143117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:19.142715 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerStarted","Data":"76e7c2bbd79914761aadf4f42a29e3e61ba3b4b9c7d707f1247c4dd7eb32deb6"} Jul 16 17:35:19.143117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:19.142758 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerStarted","Data":"65de7f916c19c354a9598aca29b8db64661299af8fd1586635b8a40bb5c339c0"} Jul 16 17:35:19.143117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:19.142803 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerStarted","Data":"3f62a8d3a74edf30ae1e5295363eb8c44f94f44c86cfcde304e928066dd05913"} Jul 16 17:35:19.143117 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:19.142844 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerStarted","Data":"8807785b3bbd6fee1cf95cd667678ff5eb10102d04ea2b4dfbc906de5cfba85f"} Jul 16 17:35:19.182230 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:19.182171 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.123758528 podStartE2EDuration="7.182150779s" totalImagesPullingTime="4.041215806s" totalInitContainerRuntime="17.176445ms" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:19.180221087 +0000 UTC m=+152.120752990" watchObservedRunningTime="2026-07-16 17:35:19.182150779 +0000 UTC m=+152.122682685" Jul 16 17:35:20.128207 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:20.128179 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68fd4c6647-tb5fb" Jul 16 17:35:21.246319 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:21.246286 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:21.246723 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:21.246372 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:21.250891 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:21.250863 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:22.157370 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:22.157344 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:35:22.221511 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:22.221480 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cc8f85575-6sgzf"] Jul 16 17:35:22.952834 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:22.952790 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:35:25.896818 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:35:25.896770 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7d46w" podUID="b5895f08-d52d-4dc1-9921-e4523fd27d58" Jul 16 17:35:26.167754 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:26.167675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7d46w" Jul 16 17:35:30.849134 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:30.849098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:35:30.851533 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:30.851504 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5895f08-d52d-4dc1-9921-e4523fd27d58-metrics-tls\") pod \"dns-default-7d46w\" (UID: \"b5895f08-d52d-4dc1-9921-e4523fd27d58\") " pod="openshift-dns/dns-default-7d46w" Jul 16 17:35:30.973069 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:30.973038 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7tn9x\"" Jul 16 17:35:30.979965 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:30.979940 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7d46w" Jul 16 17:35:31.280020 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:31.279989 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7d46w"] Jul 16 17:35:31.282829 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:35:31.282803 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5895f08_d52d_4dc1_9921_e4523fd27d58.slice/crio-eed5bef92a5c9978b62f1adb64c27c7a1c43319ae67cf8e683159669d2827363 WatchSource:0}: Error finding container eed5bef92a5c9978b62f1adb64c27c7a1c43319ae67cf8e683159669d2827363: Status 404 returned error can't find the container with id eed5bef92a5c9978b62f1adb64c27c7a1c43319ae67cf8e683159669d2827363 Jul 16 17:35:32.083917 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.083863 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59bb7dc6fd-9czfz" podUID="f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47" containerName="console" containerID="cri-o://0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f" gracePeriod=15 Jul 16 17:35:32.201394 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.201353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7d46w" event={"ID":"b5895f08-d52d-4dc1-9921-e4523fd27d58","Type":"ContainerStarted","Data":"eed5bef92a5c9978b62f1adb64c27c7a1c43319ae67cf8e683159669d2827363"} Jul 16 17:35:32.385209 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.385145 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:35:32.463036 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.462018 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqw8l\" (UniqueName: \"kubernetes.io/projected/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-kube-api-access-tqw8l\") pod \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " Jul 16 17:35:32.463036 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.462074 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-config\") pod \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " Jul 16 17:35:32.463036 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.462118 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-oauth-serving-cert\") pod \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " Jul 16 17:35:32.463036 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.462162 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-serving-cert\") pod \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " Jul 16 17:35:32.463036 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.462201 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-oauth-config\") pod \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " Jul 16 17:35:32.463036 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.462242 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-service-ca\") pod \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\" (UID: \"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47\") " Jul 16 17:35:32.463036 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.462968 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47" (UID: "f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:35:32.463554 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.463186 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-service-ca" (OuterVolumeSpecName: "service-ca") pod "f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47" (UID: "f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:35:32.463554 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.463479 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-config" (OuterVolumeSpecName: "console-config") pod "f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47" (UID: "f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:35:32.466148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.466118 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47" (UID: "f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:35:32.466648 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.466624 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47" (UID: "f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:35:32.466785 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.466767 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-kube-api-access-tqw8l" (OuterVolumeSpecName: "kube-api-access-tqw8l") pod "f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47" (UID: "f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47"). InnerVolumeSpecName "kube-api-access-tqw8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:35:32.563647 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.563607 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-oauth-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:32.563647 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.563639 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:32.563647 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.563652 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-oauth-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:32.563888 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.563666 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-service-ca\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:32.563888 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.563679 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqw8l\" (UniqueName: \"kubernetes.io/projected/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-kube-api-access-tqw8l\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:32.563888 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:32.563691 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47-console-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:33.206635 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:33.206598 2577 generic.go:356] "Generic (PLEG): container finished" podID="f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47" containerID="0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f" exitCode=0 Jul 16 17:35:33.207214 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:33.206648 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bb7dc6fd-9czfz" Jul 16 17:35:33.207214 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:33.206688 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bb7dc6fd-9czfz" event={"ID":"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47","Type":"ContainerDied","Data":"0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f"} Jul 16 17:35:33.207214 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:33.206744 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bb7dc6fd-9czfz" event={"ID":"f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47","Type":"ContainerDied","Data":"34526d5cc725d68caad24b83add1120be8e1a0d2ab2995f81ed09c04623cf9b9"} Jul 16 17:35:33.207214 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:33.206766 2577 scope.go:117] "RemoveContainer" containerID="0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f" Jul 16 17:35:33.246581 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:33.246542 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59bb7dc6fd-9czfz"] Jul 16 17:35:33.256561 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:33.256525 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59bb7dc6fd-9czfz"] Jul 16 17:35:33.569740 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:33.569720 2577 scope.go:117] "RemoveContainer" containerID="0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f" Jul 16 17:35:33.570090 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:35:33.570070 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f\": container with ID starting with 0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f not found: ID does not exist" containerID="0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f" Jul 16 17:35:33.570140 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:33.570102 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f"} err="failed to get container status \"0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f\": rpc error: code = NotFound desc = could not find container \"0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f\": container with ID starting with 0acd1d84de730f4d0466bbb8a1e84fedd9a528e4f74ca85be61c130e27fda29f not found: ID does not exist" Jul 16 17:35:33.577677 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:33.577653 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47" path="/var/lib/kubelet/pods/f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47/volumes" Jul 16 17:35:34.213038 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:34.212950 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7d46w" event={"ID":"b5895f08-d52d-4dc1-9921-e4523fd27d58","Type":"ContainerStarted","Data":"4f6c55c4e24bc24ad73c535b668b1d6e09a930a43d76aa09ce06903765251f47"} Jul 16 17:35:34.213038 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:34.213007 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7d46w" event={"ID":"b5895f08-d52d-4dc1-9921-e4523fd27d58","Type":"ContainerStarted","Data":"ef9a056e12322b29e38e3a98ad9cc2062fadc6e8f2f69561528222eb48c5a574"} Jul 16 17:35:34.213542 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:34.213043 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7d46w" Jul 16 17:35:34.237703 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:34.237648 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7d46w" podStartSLOduration=129.730371524 podStartE2EDuration="2m12.237630639s" totalImagesPullingTime="2.507259115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:34.236615048 +0000 UTC m=+167.177146951" watchObservedRunningTime="2026-07-16 17:35:34.237630639 +0000 UTC m=+167.178162542" Jul 16 17:35:44.221017 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:44.220936 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7d46w" Jul 16 17:35:47.242734 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.242692 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cc8f85575-6sgzf" podUID="aa3e99e8-73f2-442a-8628-2df5bd41f0d9" containerName="console" containerID="cri-o://b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39" gracePeriod=15 Jul 16 17:35:47.519657 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.519586 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:35:47.604349 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.604315 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-config\") pod \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " Jul 16 17:35:47.604525 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.604368 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-oauth-serving-cert\") pod \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " Jul 16 17:35:47.604525 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.604418 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-service-ca\") pod \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " Jul 16 17:35:47.604525 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.604443 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h9kg\" (UniqueName: \"kubernetes.io/projected/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-kube-api-access-6h9kg\") pod \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " Jul 16 17:35:47.604525 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.604481 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-trusted-ca-bundle\") pod \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " Jul 16 17:35:47.604855 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.604760 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-config" (OuterVolumeSpecName: "console-config") pod "aa3e99e8-73f2-442a-8628-2df5bd41f0d9" (UID: "aa3e99e8-73f2-442a-8628-2df5bd41f0d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:35:47.604963 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.604872 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "aa3e99e8-73f2-442a-8628-2df5bd41f0d9" (UID: "aa3e99e8-73f2-442a-8628-2df5bd41f0d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:35:47.604963 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.604882 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aa3e99e8-73f2-442a-8628-2df5bd41f0d9" (UID: "aa3e99e8-73f2-442a-8628-2df5bd41f0d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:35:47.604963 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.604941 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aa3e99e8-73f2-442a-8628-2df5bd41f0d9" (UID: "aa3e99e8-73f2-442a-8628-2df5bd41f0d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:35:47.606637 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.606615 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-kube-api-access-6h9kg" (OuterVolumeSpecName: "kube-api-access-6h9kg") pod "aa3e99e8-73f2-442a-8628-2df5bd41f0d9" (UID: "aa3e99e8-73f2-442a-8628-2df5bd41f0d9"). InnerVolumeSpecName "kube-api-access-6h9kg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:35:47.705224 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.705185 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-serving-cert\") pod \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " Jul 16 17:35:47.705224 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.705224 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-oauth-config\") pod \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\" (UID: \"aa3e99e8-73f2-442a-8628-2df5bd41f0d9\") " Jul 16 17:35:47.705448 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.705407 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-service-ca\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:47.705448 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.705419 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h9kg\" (UniqueName: \"kubernetes.io/projected/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-kube-api-access-6h9kg\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:47.705448 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.705428 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-trusted-ca-bundle\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:47.705448 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.705436 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:47.705448 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.705444 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-oauth-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:47.707373 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.707335 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aa3e99e8-73f2-442a-8628-2df5bd41f0d9" (UID: "aa3e99e8-73f2-442a-8628-2df5bd41f0d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:35:47.707490 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.707403 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aa3e99e8-73f2-442a-8628-2df5bd41f0d9" (UID: "aa3e99e8-73f2-442a-8628-2df5bd41f0d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:35:47.805812 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.805722 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:47.805812 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:47.805752 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa3e99e8-73f2-442a-8628-2df5bd41f0d9-console-oauth-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:35:48.267206 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:48.267176 2577 generic.go:356] "Generic (PLEG): container finished" podID="aa3e99e8-73f2-442a-8628-2df5bd41f0d9" containerID="b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39" exitCode=0 Jul 16 17:35:48.267617 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:48.267223 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc8f85575-6sgzf" Jul 16 17:35:48.267617 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:48.267243 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc8f85575-6sgzf" event={"ID":"aa3e99e8-73f2-442a-8628-2df5bd41f0d9","Type":"ContainerDied","Data":"b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39"} Jul 16 17:35:48.267617 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:48.267302 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc8f85575-6sgzf" event={"ID":"aa3e99e8-73f2-442a-8628-2df5bd41f0d9","Type":"ContainerDied","Data":"d98d37d65b14d985db18847780ac51a39d045013f1204dfe11cd74c39d0c4412"} Jul 16 17:35:48.267617 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:48.267324 2577 scope.go:117] "RemoveContainer" containerID="b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39" Jul 16 17:35:48.276174 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:48.276153 2577 scope.go:117] "RemoveContainer" containerID="b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39" Jul 16 17:35:48.276701 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:35:48.276666 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39\": container with ID starting with b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39 not found: ID does not exist" containerID="b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39" Jul 16 17:35:48.276795 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:48.276706 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39"} err="failed to get container status \"b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39\": rpc error: code = NotFound desc = could not find container \"b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39\": container with ID starting with b3f0ff21d05c88ae749fd34a243def61865585cae7200e865ad86d418fe7ff39 not found: ID does not exist" Jul 16 17:35:48.301175 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:48.301115 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cc8f85575-6sgzf"] Jul 16 17:35:48.309960 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:48.309823 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cc8f85575-6sgzf"] Jul 16 17:35:49.578449 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:35:49.578418 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa3e99e8-73f2-442a-8628-2df5bd41f0d9" path="/var/lib/kubelet/pods/aa3e99e8-73f2-442a-8628-2df5bd41f0d9/volumes" Jul 16 17:36:12.953414 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:12.953378 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:12.969128 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:12.969099 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:13.373923 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:13.373896 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:31.284134 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.284102 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 17:36:31.284677 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.284480 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="prometheus" containerID="cri-o://3055dd1ca65052248a97739dfbd843b3be8bdf16efc74117887a8f9b364e0a5e" gracePeriod=600 Jul 16 17:36:31.284677 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.284517 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="kube-rbac-proxy" containerID="cri-o://76e7c2bbd79914761aadf4f42a29e3e61ba3b4b9c7d707f1247c4dd7eb32deb6" gracePeriod=600 Jul 16 17:36:31.284677 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.284550 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="kube-rbac-proxy-web" containerID="cri-o://65de7f916c19c354a9598aca29b8db64661299af8fd1586635b8a40bb5c339c0" gracePeriod=600 Jul 16 17:36:31.284677 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.284576 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="config-reloader" containerID="cri-o://8807785b3bbd6fee1cf95cd667678ff5eb10102d04ea2b4dfbc906de5cfba85f" gracePeriod=600 Jul 16 17:36:31.284677 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.284538 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="thanos-sidecar" containerID="cri-o://3f62a8d3a74edf30ae1e5295363eb8c44f94f44c86cfcde304e928066dd05913" gracePeriod=600 Jul 16 17:36:31.284677 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.284550 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://20a46ab5be1fa86332f9709ed74111bade7f0682f7cf7405b57f17ea40c98715" gracePeriod=600 Jul 16 17:36:31.426665 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.426636 2577 generic.go:356] "Generic (PLEG): container finished" podID="929b3d71-de06-4835-a999-ed1dd938291d" containerID="20a46ab5be1fa86332f9709ed74111bade7f0682f7cf7405b57f17ea40c98715" exitCode=0 Jul 16 17:36:31.426665 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.426659 2577 generic.go:356] "Generic (PLEG): container finished" podID="929b3d71-de06-4835-a999-ed1dd938291d" containerID="76e7c2bbd79914761aadf4f42a29e3e61ba3b4b9c7d707f1247c4dd7eb32deb6" exitCode=0 Jul 16 17:36:31.426665 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.426667 2577 generic.go:356] "Generic (PLEG): container finished" podID="929b3d71-de06-4835-a999-ed1dd938291d" containerID="65de7f916c19c354a9598aca29b8db64661299af8fd1586635b8a40bb5c339c0" exitCode=0 Jul 16 17:36:31.426665 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.426672 2577 generic.go:356] "Generic (PLEG): container finished" podID="929b3d71-de06-4835-a999-ed1dd938291d" containerID="3f62a8d3a74edf30ae1e5295363eb8c44f94f44c86cfcde304e928066dd05913" exitCode=0 Jul 16 17:36:31.426897 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.426678 2577 generic.go:356] "Generic (PLEG): container finished" podID="929b3d71-de06-4835-a999-ed1dd938291d" containerID="8807785b3bbd6fee1cf95cd667678ff5eb10102d04ea2b4dfbc906de5cfba85f" exitCode=0 Jul 16 17:36:31.426897 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.426683 2577 generic.go:356] "Generic (PLEG): container finished" podID="929b3d71-de06-4835-a999-ed1dd938291d" containerID="3055dd1ca65052248a97739dfbd843b3be8bdf16efc74117887a8f9b364e0a5e" exitCode=0 Jul 16 17:36:31.426897 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.426712 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerDied","Data":"20a46ab5be1fa86332f9709ed74111bade7f0682f7cf7405b57f17ea40c98715"} Jul 16 17:36:31.426897 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.426799 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerDied","Data":"76e7c2bbd79914761aadf4f42a29e3e61ba3b4b9c7d707f1247c4dd7eb32deb6"} Jul 16 17:36:31.426897 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.426843 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerDied","Data":"65de7f916c19c354a9598aca29b8db64661299af8fd1586635b8a40bb5c339c0"} Jul 16 17:36:31.426897 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.426883 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerDied","Data":"3f62a8d3a74edf30ae1e5295363eb8c44f94f44c86cfcde304e928066dd05913"} Jul 16 17:36:31.427067 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.426924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerDied","Data":"8807785b3bbd6fee1cf95cd667678ff5eb10102d04ea2b4dfbc906de5cfba85f"} Jul 16 17:36:31.427067 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.426962 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerDied","Data":"3055dd1ca65052248a97739dfbd843b3be8bdf16efc74117887a8f9b364e0a5e"} Jul 16 17:36:31.524200 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.524178 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:31.658307 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658215 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-config\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658307 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658276 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/929b3d71-de06-4835-a999-ed1dd938291d-config-out\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658307 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658296 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-serving-certs-ca-bundle\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658565 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658320 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-web-config\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658565 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658416 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-grpc-tls\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658565 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658448 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658565 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658481 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-trusted-ca-bundle\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658565 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658509 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-metrics-client-ca\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658565 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658533 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-kube-rbac-proxy\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658565 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658564 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-2\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658630 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mpb2\" (UniqueName: \"kubernetes.io/projected/929b3d71-de06-4835-a999-ed1dd938291d-kube-api-access-4mpb2\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658661 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-tls\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658687 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-metrics-client-certs\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658711 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-thanos-prometheus-http-client-file\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658733 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:31.658908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658753 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658779 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-0\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658810 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-1\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658845 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-db\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.658908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658890 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-kubelet-serving-ca-bundle\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.659488 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.658926 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/929b3d71-de06-4835-a999-ed1dd938291d-tls-assets\") pod \"929b3d71-de06-4835-a999-ed1dd938291d\" (UID: \"929b3d71-de06-4835-a999-ed1dd938291d\") " Jul 16 17:36:31.659488 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.659059 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:31.659781 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.659548 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:31.659781 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.659634 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.659781 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.659681 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:31.659991 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.659864 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:31.661780 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.660316 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:31.661780 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.660808 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.661780 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.661310 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:36:31.661780 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.661681 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:36:31.662020 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.661958 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:31.662179 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.662138 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:31.663004 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.662970 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:31.663335 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.663274 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/929b3d71-de06-4835-a999-ed1dd938291d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:36:31.663335 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.663291 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:31.663335 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.663328 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:31.663521 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.663340 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/929b3d71-de06-4835-a999-ed1dd938291d-config-out" (OuterVolumeSpecName: "config-out") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:36:31.663521 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.663375 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-config" (OuterVolumeSpecName: "config") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:31.663632 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.663611 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:31.663935 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.663920 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/929b3d71-de06-4835-a999-ed1dd938291d-kube-api-access-4mpb2" (OuterVolumeSpecName: "kube-api-access-4mpb2") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "kube-api-access-4mpb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:36:31.664591 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.664568 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:31.673035 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.673017 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-web-config" (OuterVolumeSpecName: "web-config") pod "929b3d71-de06-4835-a999-ed1dd938291d" (UID: "929b3d71-de06-4835-a999-ed1dd938291d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:36:31.761719 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761682 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-grpc-tls\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761719 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761714 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761719 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761727 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761740 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-metrics-client-ca\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761751 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-kube-rbac-proxy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761763 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mpb2\" (UniqueName: \"kubernetes.io/projected/929b3d71-de06-4835-a999-ed1dd938291d-kube-api-access-4mpb2\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761778 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761789 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-metrics-client-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761801 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761814 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761827 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761847 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761859 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/929b3d71-de06-4835-a999-ed1dd938291d-prometheus-k8s-db\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761871 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/929b3d71-de06-4835-a999-ed1dd938291d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761883 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/929b3d71-de06-4835-a999-ed1dd938291d-tls-assets\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761896 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761910 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/929b3d71-de06-4835-a999-ed1dd938291d-config-out\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:31.761983 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:31.761922 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/929b3d71-de06-4835-a999-ed1dd938291d-web-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:36:32.437538 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.437501 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"929b3d71-de06-4835-a999-ed1dd938291d","Type":"ContainerDied","Data":"24d937ef26fd52351fb8b518cac9f2b6f659fb85a08c819712aa924bac2972aa"} Jul 16 17:36:32.437538 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.437536 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.437987 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.437599 2577 scope.go:117] "RemoveContainer" containerID="20a46ab5be1fa86332f9709ed74111bade7f0682f7cf7405b57f17ea40c98715" Jul 16 17:36:32.446549 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.446530 2577 scope.go:117] "RemoveContainer" containerID="76e7c2bbd79914761aadf4f42a29e3e61ba3b4b9c7d707f1247c4dd7eb32deb6" Jul 16 17:36:32.453224 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.453209 2577 scope.go:117] "RemoveContainer" containerID="65de7f916c19c354a9598aca29b8db64661299af8fd1586635b8a40bb5c339c0" Jul 16 17:36:32.459482 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.459466 2577 scope.go:117] "RemoveContainer" containerID="3f62a8d3a74edf30ae1e5295363eb8c44f94f44c86cfcde304e928066dd05913" Jul 16 17:36:32.465195 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.465171 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 17:36:32.465868 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.465855 2577 scope.go:117] "RemoveContainer" containerID="8807785b3bbd6fee1cf95cd667678ff5eb10102d04ea2b4dfbc906de5cfba85f" Jul 16 17:36:32.471460 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.471440 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 17:36:32.472944 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.472919 2577 scope.go:117] "RemoveContainer" containerID="3055dd1ca65052248a97739dfbd843b3be8bdf16efc74117887a8f9b364e0a5e" Jul 16 17:36:32.479746 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.479732 2577 scope.go:117] "RemoveContainer" containerID="acfe30c93268222912b0f332f1f589cb8c6ce115c8f0f686f22fa783ad8a76b0" Jul 16 17:36:32.502576 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502556 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 17:36:32.502845 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502831 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa3e99e8-73f2-442a-8628-2df5bd41f0d9" containerName="console" Jul 16 17:36:32.502916 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502849 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa3e99e8-73f2-442a-8628-2df5bd41f0d9" containerName="console" Jul 16 17:36:32.502916 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502860 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47" containerName="console" Jul 16 17:36:32.502916 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502869 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47" containerName="console" Jul 16 17:36:32.502916 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502882 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="kube-rbac-proxy-web" Jul 16 17:36:32.502916 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502892 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="kube-rbac-proxy-web" Jul 16 17:36:32.502916 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502902 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="kube-rbac-proxy" Jul 16 17:36:32.502916 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502911 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="kube-rbac-proxy" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502926 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="init-config-reloader" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502934 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="init-config-reloader" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502947 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="config-reloader" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502955 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="config-reloader" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502966 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="kube-rbac-proxy-thanos" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502975 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="kube-rbac-proxy-thanos" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.502992 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="prometheus" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.503001 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="prometheus" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.503015 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="thanos-sidecar" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.503024 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="thanos-sidecar" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.503086 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="kube-rbac-proxy" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.503097 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="config-reloader" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.503107 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa3e99e8-73f2-442a-8628-2df5bd41f0d9" containerName="console" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.503116 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f32b3ea3-83dc-4bd1-87ac-b5e45a2dbe47" containerName="console" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.503125 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="kube-rbac-proxy-web" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.503132 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="kube-rbac-proxy-thanos" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.503141 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="thanos-sidecar" Jul 16 17:36:32.503294 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.503149 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="929b3d71-de06-4835-a999-ed1dd938291d" containerName="prometheus" Jul 16 17:36:32.508456 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.508438 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.512712 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.512694 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 17:36:32.513298 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.513285 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 17:36:32.513373 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.513344 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 17:36:32.513508 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.513491 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 17:36:32.513508 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.513499 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 17:36:32.513866 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.513543 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 17:36:32.513866 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.513584 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2a3k8tev8nseq\"" Jul 16 17:36:32.513866 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.513635 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wc2gs\"" Jul 16 17:36:32.514123 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.514105 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 17:36:32.514182 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.514111 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 17:36:32.514182 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.514153 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 17:36:32.514645 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.514507 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 17:36:32.514645 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.514516 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 17:36:32.514645 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.514519 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 17:36:32.514645 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.514509 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 17:36:32.518920 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.518902 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 17:36:32.520311 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.520297 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 17:36:32.530591 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.530566 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 17:36:32.667283 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-web-config\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667283 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667218 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbff22df-bbe5-4b24-bdd3-952773ca3a01-config-out\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667283 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667237 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667498 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhxzk\" (UniqueName: \"kubernetes.io/projected/bbff22df-bbe5-4b24-bdd3-952773ca3a01-kube-api-access-jhxzk\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667498 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667343 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667498 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667498 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667498 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667498 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667453 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-config\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667498 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667693 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667509 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667693 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667693 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667693 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667693 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667693 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667693 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667693 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667680 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667916 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbff22df-bbe5-4b24-bdd3-952773ca3a01-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.667916 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.667714 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.768521 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.768521 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.768750 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.768750 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbff22df-bbe5-4b24-bdd3-952773ca3a01-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.768750 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.768750 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-web-config\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.768750 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbff22df-bbe5-4b24-bdd3-952773ca3a01-config-out\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.768750 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.768750 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768689 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhxzk\" (UniqueName: \"kubernetes.io/projected/bbff22df-bbe5-4b24-bdd3-952773ca3a01-kube-api-access-jhxzk\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.768750 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.769202 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.769202 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.769202 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.769202 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-config\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.769202 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.769202 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.769202 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768957 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.769202 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.768986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.769202 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.769012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.769202 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.769056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.769712 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.769452 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.770168 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.769985 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.770286 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.770142 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.770516 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.770488 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.770771 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.770744 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.770850 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.770798 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.771483 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.771455 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.771844 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.771822 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbff22df-bbe5-4b24-bdd3-952773ca3a01-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.773343 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.772790 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-web-config\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.773343 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.773302 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.773556 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.773536 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-config\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.773614 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.773591 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.773895 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.773844 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbff22df-bbe5-4b24-bdd3-952773ca3a01-config-out\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.774043 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.774006 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.774043 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.774026 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.774330 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.774304 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bbff22df-bbe5-4b24-bdd3-952773ca3a01-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.774496 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.774476 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.774541 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.774522 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.775217 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.775199 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbff22df-bbe5-4b24-bdd3-952773ca3a01-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.779667 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.779644 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhxzk\" (UniqueName: \"kubernetes.io/projected/bbff22df-bbe5-4b24-bdd3-952773ca3a01-kube-api-access-jhxzk\") pod \"prometheus-k8s-0\" (UID: \"bbff22df-bbe5-4b24-bdd3-952773ca3a01\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.817735 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.817698 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:32.964486 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:32.964397 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 17:36:32.967652 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:36:32.967623 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbff22df_bbe5_4b24_bdd3_952773ca3a01.slice/crio-4bd9c3337e0b50aff47d2d637154b0250d644468b25d66f33725576880f4603c WatchSource:0}: Error finding container 4bd9c3337e0b50aff47d2d637154b0250d644468b25d66f33725576880f4603c: Status 404 returned error can't find the container with id 4bd9c3337e0b50aff47d2d637154b0250d644468b25d66f33725576880f4603c Jul 16 17:36:33.443971 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:33.443932 2577 generic.go:356] "Generic (PLEG): container finished" podID="bbff22df-bbe5-4b24-bdd3-952773ca3a01" containerID="862b253a466e248ac2d7c57210d00a964d4f3a1a6b121b30d58315ea23e46501" exitCode=0 Jul 16 17:36:33.444372 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:33.444010 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbff22df-bbe5-4b24-bdd3-952773ca3a01","Type":"ContainerDied","Data":"862b253a466e248ac2d7c57210d00a964d4f3a1a6b121b30d58315ea23e46501"} Jul 16 17:36:33.444372 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:33.444074 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbff22df-bbe5-4b24-bdd3-952773ca3a01","Type":"ContainerStarted","Data":"4bd9c3337e0b50aff47d2d637154b0250d644468b25d66f33725576880f4603c"} Jul 16 17:36:33.583289 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:33.583183 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="929b3d71-de06-4835-a999-ed1dd938291d" path="/var/lib/kubelet/pods/929b3d71-de06-4835-a999-ed1dd938291d/volumes" Jul 16 17:36:34.451336 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.451298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbff22df-bbe5-4b24-bdd3-952773ca3a01","Type":"ContainerStarted","Data":"6d2968765d40a796b86a87bc31d3cb4dec9e7e47e2e824d96361334d07b2c4da"} Jul 16 17:36:34.451854 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.451363 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbff22df-bbe5-4b24-bdd3-952773ca3a01","Type":"ContainerStarted","Data":"0686b1fadad1e83478e7f8514b833cefa3d92e42886ab283245c16506bdfdff3"} Jul 16 17:36:34.451854 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.451390 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbff22df-bbe5-4b24-bdd3-952773ca3a01","Type":"ContainerStarted","Data":"b0c3e092ae01faac06db7acf18f5e3fc0fb76f65d83eaae1b9bb1b3443cd7f15"} Jul 16 17:36:34.451854 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.451414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbff22df-bbe5-4b24-bdd3-952773ca3a01","Type":"ContainerStarted","Data":"820f718da2d057eef7e8ae64cfa14595c6c3285ffe27149cad806af231ecc5b4"} Jul 16 17:36:34.451854 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.451439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbff22df-bbe5-4b24-bdd3-952773ca3a01","Type":"ContainerStarted","Data":"d4bfed2250ba399d4616b65323944c0d73322586bc2be3ca9dd911089f1aff21"} Jul 16 17:36:34.451854 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.451462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bbff22df-bbe5-4b24-bdd3-952773ca3a01","Type":"ContainerStarted","Data":"0cded2e139a9517f7e7b2b3e0655134440cae302e3b4e9d1e47a4a569e1821ec"} Jul 16 17:36:34.479168 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.479138 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b79ddd6fc-s4ps9"] Jul 16 17:36:34.482331 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.482314 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.485429 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.485378 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.467570873 podStartE2EDuration="2.485360316s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.789443ms" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:34.483487359 +0000 UTC m=+227.424019265" watchObservedRunningTime="2026-07-16 17:36:34.485360316 +0000 UTC m=+227.425892220" Jul 16 17:36:34.493357 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.493336 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b79ddd6fc-s4ps9"] Jul 16 17:36:34.582768 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.582717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-service-ca\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.582998 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.582976 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b868d977-e563-45fc-9727-8fb534d42c35-console-serving-cert\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.583085 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.583072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-console-config\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.583141 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.583104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsn9n\" (UniqueName: \"kubernetes.io/projected/b868d977-e563-45fc-9727-8fb534d42c35-kube-api-access-rsn9n\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.583207 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.583177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-oauth-serving-cert\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.583516 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.583304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b868d977-e563-45fc-9727-8fb534d42c35-console-oauth-config\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.583516 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.583379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-trusted-ca-bundle\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.684805 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.684758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsn9n\" (UniqueName: \"kubernetes.io/projected/b868d977-e563-45fc-9727-8fb534d42c35-kube-api-access-rsn9n\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.684805 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.684809 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-oauth-serving-cert\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.685021 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.684844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b868d977-e563-45fc-9727-8fb534d42c35-console-oauth-config\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.685021 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.684877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-trusted-ca-bundle\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.685104 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.685078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-service-ca\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.685156 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.685135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b868d977-e563-45fc-9727-8fb534d42c35-console-serving-cert\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.685207 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.685181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-console-config\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.685619 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.685592 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-oauth-serving-cert\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.685777 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.685754 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-service-ca\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.685777 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.685771 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-trusted-ca-bundle\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.685977 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.685819 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-console-config\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.687413 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.687387 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b868d977-e563-45fc-9727-8fb534d42c35-console-oauth-config\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.687508 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.687448 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b868d977-e563-45fc-9727-8fb534d42c35-console-serving-cert\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.693615 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.693589 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsn9n\" (UniqueName: \"kubernetes.io/projected/b868d977-e563-45fc-9727-8fb534d42c35-kube-api-access-rsn9n\") pod \"console-7b79ddd6fc-s4ps9\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.792908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.792864 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:34.926274 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:34.926232 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b79ddd6fc-s4ps9"] Jul 16 17:36:34.928433 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:36:34.928410 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb868d977_e563_45fc_9727_8fb534d42c35.slice/crio-8366bfe392366c6c1b8141f3047013a2a8f190640b04c86c0aef00e9f5731bf4 WatchSource:0}: Error finding container 8366bfe392366c6c1b8141f3047013a2a8f190640b04c86c0aef00e9f5731bf4: Status 404 returned error can't find the container with id 8366bfe392366c6c1b8141f3047013a2a8f190640b04c86c0aef00e9f5731bf4 Jul 16 17:36:35.457359 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:35.457324 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b79ddd6fc-s4ps9" event={"ID":"b868d977-e563-45fc-9727-8fb534d42c35","Type":"ContainerStarted","Data":"3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7"} Jul 16 17:36:35.457747 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:35.457373 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b79ddd6fc-s4ps9" event={"ID":"b868d977-e563-45fc-9727-8fb534d42c35","Type":"ContainerStarted","Data":"8366bfe392366c6c1b8141f3047013a2a8f190640b04c86c0aef00e9f5731bf4"} Jul 16 17:36:35.482973 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:35.482909 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b79ddd6fc-s4ps9" podStartSLOduration=1.482892936 podStartE2EDuration="1.482892936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:35.481799723 +0000 UTC m=+228.422331639" watchObservedRunningTime="2026-07-16 17:36:35.482892936 +0000 UTC m=+228.423424839" Jul 16 17:36:37.818689 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:37.818640 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:36:44.793982 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:44.793940 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:44.794520 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:44.794012 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:44.798708 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:44.798685 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:45.501417 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:45.501388 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:36:45.558968 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:36:45.558936 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fd45c5557-4jdbk"] Jul 16 17:37:10.582462 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.582355 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5fd45c5557-4jdbk" podUID="93a073f8-c01b-4e9a-87e0-18b51c40da44" containerName="console" containerID="cri-o://26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e" gracePeriod=15 Jul 16 17:37:10.825494 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.825470 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:37:10.871933 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.871866 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-trusted-ca-bundle\") pod \"93a073f8-c01b-4e9a-87e0-18b51c40da44\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " Jul 16 17:37:10.871933 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.871902 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv76c\" (UniqueName: \"kubernetes.io/projected/93a073f8-c01b-4e9a-87e0-18b51c40da44-kube-api-access-jv76c\") pod \"93a073f8-c01b-4e9a-87e0-18b51c40da44\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " Jul 16 17:37:10.871933 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.871930 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-oauth-serving-cert\") pod \"93a073f8-c01b-4e9a-87e0-18b51c40da44\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " Jul 16 17:37:10.872146 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.871978 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-oauth-config\") pod \"93a073f8-c01b-4e9a-87e0-18b51c40da44\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " Jul 16 17:37:10.872146 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.872008 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-serving-cert\") pod \"93a073f8-c01b-4e9a-87e0-18b51c40da44\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " Jul 16 17:37:10.872146 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.872035 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-service-ca\") pod \"93a073f8-c01b-4e9a-87e0-18b51c40da44\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " Jul 16 17:37:10.872146 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.872062 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-config\") pod \"93a073f8-c01b-4e9a-87e0-18b51c40da44\" (UID: \"93a073f8-c01b-4e9a-87e0-18b51c40da44\") " Jul 16 17:37:10.872402 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.872370 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "93a073f8-c01b-4e9a-87e0-18b51c40da44" (UID: "93a073f8-c01b-4e9a-87e0-18b51c40da44"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:37:10.872471 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.872445 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "93a073f8-c01b-4e9a-87e0-18b51c40da44" (UID: "93a073f8-c01b-4e9a-87e0-18b51c40da44"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:37:10.872555 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.872530 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-service-ca" (OuterVolumeSpecName: "service-ca") pod "93a073f8-c01b-4e9a-87e0-18b51c40da44" (UID: "93a073f8-c01b-4e9a-87e0-18b51c40da44"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:37:10.872652 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.872627 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-config" (OuterVolumeSpecName: "console-config") pod "93a073f8-c01b-4e9a-87e0-18b51c40da44" (UID: "93a073f8-c01b-4e9a-87e0-18b51c40da44"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:37:10.874080 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.874057 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93a073f8-c01b-4e9a-87e0-18b51c40da44-kube-api-access-jv76c" (OuterVolumeSpecName: "kube-api-access-jv76c") pod "93a073f8-c01b-4e9a-87e0-18b51c40da44" (UID: "93a073f8-c01b-4e9a-87e0-18b51c40da44"). InnerVolumeSpecName "kube-api-access-jv76c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:37:10.874599 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.874574 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "93a073f8-c01b-4e9a-87e0-18b51c40da44" (UID: "93a073f8-c01b-4e9a-87e0-18b51c40da44"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:37:10.874599 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.874587 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "93a073f8-c01b-4e9a-87e0-18b51c40da44" (UID: "93a073f8-c01b-4e9a-87e0-18b51c40da44"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:37:10.972831 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.972794 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-trusted-ca-bundle\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:37:10.972831 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.972824 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv76c\" (UniqueName: \"kubernetes.io/projected/93a073f8-c01b-4e9a-87e0-18b51c40da44-kube-api-access-jv76c\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:37:10.972831 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.972837 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-oauth-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:37:10.973058 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.972849 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-oauth-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:37:10.973058 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.972860 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:37:10.973058 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.972872 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-service-ca\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:37:10.973058 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:10.972883 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93a073f8-c01b-4e9a-87e0-18b51c40da44-console-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:37:11.591588 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:11.591560 2577 generic.go:356] "Generic (PLEG): container finished" podID="93a073f8-c01b-4e9a-87e0-18b51c40da44" containerID="26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e" exitCode=0 Jul 16 17:37:11.591936 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:11.591610 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd45c5557-4jdbk" Jul 16 17:37:11.591936 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:11.591622 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd45c5557-4jdbk" event={"ID":"93a073f8-c01b-4e9a-87e0-18b51c40da44","Type":"ContainerDied","Data":"26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e"} Jul 16 17:37:11.591936 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:11.591658 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd45c5557-4jdbk" event={"ID":"93a073f8-c01b-4e9a-87e0-18b51c40da44","Type":"ContainerDied","Data":"df7140111fc58d3f0e262918a7d6c03f8a521e537cebdefeed650e179f9952e8"} Jul 16 17:37:11.591936 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:11.591677 2577 scope.go:117] "RemoveContainer" containerID="26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e" Jul 16 17:37:11.599682 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:11.599662 2577 scope.go:117] "RemoveContainer" containerID="26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e" Jul 16 17:37:11.599940 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:37:11.599922 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e\": container with ID starting with 26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e not found: ID does not exist" containerID="26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e" Jul 16 17:37:11.600007 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:11.599959 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e"} err="failed to get container status \"26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e\": rpc error: code = NotFound desc = could not find container \"26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e\": container with ID starting with 26aa43663549eac989e8ce7e2949d676d429c697ab82c4a454ca11af746f2a9e not found: ID does not exist" Jul 16 17:37:11.609319 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:11.609296 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fd45c5557-4jdbk"] Jul 16 17:37:11.613823 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:11.613803 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fd45c5557-4jdbk"] Jul 16 17:37:13.577472 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:13.577438 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93a073f8-c01b-4e9a-87e0-18b51c40da44" path="/var/lib/kubelet/pods/93a073f8-c01b-4e9a-87e0-18b51c40da44/volumes" Jul 16 17:37:32.818497 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:32.818458 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:37:32.833593 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:32.833568 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:37:33.684791 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:33.684759 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 17:37:47.388659 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:47.388632 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:37:47.391594 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:47.391574 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:37:47.392835 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:47.392817 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 17:37:52.447226 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.447187 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ddb7d89d6-gsrdj"] Jul 16 17:37:52.449678 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.447730 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93a073f8-c01b-4e9a-87e0-18b51c40da44" containerName="console" Jul 16 17:37:52.449678 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.447746 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="93a073f8-c01b-4e9a-87e0-18b51c40da44" containerName="console" Jul 16 17:37:52.449678 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.447800 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="93a073f8-c01b-4e9a-87e0-18b51c40da44" containerName="console" Jul 16 17:37:52.450541 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.450521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.467288 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.467264 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ddb7d89d6-gsrdj"] Jul 16 17:37:52.503896 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.503870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-console-config\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.504017 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.503910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-trusted-ca-bundle\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.504017 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.503948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-oauth-serving-cert\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.504017 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.503975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cc40c4e-98ba-4746-9f42-6248f307af95-console-serving-cert\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.504017 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.503999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cc40c4e-98ba-4746-9f42-6248f307af95-console-oauth-config\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.504195 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.504021 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-service-ca\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.504195 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.504090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdmch\" (UniqueName: \"kubernetes.io/projected/4cc40c4e-98ba-4746-9f42-6248f307af95-kube-api-access-mdmch\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.605334 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.605303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-oauth-serving-cert\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.605334 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.605339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cc40c4e-98ba-4746-9f42-6248f307af95-console-serving-cert\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.605540 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.605365 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cc40c4e-98ba-4746-9f42-6248f307af95-console-oauth-config\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.605540 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.605479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-service-ca\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.605540 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.605533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdmch\" (UniqueName: \"kubernetes.io/projected/4cc40c4e-98ba-4746-9f42-6248f307af95-kube-api-access-mdmch\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.605694 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.605564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-console-config\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.605694 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.605618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-trusted-ca-bundle\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.606176 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.606151 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-oauth-serving-cert\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.606347 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.606321 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-service-ca\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.606492 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.606469 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-console-config\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.606577 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.606560 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-trusted-ca-bundle\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.607972 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.607953 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cc40c4e-98ba-4746-9f42-6248f307af95-console-oauth-config\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.608068 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.608052 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cc40c4e-98ba-4746-9f42-6248f307af95-console-serving-cert\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.615583 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.615563 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdmch\" (UniqueName: \"kubernetes.io/projected/4cc40c4e-98ba-4746-9f42-6248f307af95-kube-api-access-mdmch\") pod \"console-5ddb7d89d6-gsrdj\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.760032 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.760012 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:37:52.890283 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:52.890237 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ddb7d89d6-gsrdj"] Jul 16 17:37:52.893143 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:37:52.893117 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc40c4e_98ba_4746_9f42_6248f307af95.slice/crio-f03830b5b025a3f377ffc6945fab419fa7e4bc94e33811a3d2e96b3270baf7ab WatchSource:0}: Error finding container f03830b5b025a3f377ffc6945fab419fa7e4bc94e33811a3d2e96b3270baf7ab: Status 404 returned error can't find the container with id f03830b5b025a3f377ffc6945fab419fa7e4bc94e33811a3d2e96b3270baf7ab Jul 16 17:37:53.742614 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:53.742577 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddb7d89d6-gsrdj" event={"ID":"4cc40c4e-98ba-4746-9f42-6248f307af95","Type":"ContainerStarted","Data":"b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb"} Jul 16 17:37:53.743034 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:53.742632 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddb7d89d6-gsrdj" event={"ID":"4cc40c4e-98ba-4746-9f42-6248f307af95","Type":"ContainerStarted","Data":"f03830b5b025a3f377ffc6945fab419fa7e4bc94e33811a3d2e96b3270baf7ab"} Jul 16 17:37:53.766128 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:37:53.766082 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5ddb7d89d6-gsrdj" podStartSLOduration=1.76606727 podStartE2EDuration="1.76606727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:37:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:37:53.764616478 +0000 UTC m=+306.705148393" watchObservedRunningTime="2026-07-16 17:37:53.76606727 +0000 UTC m=+306.706599175" Jul 16 17:38:02.760775 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:02.760733 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:38:02.761181 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:02.760819 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:38:02.765738 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:02.765716 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:38:02.776575 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:02.776553 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:38:02.855616 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:02.855579 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b79ddd6fc-s4ps9"] Jul 16 17:38:27.877099 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:27.877057 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b79ddd6fc-s4ps9" podUID="b868d977-e563-45fc-9727-8fb534d42c35" containerName="console" containerID="cri-o://3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7" gracePeriod=15 Jul 16 17:38:28.112930 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.112906 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:38:28.194075 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.193996 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b868d977-e563-45fc-9727-8fb534d42c35-console-oauth-config\") pod \"b868d977-e563-45fc-9727-8fb534d42c35\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " Jul 16 17:38:28.194075 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.194047 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-service-ca\") pod \"b868d977-e563-45fc-9727-8fb534d42c35\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " Jul 16 17:38:28.194075 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.194071 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-console-config\") pod \"b868d977-e563-45fc-9727-8fb534d42c35\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " Jul 16 17:38:28.194378 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.194095 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-trusted-ca-bundle\") pod \"b868d977-e563-45fc-9727-8fb534d42c35\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " Jul 16 17:38:28.194378 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.194124 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsn9n\" (UniqueName: \"kubernetes.io/projected/b868d977-e563-45fc-9727-8fb534d42c35-kube-api-access-rsn9n\") pod \"b868d977-e563-45fc-9727-8fb534d42c35\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " Jul 16 17:38:28.194378 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.194147 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b868d977-e563-45fc-9727-8fb534d42c35-console-serving-cert\") pod \"b868d977-e563-45fc-9727-8fb534d42c35\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " Jul 16 17:38:28.194378 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.194168 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-oauth-serving-cert\") pod \"b868d977-e563-45fc-9727-8fb534d42c35\" (UID: \"b868d977-e563-45fc-9727-8fb534d42c35\") " Jul 16 17:38:28.194638 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.194572 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-console-config" (OuterVolumeSpecName: "console-config") pod "b868d977-e563-45fc-9727-8fb534d42c35" (UID: "b868d977-e563-45fc-9727-8fb534d42c35"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:38:28.194696 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.194653 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b868d977-e563-45fc-9727-8fb534d42c35" (UID: "b868d977-e563-45fc-9727-8fb534d42c35"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:38:28.194696 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.194684 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b868d977-e563-45fc-9727-8fb534d42c35" (UID: "b868d977-e563-45fc-9727-8fb534d42c35"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:38:28.194802 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.194710 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-service-ca" (OuterVolumeSpecName: "service-ca") pod "b868d977-e563-45fc-9727-8fb534d42c35" (UID: "b868d977-e563-45fc-9727-8fb534d42c35"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:38:28.196215 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.196191 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b868d977-e563-45fc-9727-8fb534d42c35-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b868d977-e563-45fc-9727-8fb534d42c35" (UID: "b868d977-e563-45fc-9727-8fb534d42c35"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:38:28.196340 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.196218 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b868d977-e563-45fc-9727-8fb534d42c35-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b868d977-e563-45fc-9727-8fb534d42c35" (UID: "b868d977-e563-45fc-9727-8fb534d42c35"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:38:28.196340 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.196301 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b868d977-e563-45fc-9727-8fb534d42c35-kube-api-access-rsn9n" (OuterVolumeSpecName: "kube-api-access-rsn9n") pod "b868d977-e563-45fc-9727-8fb534d42c35" (UID: "b868d977-e563-45fc-9727-8fb534d42c35"). InnerVolumeSpecName "kube-api-access-rsn9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:38:28.295060 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.295016 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-service-ca\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:38:28.295060 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.295054 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-console-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:38:28.295060 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.295063 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-trusted-ca-bundle\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:38:28.295060 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.295072 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsn9n\" (UniqueName: \"kubernetes.io/projected/b868d977-e563-45fc-9727-8fb534d42c35-kube-api-access-rsn9n\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:38:28.295332 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.295081 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b868d977-e563-45fc-9727-8fb534d42c35-console-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:38:28.295332 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.295089 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b868d977-e563-45fc-9727-8fb534d42c35-oauth-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:38:28.295332 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.295098 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b868d977-e563-45fc-9727-8fb534d42c35-console-oauth-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:38:28.865591 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.865553 2577 generic.go:356] "Generic (PLEG): container finished" podID="b868d977-e563-45fc-9727-8fb534d42c35" containerID="3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7" exitCode=0 Jul 16 17:38:28.865758 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.865598 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b79ddd6fc-s4ps9" Jul 16 17:38:28.865758 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.865637 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b79ddd6fc-s4ps9" event={"ID":"b868d977-e563-45fc-9727-8fb534d42c35","Type":"ContainerDied","Data":"3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7"} Jul 16 17:38:28.865758 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.865689 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b79ddd6fc-s4ps9" event={"ID":"b868d977-e563-45fc-9727-8fb534d42c35","Type":"ContainerDied","Data":"8366bfe392366c6c1b8141f3047013a2a8f190640b04c86c0aef00e9f5731bf4"} Jul 16 17:38:28.865758 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.865708 2577 scope.go:117] "RemoveContainer" containerID="3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7" Jul 16 17:38:28.875723 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.875705 2577 scope.go:117] "RemoveContainer" containerID="3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7" Jul 16 17:38:28.876009 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:38:28.875985 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7\": container with ID starting with 3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7 not found: ID does not exist" containerID="3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7" Jul 16 17:38:28.876066 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.876023 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7"} err="failed to get container status \"3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7\": rpc error: code = NotFound desc = could not find container \"3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7\": container with ID starting with 3261b4ee0757f57c28e2e0d5bf4fea78a9f2084e86eaf67b5db5d687c3323fd7 not found: ID does not exist" Jul 16 17:38:28.893413 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.893386 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b79ddd6fc-s4ps9"] Jul 16 17:38:28.897518 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:28.897498 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b79ddd6fc-s4ps9"] Jul 16 17:38:29.577640 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:38:29.577606 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b868d977-e563-45fc-9727-8fb534d42c35" path="/var/lib/kubelet/pods/b868d977-e563-45fc-9727-8fb534d42c35/volumes" Jul 16 17:40:39.431589 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.431551 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl"] Jul 16 17:40:39.432130 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.432003 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b868d977-e563-45fc-9727-8fb534d42c35" containerName="console" Jul 16 17:40:39.432130 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.432020 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b868d977-e563-45fc-9727-8fb534d42c35" containerName="console" Jul 16 17:40:39.432130 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.432111 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b868d977-e563-45fc-9727-8fb534d42c35" containerName="console" Jul 16 17:40:39.435222 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.435201 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl" Jul 16 17:40:39.437911 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.437890 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:40:39.438035 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.437947 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xnjgz\"" Jul 16 17:40:39.438611 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.438597 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 16 17:40:39.448135 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.448114 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl"] Jul 16 17:40:39.520942 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.520914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/285c16e9-733c-4351-8f10-ba649b72f2ed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tr5nl\" (UID: \"285c16e9-733c-4351-8f10-ba649b72f2ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl" Jul 16 17:40:39.521112 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.520962 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdctz\" (UniqueName: \"kubernetes.io/projected/285c16e9-733c-4351-8f10-ba649b72f2ed-kube-api-access-gdctz\") pod \"openshift-lws-operator-fd8ccff4c-tr5nl\" (UID: \"285c16e9-733c-4351-8f10-ba649b72f2ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl" Jul 16 17:40:39.622229 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.622191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdctz\" (UniqueName: \"kubernetes.io/projected/285c16e9-733c-4351-8f10-ba649b72f2ed-kube-api-access-gdctz\") pod \"openshift-lws-operator-fd8ccff4c-tr5nl\" (UID: \"285c16e9-733c-4351-8f10-ba649b72f2ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl" Jul 16 17:40:39.622410 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.622298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/285c16e9-733c-4351-8f10-ba649b72f2ed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tr5nl\" (UID: \"285c16e9-733c-4351-8f10-ba649b72f2ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl" Jul 16 17:40:39.622655 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.622630 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/285c16e9-733c-4351-8f10-ba649b72f2ed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tr5nl\" (UID: \"285c16e9-733c-4351-8f10-ba649b72f2ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl" Jul 16 17:40:39.632452 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.632429 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdctz\" (UniqueName: \"kubernetes.io/projected/285c16e9-733c-4351-8f10-ba649b72f2ed-kube-api-access-gdctz\") pod \"openshift-lws-operator-fd8ccff4c-tr5nl\" (UID: \"285c16e9-733c-4351-8f10-ba649b72f2ed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl" Jul 16 17:40:39.756139 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.756113 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl" Jul 16 17:40:39.922699 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.922666 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl"] Jul 16 17:40:39.926369 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:40:39.926337 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod285c16e9_733c_4351_8f10_ba649b72f2ed.slice/crio-ea4a1949c3dd82e760a41e4bf34fe20619b992996926a700062ca129933c6fb9 WatchSource:0}: Error finding container ea4a1949c3dd82e760a41e4bf34fe20619b992996926a700062ca129933c6fb9: Status 404 returned error can't find the container with id ea4a1949c3dd82e760a41e4bf34fe20619b992996926a700062ca129933c6fb9 Jul 16 17:40:39.927969 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:39.927947 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:40:40.336874 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:40.336840 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl" event={"ID":"285c16e9-733c-4351-8f10-ba649b72f2ed","Type":"ContainerStarted","Data":"ea4a1949c3dd82e760a41e4bf34fe20619b992996926a700062ca129933c6fb9"} Jul 16 17:40:43.352685 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:43.352649 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl" event={"ID":"285c16e9-733c-4351-8f10-ba649b72f2ed","Type":"ContainerStarted","Data":"6d602d8d5d518b91069fefa32a9f90699f1e3ce02240212a2d2d8c1331c22a60"} Jul 16 17:40:43.373310 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:43.373236 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tr5nl" podStartSLOduration=1.371874095 podStartE2EDuration="4.373213768s" totalImagesPullingTime="3.001339673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:40:43.371836342 +0000 UTC m=+476.312368247" watchObservedRunningTime="2026-07-16 17:40:43.373213768 +0000 UTC m=+476.313745674" Jul 16 17:40:45.474112 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.474077 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qzztw"] Jul 16 17:40:45.477238 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.477220 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qzztw" Jul 16 17:40:45.480288 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.480266 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 16 17:40:45.480288 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.480281 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-27q7g\"" Jul 16 17:40:45.480751 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.480734 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 16 17:40:45.494765 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.494741 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qzztw"] Jul 16 17:40:45.574710 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.574677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a83e61e4-3c87-4fb4-a1cc-020e21287aa3-bound-sa-token\") pod \"cert-manager-55b4d954d5-qzztw\" (UID: \"a83e61e4-3c87-4fb4-a1cc-020e21287aa3\") " pod="cert-manager/cert-manager-55b4d954d5-qzztw" Jul 16 17:40:45.574888 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.574728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srdrk\" (UniqueName: \"kubernetes.io/projected/a83e61e4-3c87-4fb4-a1cc-020e21287aa3-kube-api-access-srdrk\") pod \"cert-manager-55b4d954d5-qzztw\" (UID: \"a83e61e4-3c87-4fb4-a1cc-020e21287aa3\") " pod="cert-manager/cert-manager-55b4d954d5-qzztw" Jul 16 17:40:45.675708 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.675670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a83e61e4-3c87-4fb4-a1cc-020e21287aa3-bound-sa-token\") pod \"cert-manager-55b4d954d5-qzztw\" (UID: \"a83e61e4-3c87-4fb4-a1cc-020e21287aa3\") " pod="cert-manager/cert-manager-55b4d954d5-qzztw" Jul 16 17:40:45.675893 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.675732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srdrk\" (UniqueName: \"kubernetes.io/projected/a83e61e4-3c87-4fb4-a1cc-020e21287aa3-kube-api-access-srdrk\") pod \"cert-manager-55b4d954d5-qzztw\" (UID: \"a83e61e4-3c87-4fb4-a1cc-020e21287aa3\") " pod="cert-manager/cert-manager-55b4d954d5-qzztw" Jul 16 17:40:45.687169 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.687146 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a83e61e4-3c87-4fb4-a1cc-020e21287aa3-bound-sa-token\") pod \"cert-manager-55b4d954d5-qzztw\" (UID: \"a83e61e4-3c87-4fb4-a1cc-020e21287aa3\") " pod="cert-manager/cert-manager-55b4d954d5-qzztw" Jul 16 17:40:45.687326 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.687310 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srdrk\" (UniqueName: \"kubernetes.io/projected/a83e61e4-3c87-4fb4-a1cc-020e21287aa3-kube-api-access-srdrk\") pod \"cert-manager-55b4d954d5-qzztw\" (UID: \"a83e61e4-3c87-4fb4-a1cc-020e21287aa3\") " pod="cert-manager/cert-manager-55b4d954d5-qzztw" Jul 16 17:40:45.786413 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.786378 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qzztw" Jul 16 17:40:45.919439 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:45.919404 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qzztw"] Jul 16 17:40:45.923284 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:40:45.923230 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda83e61e4_3c87_4fb4_a1cc_020e21287aa3.slice/crio-37ee09dd51b905a984996b5cd6f79907fa5aa8b8e08560756cb4e57a98782650 WatchSource:0}: Error finding container 37ee09dd51b905a984996b5cd6f79907fa5aa8b8e08560756cb4e57a98782650: Status 404 returned error can't find the container with id 37ee09dd51b905a984996b5cd6f79907fa5aa8b8e08560756cb4e57a98782650 Jul 16 17:40:46.365483 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:46.365447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qzztw" event={"ID":"a83e61e4-3c87-4fb4-a1cc-020e21287aa3","Type":"ContainerStarted","Data":"37ee09dd51b905a984996b5cd6f79907fa5aa8b8e08560756cb4e57a98782650"} Jul 16 17:40:50.389825 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:50.389793 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qzztw" event={"ID":"a83e61e4-3c87-4fb4-a1cc-020e21287aa3","Type":"ContainerStarted","Data":"9a4ce44a6f55cf25dda406c2e60f32d5413b13231291ea6616403e63d3bd76d7"} Jul 16 17:40:52.626140 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.626083 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qzztw" podStartSLOduration=3.73846448 podStartE2EDuration="7.626066564s" totalImagesPullingTime="3.887602084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:40:50.409705263 +0000 UTC m=+483.350237169" watchObservedRunningTime="2026-07-16 17:40:52.626066564 +0000 UTC m=+485.566598758" Jul 16 17:40:52.626579 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.626445 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2"] Jul 16 17:40:52.629790 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.629767 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.632392 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.632372 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 16 17:40:52.633307 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.633288 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zlpzt\"" Jul 16 17:40:52.633307 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.633296 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 16 17:40:52.633471 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.633291 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 16 17:40:52.641027 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.641004 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2"] Jul 16 17:40:52.736042 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.736005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d984d7f7-14ba-420b-9f86-8405ac890218-metrics-cert\") pod \"lws-controller-manager-65794b4fd8-pcvd2\" (UID: \"d984d7f7-14ba-420b-9f86-8405ac890218\") " pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.736232 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.736064 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26fq7\" (UniqueName: \"kubernetes.io/projected/d984d7f7-14ba-420b-9f86-8405ac890218-kube-api-access-26fq7\") pod \"lws-controller-manager-65794b4fd8-pcvd2\" (UID: \"d984d7f7-14ba-420b-9f86-8405ac890218\") " pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.736232 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.736113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d984d7f7-14ba-420b-9f86-8405ac890218-cert\") pod \"lws-controller-manager-65794b4fd8-pcvd2\" (UID: \"d984d7f7-14ba-420b-9f86-8405ac890218\") " pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.736232 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.736159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d984d7f7-14ba-420b-9f86-8405ac890218-manager-config\") pod \"lws-controller-manager-65794b4fd8-pcvd2\" (UID: \"d984d7f7-14ba-420b-9f86-8405ac890218\") " pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.837004 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.836973 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26fq7\" (UniqueName: \"kubernetes.io/projected/d984d7f7-14ba-420b-9f86-8405ac890218-kube-api-access-26fq7\") pod \"lws-controller-manager-65794b4fd8-pcvd2\" (UID: \"d984d7f7-14ba-420b-9f86-8405ac890218\") " pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.837004 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.837008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d984d7f7-14ba-420b-9f86-8405ac890218-cert\") pod \"lws-controller-manager-65794b4fd8-pcvd2\" (UID: \"d984d7f7-14ba-420b-9f86-8405ac890218\") " pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.837267 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.837041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d984d7f7-14ba-420b-9f86-8405ac890218-manager-config\") pod \"lws-controller-manager-65794b4fd8-pcvd2\" (UID: \"d984d7f7-14ba-420b-9f86-8405ac890218\") " pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.837267 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.837096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d984d7f7-14ba-420b-9f86-8405ac890218-metrics-cert\") pod \"lws-controller-manager-65794b4fd8-pcvd2\" (UID: \"d984d7f7-14ba-420b-9f86-8405ac890218\") " pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.837757 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.837732 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d984d7f7-14ba-420b-9f86-8405ac890218-manager-config\") pod \"lws-controller-manager-65794b4fd8-pcvd2\" (UID: \"d984d7f7-14ba-420b-9f86-8405ac890218\") " pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.839355 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.839333 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d984d7f7-14ba-420b-9f86-8405ac890218-metrics-cert\") pod \"lws-controller-manager-65794b4fd8-pcvd2\" (UID: \"d984d7f7-14ba-420b-9f86-8405ac890218\") " pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.839518 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.839498 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d984d7f7-14ba-420b-9f86-8405ac890218-cert\") pod \"lws-controller-manager-65794b4fd8-pcvd2\" (UID: \"d984d7f7-14ba-420b-9f86-8405ac890218\") " pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.855468 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.855440 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26fq7\" (UniqueName: \"kubernetes.io/projected/d984d7f7-14ba-420b-9f86-8405ac890218-kube-api-access-26fq7\") pod \"lws-controller-manager-65794b4fd8-pcvd2\" (UID: \"d984d7f7-14ba-420b-9f86-8405ac890218\") " pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:52.939358 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:52.939242 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:53.099814 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:53.099764 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2"] Jul 16 17:40:53.103739 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:40:53.103711 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd984d7f7_14ba_420b_9f86_8405ac890218.slice/crio-0b0b15085c4c8dfc210f04ba8953b518e9aa0a721431baac4879a3bdd3e3199d WatchSource:0}: Error finding container 0b0b15085c4c8dfc210f04ba8953b518e9aa0a721431baac4879a3bdd3e3199d: Status 404 returned error can't find the container with id 0b0b15085c4c8dfc210f04ba8953b518e9aa0a721431baac4879a3bdd3e3199d Jul 16 17:40:53.406671 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:53.406639 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" event={"ID":"d984d7f7-14ba-420b-9f86-8405ac890218","Type":"ContainerStarted","Data":"0b0b15085c4c8dfc210f04ba8953b518e9aa0a721431baac4879a3bdd3e3199d"} Jul 16 17:40:56.426262 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:56.426210 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" event={"ID":"d984d7f7-14ba-420b-9f86-8405ac890218","Type":"ContainerStarted","Data":"02e0bc1c26eca8f1381452dc2e2356d85f3fd092109a28dd62be63522095a072"} Jul 16 17:40:56.426655 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:56.426321 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:40:56.447020 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:40:56.446970 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" podStartSLOduration=1.768214719 podStartE2EDuration="4.446954232s" totalImagesPullingTime="2.678739513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:40:56.446456347 +0000 UTC m=+489.386988263" watchObservedRunningTime="2026-07-16 17:40:56.446954232 +0000 UTC m=+489.387486156" Jul 16 17:41:00.803871 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.803842 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v"] Jul 16 17:41:00.807233 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.807216 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:00.809831 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.809808 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 17:41:00.809966 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.809850 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 17:41:00.809966 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.809920 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 17:41:00.810341 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.810325 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 17:41:00.810432 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.810417 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n44d8\"" Jul 16 17:41:00.825697 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.825676 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v"] Jul 16 17:41:00.903225 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.903189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904bf456-97aa-4093-965b-a765746bc0d3-tmp\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:00.903225 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.903225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlwg2\" (UniqueName: \"kubernetes.io/projected/904bf456-97aa-4093-965b-a765746bc0d3-kube-api-access-jlwg2\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:00.903534 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.903248 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/904bf456-97aa-4093-965b-a765746bc0d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:00.903534 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.903362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/904bf456-97aa-4093-965b-a765746bc0d3-manifests\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:00.903534 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:00.903435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/904bf456-97aa-4093-965b-a765746bc0d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:01.004335 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.004295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/904bf456-97aa-4093-965b-a765746bc0d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:01.004519 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.004389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904bf456-97aa-4093-965b-a765746bc0d3-tmp\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:01.004519 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.004420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlwg2\" (UniqueName: \"kubernetes.io/projected/904bf456-97aa-4093-965b-a765746bc0d3-kube-api-access-jlwg2\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:01.004519 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.004447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/904bf456-97aa-4093-965b-a765746bc0d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:01.004519 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.004482 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/904bf456-97aa-4093-965b-a765746bc0d3-manifests\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:01.004901 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.004878 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/904bf456-97aa-4093-965b-a765746bc0d3-manifests\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:01.006740 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.006712 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904bf456-97aa-4093-965b-a765746bc0d3-tmp\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:01.006883 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.006869 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/904bf456-97aa-4093-965b-a765746bc0d3-webhook-cert\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:01.006934 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.006909 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/904bf456-97aa-4093-965b-a765746bc0d3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:01.015154 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.015124 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlwg2\" (UniqueName: \"kubernetes.io/projected/904bf456-97aa-4093-965b-a765746bc0d3-kube-api-access-jlwg2\") pod \"opendatahub-operator-controller-manager-674ff8dd58-njn5v\" (UID: \"904bf456-97aa-4093-965b-a765746bc0d3\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:01.117056 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.116974 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:01.251297 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.251273 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v"] Jul 16 17:41:01.253633 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:41:01.253608 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904bf456_97aa_4093_965b_a765746bc0d3.slice/crio-6ef055ceef8be2438f2dacb3371eb866578e41a0c4981c16f7360b1051427402 WatchSource:0}: Error finding container 6ef055ceef8be2438f2dacb3371eb866578e41a0c4981c16f7360b1051427402: Status 404 returned error can't find the container with id 6ef055ceef8be2438f2dacb3371eb866578e41a0c4981c16f7360b1051427402 Jul 16 17:41:01.446165 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:01.446079 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" event={"ID":"904bf456-97aa-4093-965b-a765746bc0d3","Type":"ContainerStarted","Data":"6ef055ceef8be2438f2dacb3371eb866578e41a0c4981c16f7360b1051427402"} Jul 16 17:41:05.465119 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:05.465073 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" event={"ID":"904bf456-97aa-4093-965b-a765746bc0d3","Type":"ContainerStarted","Data":"cac33a8b1414cbd418e643efbeb7c96e9585151cd221024d9704782354ccdd88"} Jul 16 17:41:06.470833 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:06.470799 2577 generic.go:356] "Generic (PLEG): container finished" podID="904bf456-97aa-4093-965b-a765746bc0d3" containerID="cac33a8b1414cbd418e643efbeb7c96e9585151cd221024d9704782354ccdd88" exitCode=0 Jul 16 17:41:06.471212 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:06.470853 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" event={"ID":"904bf456-97aa-4093-965b-a765746bc0d3","Type":"ContainerDied","Data":"cac33a8b1414cbd418e643efbeb7c96e9585151cd221024d9704782354ccdd88"} Jul 16 17:41:07.432073 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:07.432038 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65794b4fd8-pcvd2" Jul 16 17:41:07.478326 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:07.478290 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" event={"ID":"904bf456-97aa-4093-965b-a765746bc0d3","Type":"ContainerStarted","Data":"38db3ba9954bb8f148ce5d0d093879f64aa291061e007ce38ee1b9c28936086a"} Jul 16 17:41:07.478735 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:07.478440 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:07.521618 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:07.521552 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" podStartSLOduration=2.649676528 podStartE2EDuration="7.521530663s" totalImagesPullingTime="3.788276809s" totalInitContainerRuntime="1.083577326s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:07.521290245 +0000 UTC m=+500.461822147" watchObservedRunningTime="2026-07-16 17:41:07.521530663 +0000 UTC m=+500.462062568" Jul 16 17:41:18.485408 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:18.485373 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-njn5v" Jul 16 17:41:30.356389 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.356355 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf"] Jul 16 17:41:30.371757 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.371726 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.375432 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.375414 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 17:41:30.375516 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.375416 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kx2kn\"" Jul 16 17:41:30.399138 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.399111 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf"] Jul 16 17:41:30.464173 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.464133 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.464350 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.464197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1049330f-4785-4d6c-aeb5-af6831e2e89c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.464350 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.464223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th6rp\" (UniqueName: \"kubernetes.io/projected/1049330f-4785-4d6c-aeb5-af6831e2e89c-kube-api-access-th6rp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.464350 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.464315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.464459 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.464353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1049330f-4785-4d6c-aeb5-af6831e2e89c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.464459 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.464371 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1049330f-4785-4d6c-aeb5-af6831e2e89c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.464459 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.464439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.464547 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.464466 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.464547 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.464490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565118 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565301 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1049330f-4785-4d6c-aeb5-af6831e2e89c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565301 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1049330f-4785-4d6c-aeb5-af6831e2e89c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565301 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565301 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565301 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565301 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565597 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1049330f-4785-4d6c-aeb5-af6831e2e89c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565597 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th6rp\" (UniqueName: \"kubernetes.io/projected/1049330f-4785-4d6c-aeb5-af6831e2e89c-kube-api-access-th6rp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565597 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565578 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565714 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565662 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565714 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565704 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565830 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565808 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.565949 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.565925 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1049330f-4785-4d6c-aeb5-af6831e2e89c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.567630 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.567606 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1049330f-4785-4d6c-aeb5-af6831e2e89c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.567887 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.567869 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1049330f-4785-4d6c-aeb5-af6831e2e89c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.577778 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.577754 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1049330f-4785-4d6c-aeb5-af6831e2e89c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.577911 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.577898 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th6rp\" (UniqueName: \"kubernetes.io/projected/1049330f-4785-4d6c-aeb5-af6831e2e89c-kube-api-access-th6rp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4445rf\" (UID: \"1049330f-4785-4d6c-aeb5-af6831e2e89c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.681560 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.681468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:30.724620 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.724589 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4"] Jul 16 17:41:30.727926 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.727910 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.731958 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.731734 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 16 17:41:30.731958 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.731808 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bmmjr\"" Jul 16 17:41:30.732865 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.732646 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 16 17:41:30.738284 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.738213 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 16 17:41:30.779325 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.779295 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4"] Jul 16 17:41:30.868832 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.868800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f4049429-e353-4de8-a447-1c594101df1c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.869015 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.868837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4049429-e353-4de8-a447-1c594101df1c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.869015 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.868862 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f4049429-e353-4de8-a447-1c594101df1c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.869015 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.868909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgzj2\" (UniqueName: \"kubernetes.io/projected/f4049429-e353-4de8-a447-1c594101df1c-kube-api-access-fgzj2\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.869015 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.868934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4049429-e353-4de8-a447-1c594101df1c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.869015 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.868959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f4049429-e353-4de8-a447-1c594101df1c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.869194 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.869016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f4049429-e353-4de8-a447-1c594101df1c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.878715 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.878694 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf"] Jul 16 17:41:30.881190 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:41:30.881159 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1049330f_4785_4d6c_aeb5_af6831e2e89c.slice/crio-b86f3cf9d20de04d298c4abc4e81b43fc9abc55ccaba6cf2d464c5f4cd690a69 WatchSource:0}: Error finding container b86f3cf9d20de04d298c4abc4e81b43fc9abc55ccaba6cf2d464c5f4cd690a69: Status 404 returned error can't find the container with id b86f3cf9d20de04d298c4abc4e81b43fc9abc55ccaba6cf2d464c5f4cd690a69 Jul 16 17:41:30.969905 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.969812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f4049429-e353-4de8-a447-1c594101df1c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.970062 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.969912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f4049429-e353-4de8-a447-1c594101df1c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.970062 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.969944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4049429-e353-4de8-a447-1c594101df1c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.970062 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.969980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f4049429-e353-4de8-a447-1c594101df1c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.970062 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.970010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgzj2\" (UniqueName: \"kubernetes.io/projected/f4049429-e353-4de8-a447-1c594101df1c-kube-api-access-fgzj2\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.970062 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.970040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4049429-e353-4de8-a447-1c594101df1c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.970362 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.970065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f4049429-e353-4de8-a447-1c594101df1c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.970778 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.970755 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f4049429-e353-4de8-a447-1c594101df1c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.972433 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.972401 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f4049429-e353-4de8-a447-1c594101df1c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.972545 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.972459 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f4049429-e353-4de8-a447-1c594101df1c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.972647 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.972628 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4049429-e353-4de8-a447-1c594101df1c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.972705 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.972637 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f4049429-e353-4de8-a447-1c594101df1c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.987184 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.987159 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4049429-e353-4de8-a447-1c594101df1c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:30.987699 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:30.987683 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgzj2\" (UniqueName: \"kubernetes.io/projected/f4049429-e353-4de8-a447-1c594101df1c-kube-api-access-fgzj2\") pod \"istiod-openshift-gateway-94bb8fbfd-pvhk4\" (UID: \"f4049429-e353-4de8-a447-1c594101df1c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:31.045674 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:31.045645 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:31.185742 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:31.185710 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4"] Jul 16 17:41:31.188679 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:41:31.188652 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4049429_e353_4de8_a447_1c594101df1c.slice/crio-8494b5af087fa338b175888b3e323c2f17840ce6ffafa065b897bd5496429130 WatchSource:0}: Error finding container 8494b5af087fa338b175888b3e323c2f17840ce6ffafa065b897bd5496429130: Status 404 returned error can't find the container with id 8494b5af087fa338b175888b3e323c2f17840ce6ffafa065b897bd5496429130 Jul 16 17:41:31.579978 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:31.579938 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" event={"ID":"1049330f-4785-4d6c-aeb5-af6831e2e89c","Type":"ContainerStarted","Data":"b86f3cf9d20de04d298c4abc4e81b43fc9abc55ccaba6cf2d464c5f4cd690a69"} Jul 16 17:41:31.580364 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:31.580000 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" event={"ID":"f4049429-e353-4de8-a447-1c594101df1c","Type":"ContainerStarted","Data":"8494b5af087fa338b175888b3e323c2f17840ce6ffafa065b897bd5496429130"} Jul 16 17:41:35.031148 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:35.031111 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 17:41:35.031429 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:35.031191 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 17:41:35.595710 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:35.595659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" event={"ID":"f4049429-e353-4de8-a447-1c594101df1c","Type":"ContainerStarted","Data":"d0b3ac1bbae6440fc86bcca0ef37b13e18289a8db2a2cda315bf33d2517e104f"} Jul 16 17:41:35.595908 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:35.595853 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:35.641630 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:35.640847 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" podStartSLOduration=1.8008018319999999 podStartE2EDuration="5.64082404s" totalImagesPullingTime="3.840022208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:35.639005399 +0000 UTC m=+528.579537311" watchObservedRunningTime="2026-07-16 17:41:35.64082404 +0000 UTC m=+528.581355946" Jul 16 17:41:36.601603 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:36.601576 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pvhk4" Jul 16 17:41:38.422634 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.422599 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d6cb8b778-phm2x"] Jul 16 17:41:38.426155 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.426137 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.442655 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.442633 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6cb8b778-phm2x"] Jul 16 17:41:38.538071 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.538037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c10e9dd-4884-43eb-84e8-476398ff66f3-console-config\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.538233 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.538088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c10e9dd-4884-43eb-84e8-476398ff66f3-console-oauth-config\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.538233 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.538109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c10e9dd-4884-43eb-84e8-476398ff66f3-oauth-serving-cert\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.538233 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.538160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c10e9dd-4884-43eb-84e8-476398ff66f3-service-ca\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.538233 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.538210 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m4ql\" (UniqueName: \"kubernetes.io/projected/0c10e9dd-4884-43eb-84e8-476398ff66f3-kube-api-access-5m4ql\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.538395 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.538242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c10e9dd-4884-43eb-84e8-476398ff66f3-trusted-ca-bundle\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.538395 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.538336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c10e9dd-4884-43eb-84e8-476398ff66f3-console-serving-cert\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.638769 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.638738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c10e9dd-4884-43eb-84e8-476398ff66f3-console-serving-cert\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.638934 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.638779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c10e9dd-4884-43eb-84e8-476398ff66f3-console-config\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.638934 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.638814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c10e9dd-4884-43eb-84e8-476398ff66f3-console-oauth-config\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.638934 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.638831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c10e9dd-4884-43eb-84e8-476398ff66f3-oauth-serving-cert\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.638934 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.638847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c10e9dd-4884-43eb-84e8-476398ff66f3-service-ca\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.638934 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.638876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m4ql\" (UniqueName: \"kubernetes.io/projected/0c10e9dd-4884-43eb-84e8-476398ff66f3-kube-api-access-5m4ql\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.638934 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.638901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c10e9dd-4884-43eb-84e8-476398ff66f3-trusted-ca-bundle\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.639715 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.639685 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c10e9dd-4884-43eb-84e8-476398ff66f3-service-ca\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.639813 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.639728 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c10e9dd-4884-43eb-84e8-476398ff66f3-oauth-serving-cert\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.639813 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.639767 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c10e9dd-4884-43eb-84e8-476398ff66f3-console-config\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.639922 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.639905 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c10e9dd-4884-43eb-84e8-476398ff66f3-trusted-ca-bundle\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.641348 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.641316 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c10e9dd-4884-43eb-84e8-476398ff66f3-console-oauth-config\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.641438 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.641355 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c10e9dd-4884-43eb-84e8-476398ff66f3-console-serving-cert\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.651351 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.651333 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m4ql\" (UniqueName: \"kubernetes.io/projected/0c10e9dd-4884-43eb-84e8-476398ff66f3-kube-api-access-5m4ql\") pod \"console-7d6cb8b778-phm2x\" (UID: \"0c10e9dd-4884-43eb-84e8-476398ff66f3\") " pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.735159 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.735076 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:38.881709 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:38.881679 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6cb8b778-phm2x"] Jul 16 17:41:38.888349 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:41:38.888315 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c10e9dd_4884_43eb_84e8_476398ff66f3.slice/crio-a0e6caec3998a0232938bd99f256250db83896980abb3fe49b9c3a65ebbe6417 WatchSource:0}: Error finding container a0e6caec3998a0232938bd99f256250db83896980abb3fe49b9c3a65ebbe6417: Status 404 returned error can't find the container with id a0e6caec3998a0232938bd99f256250db83896980abb3fe49b9c3a65ebbe6417 Jul 16 17:41:39.612599 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:39.612518 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6cb8b778-phm2x" event={"ID":"0c10e9dd-4884-43eb-84e8-476398ff66f3","Type":"ContainerStarted","Data":"61ad383480a76da4b66ace335ee6aa1714fc37cc548ac854d84335b0f1438c22"} Jul 16 17:41:39.612599 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:39.612570 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6cb8b778-phm2x" event={"ID":"0c10e9dd-4884-43eb-84e8-476398ff66f3","Type":"ContainerStarted","Data":"a0e6caec3998a0232938bd99f256250db83896980abb3fe49b9c3a65ebbe6417"} Jul 16 17:41:39.640963 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:39.640908 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d6cb8b778-phm2x" podStartSLOduration=1.640891214 podStartE2EDuration="1.640891214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:39.640231706 +0000 UTC m=+532.580763610" watchObservedRunningTime="2026-07-16 17:41:39.640891214 +0000 UTC m=+532.581423096" Jul 16 17:41:44.328956 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:44.328909 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 17:41:44.329367 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:44.328999 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 17:41:44.329367 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:44.329043 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 17:41:44.635822 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:44.635732 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" event={"ID":"1049330f-4785-4d6c-aeb5-af6831e2e89c","Type":"ContainerStarted","Data":"a8e12f61a3632442a115cae9ffdc9397231673054632f0114408e30c62ab6cdd"} Jul 16 17:41:44.658564 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:44.658512 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" podStartSLOduration=1.212954704 podStartE2EDuration="14.658493882s" totalImagesPullingTime="13.445539178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:44.656160251 +0000 UTC m=+537.596692176" watchObservedRunningTime="2026-07-16 17:41:44.658493882 +0000 UTC m=+537.599025787" Jul 16 17:41:44.681965 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:44.681927 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:45.682246 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:45.682203 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:45.687039 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:45.687012 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:46.646552 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:46.646518 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4445rf" Jul 16 17:41:48.736151 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:48.736122 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:48.736541 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:48.736175 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:48.740819 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:48.740797 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:49.662926 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:49.662895 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d6cb8b778-phm2x" Jul 16 17:41:49.722890 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:41:49.722855 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ddb7d89d6-gsrdj"] Jul 16 17:42:14.743790 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:14.743726 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5ddb7d89d6-gsrdj" podUID="4cc40c4e-98ba-4746-9f42-6248f307af95" containerName="console" containerID="cri-o://b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb" gracePeriod=15 Jul 16 17:42:14.988556 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:14.988530 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:42:15.157708 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.157623 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdmch\" (UniqueName: \"kubernetes.io/projected/4cc40c4e-98ba-4746-9f42-6248f307af95-kube-api-access-mdmch\") pod \"4cc40c4e-98ba-4746-9f42-6248f307af95\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " Jul 16 17:42:15.157708 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.157668 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-oauth-serving-cert\") pod \"4cc40c4e-98ba-4746-9f42-6248f307af95\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " Jul 16 17:42:15.157708 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.157705 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-console-config\") pod \"4cc40c4e-98ba-4746-9f42-6248f307af95\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " Jul 16 17:42:15.157976 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.157736 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cc40c4e-98ba-4746-9f42-6248f307af95-console-serving-cert\") pod \"4cc40c4e-98ba-4746-9f42-6248f307af95\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " Jul 16 17:42:15.157976 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.157762 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-trusted-ca-bundle\") pod \"4cc40c4e-98ba-4746-9f42-6248f307af95\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " Jul 16 17:42:15.157976 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.157901 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cc40c4e-98ba-4746-9f42-6248f307af95-console-oauth-config\") pod \"4cc40c4e-98ba-4746-9f42-6248f307af95\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " Jul 16 17:42:15.157976 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.157947 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-service-ca\") pod \"4cc40c4e-98ba-4746-9f42-6248f307af95\" (UID: \"4cc40c4e-98ba-4746-9f42-6248f307af95\") " Jul 16 17:42:15.158204 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.158168 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-console-config" (OuterVolumeSpecName: "console-config") pod "4cc40c4e-98ba-4746-9f42-6248f307af95" (UID: "4cc40c4e-98ba-4746-9f42-6248f307af95"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:42:15.158204 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.158177 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4cc40c4e-98ba-4746-9f42-6248f307af95" (UID: "4cc40c4e-98ba-4746-9f42-6248f307af95"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:42:15.158204 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.158189 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4cc40c4e-98ba-4746-9f42-6248f307af95" (UID: "4cc40c4e-98ba-4746-9f42-6248f307af95"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:42:15.158432 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.158336 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-console-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:42:15.158432 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.158348 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-trusted-ca-bundle\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:42:15.158534 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.158361 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-oauth-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:42:15.158588 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.158559 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-service-ca" (OuterVolumeSpecName: "service-ca") pod "4cc40c4e-98ba-4746-9f42-6248f307af95" (UID: "4cc40c4e-98ba-4746-9f42-6248f307af95"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:42:15.159851 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.159825 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cc40c4e-98ba-4746-9f42-6248f307af95-kube-api-access-mdmch" (OuterVolumeSpecName: "kube-api-access-mdmch") pod "4cc40c4e-98ba-4746-9f42-6248f307af95" (UID: "4cc40c4e-98ba-4746-9f42-6248f307af95"). InnerVolumeSpecName "kube-api-access-mdmch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:42:15.160292 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.160243 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cc40c4e-98ba-4746-9f42-6248f307af95-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4cc40c4e-98ba-4746-9f42-6248f307af95" (UID: "4cc40c4e-98ba-4746-9f42-6248f307af95"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:42:15.160372 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.160272 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cc40c4e-98ba-4746-9f42-6248f307af95-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4cc40c4e-98ba-4746-9f42-6248f307af95" (UID: "4cc40c4e-98ba-4746-9f42-6248f307af95"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:42:15.259592 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.259550 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdmch\" (UniqueName: \"kubernetes.io/projected/4cc40c4e-98ba-4746-9f42-6248f307af95-kube-api-access-mdmch\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:42:15.259592 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.259583 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cc40c4e-98ba-4746-9f42-6248f307af95-console-serving-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:42:15.259592 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.259596 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cc40c4e-98ba-4746-9f42-6248f307af95-console-oauth-config\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:42:15.259832 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.259608 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc40c4e-98ba-4746-9f42-6248f307af95-service-ca\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 17:42:15.770244 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.770208 2577 generic.go:356] "Generic (PLEG): container finished" podID="4cc40c4e-98ba-4746-9f42-6248f307af95" containerID="b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb" exitCode=0 Jul 16 17:42:15.770689 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.770271 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddb7d89d6-gsrdj" Jul 16 17:42:15.770689 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.770283 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddb7d89d6-gsrdj" event={"ID":"4cc40c4e-98ba-4746-9f42-6248f307af95","Type":"ContainerDied","Data":"b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb"} Jul 16 17:42:15.770689 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.770322 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddb7d89d6-gsrdj" event={"ID":"4cc40c4e-98ba-4746-9f42-6248f307af95","Type":"ContainerDied","Data":"f03830b5b025a3f377ffc6945fab419fa7e4bc94e33811a3d2e96b3270baf7ab"} Jul 16 17:42:15.770689 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.770345 2577 scope.go:117] "RemoveContainer" containerID="b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb" Jul 16 17:42:15.778295 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.778277 2577 scope.go:117] "RemoveContainer" containerID="b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb" Jul 16 17:42:15.778559 ip-10-0-129-222 kubenswrapper[2577]: E0716 17:42:15.778541 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb\": container with ID starting with b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb not found: ID does not exist" containerID="b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb" Jul 16 17:42:15.778601 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.778567 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb"} err="failed to get container status \"b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb\": rpc error: code = NotFound desc = could not find container \"b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb\": container with ID starting with b0566a76a20ea35c36c89d3e80734b004de2d3dde1555f794be35a5ee5dcb4fb not found: ID does not exist" Jul 16 17:42:15.792924 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.792901 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ddb7d89d6-gsrdj"] Jul 16 17:42:15.798436 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:15.798414 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ddb7d89d6-gsrdj"] Jul 16 17:42:17.578228 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:17.578187 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cc40c4e-98ba-4746-9f42-6248f307af95" path="/var/lib/kubelet/pods/4cc40c4e-98ba-4746-9f42-6248f307af95/volumes" Jul 16 17:42:47.418504 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:47.418466 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:42:47.419490 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:42:47.419468 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:43:57.262582 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.262551 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n"] Jul 16 17:43:57.263040 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.262881 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc40c4e-98ba-4746-9f42-6248f307af95" containerName="console" Jul 16 17:43:57.263040 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.262896 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc40c4e-98ba-4746-9f42-6248f307af95" containerName="console" Jul 16 17:43:57.263040 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.262964 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cc40c4e-98ba-4746-9f42-6248f307af95" containerName="console" Jul 16 17:43:57.265806 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.265787 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.267876 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.267857 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ftws7\"" Jul 16 17:43:57.281502 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.281480 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n"] Jul 16 17:43:57.412576 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.412528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22226c95-2436-43e0-8a2a-48983c28fde2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.412576 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.412580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.412794 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.412678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.412794 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.412710 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.412794 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.412751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22226c95-2436-43e0-8a2a-48983c28fde2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.412794 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.412771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.412919 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.412794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-484c2\" (UniqueName: \"kubernetes.io/projected/22226c95-2436-43e0-8a2a-48983c28fde2-kube-api-access-484c2\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.412919 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.412845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.412919 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.412865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22226c95-2436-43e0-8a2a-48983c28fde2-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.513559 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.513473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.513559 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.513513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.513559 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.513542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22226c95-2436-43e0-8a2a-48983c28fde2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.513811 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.513567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.513811 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.513590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-484c2\" (UniqueName: \"kubernetes.io/projected/22226c95-2436-43e0-8a2a-48983c28fde2-kube-api-access-484c2\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.513811 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.513619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.513811 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.513638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22226c95-2436-43e0-8a2a-48983c28fde2-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.513811 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.513658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22226c95-2436-43e0-8a2a-48983c28fde2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.513811 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.513692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.514092 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.513970 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.514092 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.513992 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.514176 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.514106 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.514213 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.514177 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.514433 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.514412 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22226c95-2436-43e0-8a2a-48983c28fde2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.516009 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.515988 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22226c95-2436-43e0-8a2a-48983c28fde2-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.516202 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.516186 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22226c95-2436-43e0-8a2a-48983c28fde2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.522433 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.522404 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22226c95-2436-43e0-8a2a-48983c28fde2-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.522543 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.522501 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-484c2\" (UniqueName: \"kubernetes.io/projected/22226c95-2436-43e0-8a2a-48983c28fde2-kube-api-access-484c2\") pod \"maas-default-gateway-openshift-default-56654dcf7-hjs4n\" (UID: \"22226c95-2436-43e0-8a2a-48983c28fde2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.575234 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.575199 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:57.715047 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.714855 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n"] Jul 16 17:43:57.717894 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:43:57.717872 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22226c95_2436_43e0_8a2a_48983c28fde2.slice/crio-c38ac6fe4fcf6d97ec3a7e2bece04220f4f003a9fe5af0928cc7351190fd1b95 WatchSource:0}: Error finding container c38ac6fe4fcf6d97ec3a7e2bece04220f4f003a9fe5af0928cc7351190fd1b95: Status 404 returned error can't find the container with id c38ac6fe4fcf6d97ec3a7e2bece04220f4f003a9fe5af0928cc7351190fd1b95 Jul 16 17:43:57.720577 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.720547 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 17:43:57.720653 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.720610 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 17:43:57.720653 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:57.720637 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 17:43:58.224330 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:58.224220 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" event={"ID":"22226c95-2436-43e0-8a2a-48983c28fde2","Type":"ContainerStarted","Data":"0c9d72ad09c6f5db1f6a00d2f3fbe9ec532d7c216f50b19aa8ba79235ea14389"} Jul 16 17:43:58.224505 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:58.224348 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" event={"ID":"22226c95-2436-43e0-8a2a-48983c28fde2","Type":"ContainerStarted","Data":"c38ac6fe4fcf6d97ec3a7e2bece04220f4f003a9fe5af0928cc7351190fd1b95"} Jul 16 17:43:58.250119 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:58.249719 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" podStartSLOduration=1.249700719 podStartE2EDuration="1.249700719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:43:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:43:58.249549126 +0000 UTC m=+671.190081031" watchObservedRunningTime="2026-07-16 17:43:58.249700719 +0000 UTC m=+671.190232624" Jul 16 17:43:58.575879 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:58.575841 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:43:58.577333 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:58.577306 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hjs4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 16 17:43:58.577464 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:58.577357 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" podUID="22226c95-2436-43e0-8a2a-48983c28fde2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 16 17:43:59.579299 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:43:59.579273 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:44:00.233301 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:44:00.233272 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:44:00.234081 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:44:00.234061 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:45:29.622594 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:29.622517 2577 generic.go:356] "Generic (PLEG): container finished" podID="22226c95-2436-43e0-8a2a-48983c28fde2" containerID="0c9d72ad09c6f5db1f6a00d2f3fbe9ec532d7c216f50b19aa8ba79235ea14389" exitCode=0 Jul 16 17:45:29.622594 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:29.622587 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" event={"ID":"22226c95-2436-43e0-8a2a-48983c28fde2","Type":"ContainerDied","Data":"0c9d72ad09c6f5db1f6a00d2f3fbe9ec532d7c216f50b19aa8ba79235ea14389"} Jul 16 17:45:29.623146 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:29.622931 2577 scope.go:117] "RemoveContainer" containerID="0c9d72ad09c6f5db1f6a00d2f3fbe9ec532d7c216f50b19aa8ba79235ea14389" Jul 16 17:45:29.623922 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:29.623891 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 17:45:29.623996 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:29.623980 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 17:45:29.624045 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:29.624030 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 17:45:30.234272 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:30.234223 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:45:30.632600 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:30.631618 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" event={"ID":"22226c95-2436-43e0-8a2a-48983c28fde2","Type":"ContainerStarted","Data":"924105f26a2ba5ec9b1a3a39461ce8ad89a818dcad82a2be718063f9c6cad9b3"} Jul 16 17:45:31.576810 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:31.576776 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hjs4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 16 17:45:31.577012 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:31.576847 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" podUID="22226c95-2436-43e0-8a2a-48983c28fde2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 16 17:45:31.578151 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:31.578128 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:45:32.575825 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:32.575784 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hjs4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 16 17:45:32.576217 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:32.575869 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" podUID="22226c95-2436-43e0-8a2a-48983c28fde2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 16 17:45:33.575636 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:33.575594 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hjs4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 16 17:45:33.575812 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:33.575657 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" podUID="22226c95-2436-43e0-8a2a-48983c28fde2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 16 17:45:34.576444 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:34.576402 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hjs4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 16 17:45:34.576838 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:34.576470 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" podUID="22226c95-2436-43e0-8a2a-48983c28fde2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 16 17:45:35.579517 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:35.579492 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:45:35.579954 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:35.579763 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:45:35.580488 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:35.580468 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hjs4n" Jul 16 17:45:37.182120 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.182091 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g"] Jul 16 17:45:37.185758 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.185737 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.188692 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.188672 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 17:45:37.188777 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.188701 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 17:45:37.188777 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.188748 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kw8bd\"" Jul 16 17:45:37.188897 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.188802 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 16 17:45:37.196709 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.196690 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g"] Jul 16 17:45:37.287383 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.287355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a6958fb-4062-4c05-b40d-5c97858ddc8a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.287383 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.287384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a6958fb-4062-4c05-b40d-5c97858ddc8a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.287611 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.287406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a6958fb-4062-4c05-b40d-5c97858ddc8a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.287611 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.287490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a6958fb-4062-4c05-b40d-5c97858ddc8a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.287611 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.287524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a6958fb-4062-4c05-b40d-5c97858ddc8a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.287611 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.287560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6vwx\" (UniqueName: \"kubernetes.io/projected/5a6958fb-4062-4c05-b40d-5c97858ddc8a-kube-api-access-t6vwx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.388969 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.388935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a6958fb-4062-4c05-b40d-5c97858ddc8a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.389132 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.388982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a6958fb-4062-4c05-b40d-5c97858ddc8a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.389132 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.389017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6vwx\" (UniqueName: \"kubernetes.io/projected/5a6958fb-4062-4c05-b40d-5c97858ddc8a-kube-api-access-t6vwx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.389132 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.389038 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a6958fb-4062-4c05-b40d-5c97858ddc8a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.389132 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.389055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a6958fb-4062-4c05-b40d-5c97858ddc8a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.389132 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.389072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a6958fb-4062-4c05-b40d-5c97858ddc8a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.389446 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.389414 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a6958fb-4062-4c05-b40d-5c97858ddc8a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.389522 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.389457 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a6958fb-4062-4c05-b40d-5c97858ddc8a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.389578 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.389565 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a6958fb-4062-4c05-b40d-5c97858ddc8a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.391374 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.391352 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a6958fb-4062-4c05-b40d-5c97858ddc8a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.391763 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.391743 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a6958fb-4062-4c05-b40d-5c97858ddc8a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.398693 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.398662 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6vwx\" (UniqueName: \"kubernetes.io/projected/5a6958fb-4062-4c05-b40d-5c97858ddc8a-kube-api-access-t6vwx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g\" (UID: \"5a6958fb-4062-4c05-b40d-5c97858ddc8a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.496403 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.496374 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:37.637350 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.637316 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g"] Jul 16 17:45:37.640853 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:45:37.640826 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6958fb_4062_4c05_b40d_5c97858ddc8a.slice/crio-a448eb09bc3ca1c9fa43a81a1cc59a1b4da9a1c7d98cf00c6dd8cf79b92f918b WatchSource:0}: Error finding container a448eb09bc3ca1c9fa43a81a1cc59a1b4da9a1c7d98cf00c6dd8cf79b92f918b: Status 404 returned error can't find the container with id a448eb09bc3ca1c9fa43a81a1cc59a1b4da9a1c7d98cf00c6dd8cf79b92f918b Jul 16 17:45:37.662730 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:37.662702 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" event={"ID":"5a6958fb-4062-4c05-b40d-5c97858ddc8a","Type":"ContainerStarted","Data":"a448eb09bc3ca1c9fa43a81a1cc59a1b4da9a1c7d98cf00c6dd8cf79b92f918b"} Jul 16 17:45:39.675643 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:39.675609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" event={"ID":"5a6958fb-4062-4c05-b40d-5c97858ddc8a","Type":"ContainerStarted","Data":"ef8a7caab4d6795557220961061307baee5211c7e77f472de06f9b161513e24e"} Jul 16 17:45:39.701432 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:39.701371 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" podStartSLOduration=1.569372513 podStartE2EDuration="2.70135373s" totalImagesPullingTime="1.131981217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:45:39.700144649 +0000 UTC m=+772.640676556" watchObservedRunningTime="2026-07-16 17:45:39.70135373 +0000 UTC m=+772.641885628" Jul 16 17:45:47.496530 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:47.496495 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:47.496941 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:47.496556 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:47.509519 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:47.509495 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:45:47.721916 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:45:47.721884 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g" Jul 16 17:46:20.510608 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.510534 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm"] Jul 16 17:46:20.513407 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.513392 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.516000 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.515975 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 16 17:46:20.527156 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.527134 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm"] Jul 16 17:46:20.567787 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.567756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qss6s\" (UniqueName: \"kubernetes.io/projected/711d609e-fde2-4761-b1b4-6f76f92adb27-kube-api-access-qss6s\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.567919 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.567797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/711d609e-fde2-4761-b1b4-6f76f92adb27-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.567919 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.567819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/711d609e-fde2-4761-b1b4-6f76f92adb27-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.567919 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.567840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/711d609e-fde2-4761-b1b4-6f76f92adb27-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.568020 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.567913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/711d609e-fde2-4761-b1b4-6f76f92adb27-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.568020 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.567984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/711d609e-fde2-4761-b1b4-6f76f92adb27-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.669464 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.669426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/711d609e-fde2-4761-b1b4-6f76f92adb27-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.669635 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.669475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qss6s\" (UniqueName: \"kubernetes.io/projected/711d609e-fde2-4761-b1b4-6f76f92adb27-kube-api-access-qss6s\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.669635 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.669605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/711d609e-fde2-4761-b1b4-6f76f92adb27-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.669779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.669654 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/711d609e-fde2-4761-b1b4-6f76f92adb27-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.669779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.669697 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/711d609e-fde2-4761-b1b4-6f76f92adb27-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.669779 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.669760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/711d609e-fde2-4761-b1b4-6f76f92adb27-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.669952 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.669920 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/711d609e-fde2-4761-b1b4-6f76f92adb27-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.670059 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.670039 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/711d609e-fde2-4761-b1b4-6f76f92adb27-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.670131 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.670113 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/711d609e-fde2-4761-b1b4-6f76f92adb27-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.671708 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.671690 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/711d609e-fde2-4761-b1b4-6f76f92adb27-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.672157 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.672136 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/711d609e-fde2-4761-b1b4-6f76f92adb27-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.686140 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.686112 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qss6s\" (UniqueName: \"kubernetes.io/projected/711d609e-fde2-4761-b1b4-6f76f92adb27-kube-api-access-qss6s\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7ghlm\" (UID: \"711d609e-fde2-4761-b1b4-6f76f92adb27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.823821 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.823733 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:20.969825 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.969800 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm"] Jul 16 17:46:20.972045 ip-10-0-129-222 kubenswrapper[2577]: W0716 17:46:20.972022 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711d609e_fde2_4761_b1b4_6f76f92adb27.slice/crio-2845045f1cb784c428a149b3496c02eefe0287fba108ae9d4dfb1502a9fbef51 WatchSource:0}: Error finding container 2845045f1cb784c428a149b3496c02eefe0287fba108ae9d4dfb1502a9fbef51: Status 404 returned error can't find the container with id 2845045f1cb784c428a149b3496c02eefe0287fba108ae9d4dfb1502a9fbef51 Jul 16 17:46:20.973378 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:20.973362 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:46:21.861388 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:21.861349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" event={"ID":"711d609e-fde2-4761-b1b4-6f76f92adb27","Type":"ContainerStarted","Data":"c839a46ec79effbfa7257a7ffaa0b92268dc83947902329c08dc5e3dc24de3f6"} Jul 16 17:46:21.861771 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:21.861411 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" event={"ID":"711d609e-fde2-4761-b1b4-6f76f92adb27","Type":"ContainerStarted","Data":"2845045f1cb784c428a149b3496c02eefe0287fba108ae9d4dfb1502a9fbef51"} Jul 16 17:46:21.882957 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:21.882910 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" podStartSLOduration=1.691643289 podStartE2EDuration="1.88289434s" totalImagesPullingTime="191.251051ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:46:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:46:21.881604798 +0000 UTC m=+814.822136701" watchObservedRunningTime="2026-07-16 17:46:21.88289434 +0000 UTC m=+814.823426243" Jul 16 17:46:30.824434 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:30.824397 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:30.824905 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:30.824453 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:30.837048 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:30.837022 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:46:30.911399 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:46:30.911371 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7ghlm" Jul 16 17:47:47.447033 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:47:47.446947 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:47:47.448341 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:47:47.448318 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:52:47.475715 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:52:47.475688 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:52:47.476206 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:52:47.476062 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:57:47.505854 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:57:47.505817 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 17:57:47.508420 ip-10-0-129-222 kubenswrapper[2577]: I0716 17:57:47.506434 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 18:02:33.983916 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:33.983883 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b"] Jul 16 18:02:33.987422 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:33.987406 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:33.991451 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:33.991435 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f06db564-openshift-default-dockercfg-ksm8h\"" Jul 16 18:02:34.016710 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.016680 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b"] Jul 16 18:02:34.107580 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.107545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-podinfo\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.107580 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.107583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istiod-ca-cert\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.107783 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.107610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzblv\" (UniqueName: \"kubernetes.io/projected/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-kube-api-access-dzblv\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.107783 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.107689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-workload-certs\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.107783 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.107747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-credential-socket\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.107783 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.107773 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-envoy\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.107908 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.107806 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-workload-socket\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.107908 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.107893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-data\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.107970 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.107939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-token\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.209423 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.209370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-workload-certs\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.209423 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.209436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-credential-socket\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.209687 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.209454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-envoy\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.209687 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.209476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-workload-socket\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.209687 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.209497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-data\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.209687 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.209521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-token\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.209687 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.209603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-podinfo\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.209687 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.209627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istiod-ca-cert\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.209687 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.209646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzblv\" (UniqueName: \"kubernetes.io/projected/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-kube-api-access-dzblv\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.210001 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.209824 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-workload-certs\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.210001 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.209955 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-credential-socket\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.210095 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.210005 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-data\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.210200 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.210183 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-workload-socket\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.210417 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.210399 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istiod-ca-cert\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.211685 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.211664 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-envoy\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.212009 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.211980 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-podinfo\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.218068 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.218043 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-token\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.219893 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.219870 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzblv\" (UniqueName: \"kubernetes.io/projected/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-kube-api-access-dzblv\") pod \"e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.297325 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.297297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:34.431813 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.431759 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b"] Jul 16 18:02:34.434018 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:02:34.433990 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ad8b4a_9a6e_4fcc_b018_1c00a487a329.slice/crio-cd0a36c5911b48f94d55d8e261b4ec1e05b284692731d29674aa41e29ee83473 WatchSource:0}: Error finding container cd0a36c5911b48f94d55d8e261b4ec1e05b284692731d29674aa41e29ee83473: Status 404 returned error can't find the container with id cd0a36c5911b48f94d55d8e261b4ec1e05b284692731d29674aa41e29ee83473 Jul 16 18:02:34.436289 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.436241 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:02:34.436396 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.436343 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:02:34.436396 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:34.436387 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:02:35.136065 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:35.136030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" event={"ID":"26ad8b4a-9a6e-4fcc-b018-1c00a487a329","Type":"ContainerStarted","Data":"f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f"} Jul 16 18:02:35.136464 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:35.136083 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" event={"ID":"26ad8b4a-9a6e-4fcc-b018-1c00a487a329","Type":"ContainerStarted","Data":"cd0a36c5911b48f94d55d8e261b4ec1e05b284692731d29674aa41e29ee83473"} Jul 16 18:02:35.163449 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:35.163394 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" podStartSLOduration=2.163378129 podStartE2EDuration="2.163378129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:02:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:02:35.16158019 +0000 UTC m=+1788.102112095" watchObservedRunningTime="2026-07-16 18:02:35.163378129 +0000 UTC m=+1788.103910032" Jul 16 18:02:35.298020 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:35.297983 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:35.302432 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:35.302405 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:36.140612 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:36.140579 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:36.141522 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:36.141496 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:47.191364 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:47.191333 2577 generic.go:356] "Generic (PLEG): container finished" podID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerID="f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f" exitCode=0 Jul 16 18:02:47.191817 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:47.191413 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" event={"ID":"26ad8b4a-9a6e-4fcc-b018-1c00a487a329","Type":"ContainerDied","Data":"f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f"} Jul 16 18:02:47.191944 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:47.191926 2577 scope.go:117] "RemoveContainer" containerID="f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f" Jul 16 18:02:47.193062 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:47.193033 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:02:47.193133 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:47.193117 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:02:47.193201 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:47.193188 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:02:47.543630 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:47.543601 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 18:02:47.544148 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:47.544127 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 18:02:48.205399 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:48.205354 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" event={"ID":"26ad8b4a-9a6e-4fcc-b018-1c00a487a329","Type":"ContainerStarted","Data":"abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94"} Jul 16 18:02:48.297720 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:48.297679 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:48.299017 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:48.298980 2577 patch_prober.go:28] interesting pod/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 16 18:02:48.299154 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:48.299043 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" podUID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 16 18:02:49.298224 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:49.298187 2577 patch_prober.go:28] interesting pod/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 16 18:02:49.298784 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:49.298754 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" podUID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 16 18:02:50.298657 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:50.298612 2577 patch_prober.go:28] interesting pod/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 16 18:02:50.299152 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:50.298681 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" podUID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 16 18:02:51.140736 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:51.140698 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:51.298457 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:51.298420 2577 patch_prober.go:28] interesting pod/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 16 18:02:51.298749 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:51.298705 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" podUID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 16 18:02:52.301776 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:52.301746 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:02:52.302975 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:02:52.302952 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:03:55.892851 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:03:55.892810 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b"] Jul 16 18:03:55.893328 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:03:55.893004 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" podUID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerName="istio-proxy" containerID="cri-o://abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94" gracePeriod=30 Jul 16 18:04:01.152593 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.152568 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:04:01.299838 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.299805 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-token\") pod \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " Jul 16 18:04:01.300030 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.299850 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-workload-socket\") pod \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " Jul 16 18:04:01.300030 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.299882 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-envoy\") pod \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " Jul 16 18:04:01.300030 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.299921 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-workload-certs\") pod \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " Jul 16 18:04:01.300030 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.299959 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istiod-ca-cert\") pod \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " Jul 16 18:04:01.300030 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.300010 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-podinfo\") pod \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " Jul 16 18:04:01.300329 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.300035 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzblv\" (UniqueName: \"kubernetes.io/projected/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-kube-api-access-dzblv\") pod \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " Jul 16 18:04:01.300329 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.300064 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-credential-socket\") pod \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " Jul 16 18:04:01.300329 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.300106 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-data\") pod \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\" (UID: \"26ad8b4a-9a6e-4fcc-b018-1c00a487a329\") " Jul 16 18:04:01.300329 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.300192 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26ad8b4a-9a6e-4fcc-b018-1c00a487a329" (UID: "26ad8b4a-9a6e-4fcc-b018-1c00a487a329"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:04:01.300329 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.300293 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26ad8b4a-9a6e-4fcc-b018-1c00a487a329" (UID: "26ad8b4a-9a6e-4fcc-b018-1c00a487a329"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:04:01.300585 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.300400 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26ad8b4a-9a6e-4fcc-b018-1c00a487a329" (UID: "26ad8b4a-9a6e-4fcc-b018-1c00a487a329"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:04:01.300585 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.300536 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26ad8b4a-9a6e-4fcc-b018-1c00a487a329" (UID: "26ad8b4a-9a6e-4fcc-b018-1c00a487a329"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:04:01.300694 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.300604 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-workload-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:04:01.300694 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.300626 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-workload-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:04:01.300694 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.300640 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istiod-ca-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:04:01.301055 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.301031 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-data" (OuterVolumeSpecName: "istio-data") pod "26ad8b4a-9a6e-4fcc-b018-1c00a487a329" (UID: "26ad8b4a-9a6e-4fcc-b018-1c00a487a329"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:04:01.302458 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.302428 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26ad8b4a-9a6e-4fcc-b018-1c00a487a329" (UID: "26ad8b4a-9a6e-4fcc-b018-1c00a487a329"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 18:04:01.302458 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.302452 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-token" (OuterVolumeSpecName: "istio-token") pod "26ad8b4a-9a6e-4fcc-b018-1c00a487a329" (UID: "26ad8b4a-9a6e-4fcc-b018-1c00a487a329"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:04:01.302610 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.302529 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26ad8b4a-9a6e-4fcc-b018-1c00a487a329" (UID: "26ad8b4a-9a6e-4fcc-b018-1c00a487a329"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:04:01.302610 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.302538 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-kube-api-access-dzblv" (OuterVolumeSpecName: "kube-api-access-dzblv") pod "26ad8b4a-9a6e-4fcc-b018-1c00a487a329" (UID: "26ad8b4a-9a6e-4fcc-b018-1c00a487a329"). InnerVolumeSpecName "kube-api-access-dzblv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:04:01.401450 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.401414 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-envoy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:04:01.401450 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.401445 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-podinfo\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:04:01.401450 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.401454 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzblv\" (UniqueName: \"kubernetes.io/projected/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-kube-api-access-dzblv\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:04:01.401679 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.401465 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-credential-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:04:01.401679 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.401473 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-data\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:04:01.401679 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.401481 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26ad8b4a-9a6e-4fcc-b018-1c00a487a329-istio-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:04:01.526496 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.526455 2577 generic.go:356] "Generic (PLEG): container finished" podID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerID="abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94" exitCode=0 Jul 16 18:04:01.526665 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.526503 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" event={"ID":"26ad8b4a-9a6e-4fcc-b018-1c00a487a329","Type":"ContainerDied","Data":"abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94"} Jul 16 18:04:01.526665 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.526514 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" Jul 16 18:04:01.526665 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.526561 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b" event={"ID":"26ad8b4a-9a6e-4fcc-b018-1c00a487a329","Type":"ContainerDied","Data":"cd0a36c5911b48f94d55d8e261b4ec1e05b284692731d29674aa41e29ee83473"} Jul 16 18:04:01.526665 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.526588 2577 scope.go:117] "RemoveContainer" containerID="abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94" Jul 16 18:04:01.535735 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.535712 2577 scope.go:117] "RemoveContainer" containerID="f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f" Jul 16 18:04:01.543502 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.543483 2577 scope.go:117] "RemoveContainer" containerID="abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94" Jul 16 18:04:01.543739 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:04:01.543723 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94\": container with ID starting with abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94 not found: ID does not exist" containerID="abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94" Jul 16 18:04:01.543781 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.543747 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94"} err="failed to get container status \"abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94\": rpc error: code = NotFound desc = could not find container \"abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94\": container with ID starting with abfef270b29551f9b8195878977de8281fd26841505d78aa245b4bf85116bd94 not found: ID does not exist" Jul 16 18:04:01.543781 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.543767 2577 scope.go:117] "RemoveContainer" containerID="f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f" Jul 16 18:04:01.544036 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:04:01.544015 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f\": container with ID starting with f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f not found: ID does not exist" containerID="f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f" Jul 16 18:04:01.544119 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.544043 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f"} err="failed to get container status \"f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f\": rpc error: code = NotFound desc = could not find container \"f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f\": container with ID starting with f7bf594d934c8f62aa833cbdaede2715d400862607c7d622dc77304a5b469d2f not found: ID does not exist" Jul 16 18:04:01.548962 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.548939 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b"] Jul 16 18:04:01.557192 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.557162 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f06db564-openshift-default-86b5dc457c-hvs6b"] Jul 16 18:04:01.578372 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:01.578341 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" path="/var/lib/kubelet/pods/26ad8b4a-9a6e-4fcc-b018-1c00a487a329/volumes" Jul 16 18:04:03.056954 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.056916 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk"] Jul 16 18:04:03.057776 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.057753 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerName="istio-proxy" Jul 16 18:04:03.057871 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.057779 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerName="istio-proxy" Jul 16 18:04:03.057999 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.057886 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerName="istio-proxy" Jul 16 18:04:03.062664 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.062639 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.066882 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.066864 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-89f0be1f-gw-openshift-default-dockercfg-dbg64\"" Jul 16 18:04:03.085043 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.085020 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk"] Jul 16 18:04:03.215055 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.215022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-workload-certs\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.215219 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.215079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-data\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.215219 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.215130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-envoy\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.215219 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.215156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-workload-socket\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.215219 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.215174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-podinfo\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.215433 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.215272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-credential-socket\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.215433 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.215303 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-token\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.215433 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.215348 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istiod-ca-cert\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.215433 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.215386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvrkc\" (UniqueName: \"kubernetes.io/projected/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-kube-api-access-dvrkc\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.316634 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.316544 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-workload-certs\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.316634 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.316604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-data\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.316864 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.316643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-envoy\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.316864 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.316671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-workload-socket\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.316864 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.316691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-podinfo\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.316864 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.316739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-credential-socket\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.316864 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.316761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-token\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.316864 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.316793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istiod-ca-cert\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.316864 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.316833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvrkc\" (UniqueName: \"kubernetes.io/projected/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-kube-api-access-dvrkc\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.317204 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.317002 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-workload-certs\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.317204 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.317045 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-data\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.317204 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.317143 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-credential-socket\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.317204 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.317160 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-workload-socket\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.317611 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.317592 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istiod-ca-cert\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.319155 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.319123 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-envoy\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.319341 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.319323 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-podinfo\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.327589 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.327562 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvrkc\" (UniqueName: \"kubernetes.io/projected/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-kube-api-access-dvrkc\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.327790 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.327774 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-token\") pod \"e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.372979 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.372950 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:03.519191 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.519168 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk"] Jul 16 18:04:03.521239 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:04:03.521211 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f1fba5_2b59_446c_b2ed_5ee6190f766c.slice/crio-d3f1e5e5d4391688b51d61263d0061f5183de5fde6f0c47e1bcc0b5ec16e67c8 WatchSource:0}: Error finding container d3f1e5e5d4391688b51d61263d0061f5183de5fde6f0c47e1bcc0b5ec16e67c8: Status 404 returned error can't find the container with id d3f1e5e5d4391688b51d61263d0061f5183de5fde6f0c47e1bcc0b5ec16e67c8 Jul 16 18:04:03.523323 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.523290 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:04:03.523389 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.523360 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:04:03.523432 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.523389 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:04:03.537850 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:03.537813 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" event={"ID":"b6f1fba5-2b59-446c-b2ed-5ee6190f766c","Type":"ContainerStarted","Data":"d3f1e5e5d4391688b51d61263d0061f5183de5fde6f0c47e1bcc0b5ec16e67c8"} Jul 16 18:04:04.544296 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:04.544235 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" event={"ID":"b6f1fba5-2b59-446c-b2ed-5ee6190f766c","Type":"ContainerStarted","Data":"f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380"} Jul 16 18:04:04.570444 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:04.570358 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" podStartSLOduration=1.570335609 podStartE2EDuration="1.570335609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:04:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:04:04.569515776 +0000 UTC m=+1877.510047691" watchObservedRunningTime="2026-07-16 18:04:04.570335609 +0000 UTC m=+1877.510867516" Jul 16 18:04:05.373466 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:05.373425 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:05.378411 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:05.378387 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:05.548700 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:05.548671 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:05.549900 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:05.549828 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:15.596096 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:15.596063 2577 generic.go:356] "Generic (PLEG): container finished" podID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerID="f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380" exitCode=0 Jul 16 18:04:15.596540 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:15.596135 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" event={"ID":"b6f1fba5-2b59-446c-b2ed-5ee6190f766c","Type":"ContainerDied","Data":"f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380"} Jul 16 18:04:15.596540 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:15.596513 2577 scope.go:117] "RemoveContainer" containerID="f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380" Jul 16 18:04:15.597553 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:15.597526 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:04:15.597642 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:15.597593 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:04:15.597642 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:15.597624 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:04:16.605319 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:16.605283 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" event={"ID":"b6f1fba5-2b59-446c-b2ed-5ee6190f766c","Type":"ContainerStarted","Data":"85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2"} Jul 16 18:04:17.373657 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:17.373621 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:17.374851 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:17.374825 2577 patch_prober.go:28] interesting pod/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 16 18:04:17.374978 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:17.374872 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" podUID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 16 18:04:18.374381 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:18.374337 2577 patch_prober.go:28] interesting pod/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 16 18:04:18.374765 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:18.374400 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" podUID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 16 18:04:19.373661 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:19.373625 2577 patch_prober.go:28] interesting pod/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 16 18:04:19.373847 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:19.373691 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" podUID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 16 18:04:20.373629 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:20.373590 2577 patch_prober.go:28] interesting pod/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 16 18:04:20.374040 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:20.373663 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" podUID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 16 18:04:20.549501 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:20.549462 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:21.377230 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:21.377194 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:04:21.378352 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:04:21.378333 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:05:09.111384 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:09.111347 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk"] Jul 16 18:05:09.111849 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:09.111552 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" podUID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerName="istio-proxy" containerID="cri-o://85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2" gracePeriod=30 Jul 16 18:05:14.364839 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.364815 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:05:14.466327 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466295 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-workload-socket\") pod \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " Jul 16 18:05:14.466455 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466331 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-podinfo\") pod \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " Jul 16 18:05:14.466455 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466356 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-workload-certs\") pod \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " Jul 16 18:05:14.466455 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466403 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istiod-ca-cert\") pod \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " Jul 16 18:05:14.466603 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466470 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-envoy\") pod \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " Jul 16 18:05:14.466603 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466504 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-token\") pod \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " Jul 16 18:05:14.466603 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466546 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b6f1fba5-2b59-446c-b2ed-5ee6190f766c" (UID: "b6f1fba5-2b59-446c-b2ed-5ee6190f766c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:05:14.466752 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466606 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-data\") pod \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " Jul 16 18:05:14.466752 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466655 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-credential-socket\") pod \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " Jul 16 18:05:14.466752 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466708 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvrkc\" (UniqueName: \"kubernetes.io/projected/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-kube-api-access-dvrkc\") pod \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\" (UID: \"b6f1fba5-2b59-446c-b2ed-5ee6190f766c\") " Jul 16 18:05:14.466752 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466726 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b6f1fba5-2b59-446c-b2ed-5ee6190f766c" (UID: "b6f1fba5-2b59-446c-b2ed-5ee6190f766c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:05:14.467012 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466918 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b6f1fba5-2b59-446c-b2ed-5ee6190f766c" (UID: "b6f1fba5-2b59-446c-b2ed-5ee6190f766c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:05:14.467012 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.466961 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b6f1fba5-2b59-446c-b2ed-5ee6190f766c" (UID: "b6f1fba5-2b59-446c-b2ed-5ee6190f766c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:05:14.467108 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.467085 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-credential-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:05:14.467162 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.467106 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-workload-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:05:14.467162 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.467121 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-workload-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:05:14.467162 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.467136 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istiod-ca-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:05:14.467608 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.467577 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-data" (OuterVolumeSpecName: "istio-data") pod "b6f1fba5-2b59-446c-b2ed-5ee6190f766c" (UID: "b6f1fba5-2b59-446c-b2ed-5ee6190f766c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:05:14.468727 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.468704 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-kube-api-access-dvrkc" (OuterVolumeSpecName: "kube-api-access-dvrkc") pod "b6f1fba5-2b59-446c-b2ed-5ee6190f766c" (UID: "b6f1fba5-2b59-446c-b2ed-5ee6190f766c"). InnerVolumeSpecName "kube-api-access-dvrkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:05:14.468833 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.468735 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b6f1fba5-2b59-446c-b2ed-5ee6190f766c" (UID: "b6f1fba5-2b59-446c-b2ed-5ee6190f766c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:05:14.468934 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.468916 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b6f1fba5-2b59-446c-b2ed-5ee6190f766c" (UID: "b6f1fba5-2b59-446c-b2ed-5ee6190f766c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 18:05:14.468934 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.468925 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-token" (OuterVolumeSpecName: "istio-token") pod "b6f1fba5-2b59-446c-b2ed-5ee6190f766c" (UID: "b6f1fba5-2b59-446c-b2ed-5ee6190f766c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:05:14.567750 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.567716 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-envoy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:05:14.567750 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.567745 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:05:14.567750 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.567754 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-data\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:05:14.567982 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.567763 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvrkc\" (UniqueName: \"kubernetes.io/projected/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-kube-api-access-dvrkc\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:05:14.567982 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.567772 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6f1fba5-2b59-446c-b2ed-5ee6190f766c-istio-podinfo\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:05:14.867076 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.867045 2577 generic.go:356] "Generic (PLEG): container finished" podID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerID="85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2" exitCode=0 Jul 16 18:05:14.867277 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.867084 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" event={"ID":"b6f1fba5-2b59-446c-b2ed-5ee6190f766c","Type":"ContainerDied","Data":"85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2"} Jul 16 18:05:14.867277 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.867091 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" Jul 16 18:05:14.867277 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.867127 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk" event={"ID":"b6f1fba5-2b59-446c-b2ed-5ee6190f766c","Type":"ContainerDied","Data":"d3f1e5e5d4391688b51d61263d0061f5183de5fde6f0c47e1bcc0b5ec16e67c8"} Jul 16 18:05:14.867277 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.867149 2577 scope.go:117] "RemoveContainer" containerID="85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2" Jul 16 18:05:14.876679 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.876658 2577 scope.go:117] "RemoveContainer" containerID="f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380" Jul 16 18:05:14.884592 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.884572 2577 scope.go:117] "RemoveContainer" containerID="85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2" Jul 16 18:05:14.884832 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:05:14.884812 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2\": container with ID starting with 85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2 not found: ID does not exist" containerID="85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2" Jul 16 18:05:14.884890 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.884841 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2"} err="failed to get container status \"85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2\": rpc error: code = NotFound desc = could not find container \"85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2\": container with ID starting with 85ab1b09230f9f9d2e01edcc5a4677538a96a53a4e59bd19f321b1740d59fab2 not found: ID does not exist" Jul 16 18:05:14.884890 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.884859 2577 scope.go:117] "RemoveContainer" containerID="f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380" Jul 16 18:05:14.885102 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:05:14.885084 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380\": container with ID starting with f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380 not found: ID does not exist" containerID="f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380" Jul 16 18:05:14.885145 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.885108 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380"} err="failed to get container status \"f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380\": rpc error: code = NotFound desc = could not find container \"f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380\": container with ID starting with f484bb6634d52b5517b927b34073947b67bc73a22114a2f92e48a328ef1ec380 not found: ID does not exist" Jul 16 18:05:14.891917 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.891757 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk"] Jul 16 18:05:14.893886 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:14.893830 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-89f0be1f-gw-openshift-default-84bf7b57c5-7k2fk"] Jul 16 18:05:15.578659 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:15.578626 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" path="/var/lib/kubelet/pods/b6f1fba5-2b59-446c-b2ed-5ee6190f766c/volumes" Jul 16 18:05:16.623810 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.623777 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd"] Jul 16 18:05:16.624346 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.624327 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerName="istio-proxy" Jul 16 18:05:16.624444 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.624349 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerName="istio-proxy" Jul 16 18:05:16.624444 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.624380 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerName="istio-proxy" Jul 16 18:05:16.624444 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.624390 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerName="istio-proxy" Jul 16 18:05:16.624596 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.624472 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerName="istio-proxy" Jul 16 18:05:16.624596 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.624483 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerName="istio-proxy" Jul 16 18:05:16.624596 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.624496 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ad8b4a-9a6e-4fcc-b018-1c00a487a329" containerName="istio-proxy" Jul 16 18:05:16.629097 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.629075 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.635080 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.635051 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-57c731f2-openshift-default-dockercfg-2qsm8\"" Jul 16 18:05:16.654167 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.654139 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd"] Jul 16 18:05:16.688308 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.688273 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-envoy\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.688574 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.688548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-token\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.688668 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.688654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-workload-socket\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.688725 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.688701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-workload-certs\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.688789 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.688765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-credential-socket\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.688875 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.688852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istiod-ca-cert\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.689016 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.688997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-data\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.689088 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.689037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-podinfo\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.689088 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.689063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5khhn\" (UniqueName: \"kubernetes.io/projected/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-kube-api-access-5khhn\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.790619 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.790576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-envoy\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.790809 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.790640 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-token\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.790809 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.790668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-workload-socket\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.790809 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.790684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-workload-certs\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.790809 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.790701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-credential-socket\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.790809 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.790722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istiod-ca-cert\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.790809 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.790751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-data\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.790809 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.790780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-podinfo\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.790809 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.790803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5khhn\" (UniqueName: \"kubernetes.io/projected/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-kube-api-access-5khhn\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.791228 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.791066 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-workload-socket\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.791228 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.791133 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-workload-certs\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.791374 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.791330 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-credential-socket\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.791469 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.791444 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-data\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.791537 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.791450 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istiod-ca-cert\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.792907 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.792886 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-envoy\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.793344 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.793329 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-podinfo\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.800439 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.800403 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-token\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.800627 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.800607 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5khhn\" (UniqueName: \"kubernetes.io/projected/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-kube-api-access-5khhn\") pod \"e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:16.941113 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:16.941020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:17.087901 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:17.087866 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd"] Jul 16 18:05:17.089347 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:05:17.089319 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e28e90_cba0_43a2_aa18_c6dc7dd8ed68.slice/crio-4e3a278024d444af61cd089020cf13088076ac6b914aa1f652bc07ff57c52ad7 WatchSource:0}: Error finding container 4e3a278024d444af61cd089020cf13088076ac6b914aa1f652bc07ff57c52ad7: Status 404 returned error can't find the container with id 4e3a278024d444af61cd089020cf13088076ac6b914aa1f652bc07ff57c52ad7 Jul 16 18:05:17.091689 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:17.091655 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:05:17.091760 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:17.091726 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:05:17.091760 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:17.091753 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:05:17.883025 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:17.882990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" event={"ID":"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68","Type":"ContainerStarted","Data":"f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5"} Jul 16 18:05:17.883576 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:17.883047 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" event={"ID":"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68","Type":"ContainerStarted","Data":"4e3a278024d444af61cd089020cf13088076ac6b914aa1f652bc07ff57c52ad7"} Jul 16 18:05:17.918309 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:17.918229 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" podStartSLOduration=1.918208388 podStartE2EDuration="1.918208388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:05:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:05:17.916230633 +0000 UTC m=+1950.856762548" watchObservedRunningTime="2026-07-16 18:05:17.918208388 +0000 UTC m=+1950.858740292" Jul 16 18:05:17.941759 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:17.941730 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:18.946828 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:18.946799 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:19.893001 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:19.892972 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:19.894099 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:19.894078 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:28.938199 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:28.938107 2577 generic.go:356] "Generic (PLEG): container finished" podID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" containerID="f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5" exitCode=0 Jul 16 18:05:28.938199 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:28.938178 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" event={"ID":"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68","Type":"ContainerDied","Data":"f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5"} Jul 16 18:05:28.938656 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:28.938622 2577 scope.go:117] "RemoveContainer" containerID="f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5" Jul 16 18:05:28.939620 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:28.939595 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:05:28.939677 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:28.939662 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:05:28.939712 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:28.939695 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:05:29.944545 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:29.944511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" event={"ID":"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68","Type":"ContainerStarted","Data":"bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e"} Jul 16 18:05:30.941960 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:30.941927 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:30.943230 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:30.943201 2577 patch_prober.go:28] interesting pod/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 16 18:05:30.943378 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:30.943273 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" podUID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 16 18:05:31.941618 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:31.941583 2577 patch_prober.go:28] interesting pod/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 16 18:05:31.942074 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:31.941642 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" podUID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 16 18:05:32.942432 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:32.942397 2577 patch_prober.go:28] interesting pod/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 16 18:05:32.942814 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:32.942452 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" podUID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 16 18:05:33.946001 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:33.945968 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:33.946445 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:33.946353 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:05:33.947135 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:05:33.947114 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:06:39.719594 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:39.719554 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd"] Jul 16 18:06:39.720152 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:39.719759 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" podUID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" containerName="istio-proxy" containerID="cri-o://bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e" gracePeriod=30 Jul 16 18:06:44.975140 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.975116 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:06:44.991053 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991023 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-credential-socket\") pod \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " Jul 16 18:06:44.991196 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991071 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-envoy\") pod \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " Jul 16 18:06:44.991196 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991093 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-workload-socket\") pod \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " Jul 16 18:06:44.991196 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991126 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5khhn\" (UniqueName: \"kubernetes.io/projected/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-kube-api-access-5khhn\") pod \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " Jul 16 18:06:44.991196 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991163 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-podinfo\") pod \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " Jul 16 18:06:44.991601 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991222 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-data\") pod \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " Jul 16 18:06:44.991601 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991304 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istiod-ca-cert\") pod \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " Jul 16 18:06:44.991601 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991336 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-token\") pod \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " Jul 16 18:06:44.991601 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991340 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" (UID: "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:06:44.991601 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991408 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-workload-certs\") pod \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\" (UID: \"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68\") " Jul 16 18:06:44.991601 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991480 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" (UID: "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:06:44.991909 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991683 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" (UID: "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:06:44.991909 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991704 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-credential-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:06:44.991909 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991723 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-workload-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:06:44.991909 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.991777 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" (UID: "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:06:44.992147 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.992121 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-data" (OuterVolumeSpecName: "istio-data") pod "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" (UID: "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:06:44.993568 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.993530 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" (UID: "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:06:44.993568 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.993552 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" (UID: "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 18:06:44.993745 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.993651 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" (UID: "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:06:44.993745 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:44.993702 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-kube-api-access-5khhn" (OuterVolumeSpecName: "kube-api-access-5khhn") pod "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" (UID: "f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68"). InnerVolumeSpecName "kube-api-access-5khhn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:06:45.092914 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.092885 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istiod-ca-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:06:45.092914 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.092914 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:06:45.093073 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.092923 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-workload-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:06:45.093073 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.092932 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-envoy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:06:45.093073 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.092940 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5khhn\" (UniqueName: \"kubernetes.io/projected/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-kube-api-access-5khhn\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:06:45.093073 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.092949 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-podinfo\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:06:45.093073 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.092957 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68-istio-data\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:06:45.291815 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.291717 2577 generic.go:356] "Generic (PLEG): container finished" podID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" containerID="bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e" exitCode=0 Jul 16 18:06:45.291815 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.291767 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" Jul 16 18:06:45.292047 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.291805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" event={"ID":"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68","Type":"ContainerDied","Data":"bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e"} Jul 16 18:06:45.292047 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.291874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd" event={"ID":"f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68","Type":"ContainerDied","Data":"4e3a278024d444af61cd089020cf13088076ac6b914aa1f652bc07ff57c52ad7"} Jul 16 18:06:45.292047 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.291904 2577 scope.go:117] "RemoveContainer" containerID="bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e" Jul 16 18:06:45.306220 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.306198 2577 scope.go:117] "RemoveContainer" containerID="f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5" Jul 16 18:06:45.314110 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.314093 2577 scope.go:117] "RemoveContainer" containerID="bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e" Jul 16 18:06:45.314415 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:06:45.314395 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e\": container with ID starting with bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e not found: ID does not exist" containerID="bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e" Jul 16 18:06:45.314502 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.314426 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e"} err="failed to get container status \"bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e\": rpc error: code = NotFound desc = could not find container \"bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e\": container with ID starting with bfca60955154662952e71d2e5a13e70d0a020fb8656bc77ec5e7ffaaf009400e not found: ID does not exist" Jul 16 18:06:45.314502 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.314450 2577 scope.go:117] "RemoveContainer" containerID="f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5" Jul 16 18:06:45.314684 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:06:45.314666 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5\": container with ID starting with f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5 not found: ID does not exist" containerID="f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5" Jul 16 18:06:45.314733 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.314691 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5"} err="failed to get container status \"f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5\": rpc error: code = NotFound desc = could not find container \"f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5\": container with ID starting with f9cd7a52a286789744cf811f4c4ddb5b49c4048e858bfdb02978ae97a14676a5 not found: ID does not exist" Jul 16 18:06:45.320961 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.320941 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd"] Jul 16 18:06:45.329288 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.329248 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-57c731f2-openshift-default-f94c9f5ff-8kkwd"] Jul 16 18:06:45.579492 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:45.579414 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" path="/var/lib/kubelet/pods/f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68/volumes" Jul 16 18:06:47.131089 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.131054 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml"] Jul 16 18:06:47.131477 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.131449 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" containerName="istio-proxy" Jul 16 18:06:47.131477 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.131461 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" containerName="istio-proxy" Jul 16 18:06:47.131477 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.131470 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerName="istio-proxy" Jul 16 18:06:47.131477 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.131476 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f1fba5-2b59-446c-b2ed-5ee6190f766c" containerName="istio-proxy" Jul 16 18:06:47.131612 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.131558 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" containerName="istio-proxy" Jul 16 18:06:47.136312 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.136288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.143109 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.143086 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7be4c90b-openshift-default-dockercfg-m5vfk\"" Jul 16 18:06:47.160548 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.160521 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml"] Jul 16 18:06:47.213305 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.213240 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-workload-certs\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.213452 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.213368 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-workload-socket\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.213452 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.213414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-envoy\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.213452 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.213438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-data\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.213592 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.213516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istiod-ca-cert\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.213592 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.213542 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l7pt\" (UniqueName: \"kubernetes.io/projected/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-kube-api-access-7l7pt\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.213695 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.213596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-credential-socket\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.213695 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.213651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-podinfo\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.213695 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.213681 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-token\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.314467 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.314431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-podinfo\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.314467 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.314469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-token\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.314678 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.314500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-workload-certs\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.314678 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.314553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-workload-socket\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.314775 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.314688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-envoy\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.314775 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.314731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-data\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.314858 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.314792 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istiod-ca-cert\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.314858 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.314817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l7pt\" (UniqueName: \"kubernetes.io/projected/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-kube-api-access-7l7pt\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.314944 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.314859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-credential-socket\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.315001 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.314954 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-workload-certs\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.315052 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.315011 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-workload-socket\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.315146 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.315115 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-data\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.315287 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.315184 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-credential-socket\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.315767 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.315746 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istiod-ca-cert\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.316900 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.316873 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-envoy\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.317156 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.317138 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-podinfo\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.329484 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.329458 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-token\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.329574 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.329556 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l7pt\" (UniqueName: \"kubernetes.io/projected/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-kube-api-access-7l7pt\") pod \"e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.449795 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.449722 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7be4c90b-openshift-default-dockercfg-m5vfk\"" Jul 16 18:06:47.458379 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.458355 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:47.607576 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.607482 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml"] Jul 16 18:06:47.610332 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:06:47.610304 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ea8f8a_90c3_4a4b_82cc_6eee2fe636b8.slice/crio-68cd64b589ce4da9e3a0f7cf6f6e7981fbbdf361132a8b2a3add7a6c666c5bdd WatchSource:0}: Error finding container 68cd64b589ce4da9e3a0f7cf6f6e7981fbbdf361132a8b2a3add7a6c666c5bdd: Status 404 returned error can't find the container with id 68cd64b589ce4da9e3a0f7cf6f6e7981fbbdf361132a8b2a3add7a6c666c5bdd Jul 16 18:06:47.612444 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.612417 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:06:47.612542 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.612474 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:06:47.612542 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:47.612498 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:06:48.306933 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:48.306896 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" event={"ID":"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8","Type":"ContainerStarted","Data":"1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38"} Jul 16 18:06:48.307353 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:48.306956 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" event={"ID":"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8","Type":"ContainerStarted","Data":"68cd64b589ce4da9e3a0f7cf6f6e7981fbbdf361132a8b2a3add7a6c666c5bdd"} Jul 16 18:06:48.340862 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:48.340791 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" podStartSLOduration=1.340776652 podStartE2EDuration="1.340776652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:06:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:06:48.338896966 +0000 UTC m=+2041.279428875" watchObservedRunningTime="2026-07-16 18:06:48.340776652 +0000 UTC m=+2041.281308555" Jul 16 18:06:48.459616 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:48.459584 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:48.464768 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:48.464741 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:49.319069 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:49.319032 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:49.320193 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:49.320171 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:06:59.368645 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:59.368611 2577 generic.go:356] "Generic (PLEG): container finished" podID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerID="1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38" exitCode=0 Jul 16 18:06:59.369175 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:59.368687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" event={"ID":"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8","Type":"ContainerDied","Data":"1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38"} Jul 16 18:06:59.369175 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:59.369163 2577 scope.go:117] "RemoveContainer" containerID="1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38" Jul 16 18:06:59.370214 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:59.370188 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:06:59.370296 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:59.370276 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:06:59.370336 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:06:59.370328 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:07:00.375288 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:00.375238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" event={"ID":"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8","Type":"ContainerStarted","Data":"aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e"} Jul 16 18:07:00.459472 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:00.459437 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:07:00.460499 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:00.460478 2577 patch_prober.go:28] interesting pod/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 16 18:07:00.460566 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:00.460522 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" podUID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 16 18:07:01.458944 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:01.458912 2577 patch_prober.go:28] interesting pod/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 16 18:07:01.459475 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:01.458971 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" podUID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 16 18:07:02.459601 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:02.459557 2577 patch_prober.go:28] interesting pod/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 16 18:07:02.459984 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:02.459628 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" podUID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 16 18:07:03.458996 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:03.458962 2577 patch_prober.go:28] interesting pod/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 16 18:07:03.459183 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:03.459017 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" podUID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 16 18:07:04.320028 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:04.319991 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:07:04.462666 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:04.462635 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:07:04.463574 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:04.463555 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:07:47.576348 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:47.576318 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 18:07:47.576873 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:07:47.576386 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 18:08:08.198733 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:08.198694 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml"] Jul 16 18:08:08.199222 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:08.198988 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" podUID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerName="istio-proxy" containerID="cri-o://aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e" gracePeriod=30 Jul 16 18:08:13.449126 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.449098 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:08:13.507945 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.507916 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-workload-certs\") pod \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " Jul 16 18:08:13.508134 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.507981 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-data\") pod \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " Jul 16 18:08:13.508134 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.508010 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istiod-ca-cert\") pod \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " Jul 16 18:08:13.508134 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.508052 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-token\") pod \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " Jul 16 18:08:13.508134 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.508116 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-podinfo\") pod \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " Jul 16 18:08:13.508394 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.508265 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" (UID: "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:08:13.508394 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.508363 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-envoy\") pod \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " Jul 16 18:08:13.508506 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.508458 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-credential-socket\") pod \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " Jul 16 18:08:13.508506 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.508481 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" (UID: "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:08:13.508506 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.508499 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-workload-socket\") pod \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " Jul 16 18:08:13.508657 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.508526 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l7pt\" (UniqueName: \"kubernetes.io/projected/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-kube-api-access-7l7pt\") pod \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\" (UID: \"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8\") " Jul 16 18:08:13.509132 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.508850 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-workload-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:08:13.509132 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.508872 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istiod-ca-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:08:13.509132 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.508994 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" (UID: "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:08:13.509132 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.509064 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" (UID: "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:08:13.509491 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.509157 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" (UID: "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:08:13.510581 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.510549 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" (UID: "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 18:08:13.510687 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.510665 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" (UID: "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:08:13.510854 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.510828 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-kube-api-access-7l7pt" (OuterVolumeSpecName: "kube-api-access-7l7pt") pod "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" (UID: "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8"). InnerVolumeSpecName "kube-api-access-7l7pt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:08:13.511159 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.510876 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" (UID: "91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:08:13.609670 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.609639 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-workload-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:08:13.609670 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.609667 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l7pt\" (UniqueName: \"kubernetes.io/projected/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-kube-api-access-7l7pt\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:08:13.609670 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.609678 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-data\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:08:13.609922 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.609688 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:08:13.609922 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.609695 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-podinfo\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:08:13.609922 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.609704 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-istio-envoy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:08:13.609922 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.609712 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8-credential-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:08:13.711831 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.711798 2577 generic.go:356] "Generic (PLEG): container finished" podID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerID="aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e" exitCode=0 Jul 16 18:08:13.712012 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.711838 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" event={"ID":"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8","Type":"ContainerDied","Data":"aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e"} Jul 16 18:08:13.712012 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.711845 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" Jul 16 18:08:13.712012 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.711882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml" event={"ID":"91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8","Type":"ContainerDied","Data":"68cd64b589ce4da9e3a0f7cf6f6e7981fbbdf361132a8b2a3add7a6c666c5bdd"} Jul 16 18:08:13.712012 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.711906 2577 scope.go:117] "RemoveContainer" containerID="aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e" Jul 16 18:08:13.720535 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.720515 2577 scope.go:117] "RemoveContainer" containerID="1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38" Jul 16 18:08:13.728150 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.728134 2577 scope.go:117] "RemoveContainer" containerID="aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e" Jul 16 18:08:13.728420 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:08:13.728399 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e\": container with ID starting with aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e not found: ID does not exist" containerID="aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e" Jul 16 18:08:13.728478 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.728427 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e"} err="failed to get container status \"aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e\": rpc error: code = NotFound desc = could not find container \"aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e\": container with ID starting with aa3c2f2b958183d2c9fa3e8b6d25f8e0a8082f0b2662889cbaf7876aa715b29e not found: ID does not exist" Jul 16 18:08:13.728478 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.728444 2577 scope.go:117] "RemoveContainer" containerID="1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38" Jul 16 18:08:13.728695 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:08:13.728678 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38\": container with ID starting with 1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38 not found: ID does not exist" containerID="1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38" Jul 16 18:08:13.728740 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.728706 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38"} err="failed to get container status \"1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38\": rpc error: code = NotFound desc = could not find container \"1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38\": container with ID starting with 1e607ddd9127eb2c931f877464ca83d05db913be1f86dce1836142b25034da38 not found: ID does not exist" Jul 16 18:08:13.737331 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.737308 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml"] Jul 16 18:08:13.744378 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:13.744358 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7be4c90b-openshift-default-86cb8df4f9-kzfml"] Jul 16 18:08:15.579048 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:08:15.579015 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" path="/var/lib/kubelet/pods/91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8/volumes" Jul 16 18:09:59.078912 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.078874 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6"] Jul 16 18:09:59.079428 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.079207 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerName="istio-proxy" Jul 16 18:09:59.079428 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.079218 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerName="istio-proxy" Jul 16 18:09:59.079428 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.079232 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" containerName="istio-proxy" Jul 16 18:09:59.079428 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.079237 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" containerName="istio-proxy" Jul 16 18:09:59.079428 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.079244 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerName="istio-proxy" Jul 16 18:09:59.079428 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.079266 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerName="istio-proxy" Jul 16 18:09:59.079428 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.079425 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerName="istio-proxy" Jul 16 18:09:59.079782 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.079438 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7e28e90-cba0-43a2-aa18-c6dc7dd8ed68" containerName="istio-proxy" Jul 16 18:09:59.079782 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.079452 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ea8f8a-90c3-4a4b-82cc-6eee2fe636b8" containerName="istio-proxy" Jul 16 18:09:59.082603 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.082584 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.084596 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.084574 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9826013b-openshift-default-dockercfg-gxpvh\"" Jul 16 18:09:59.106605 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.106582 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6"] Jul 16 18:09:59.162149 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.162116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/875ca822-4339-44a7-a557-3895a8856040-istio-token\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.162149 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.162158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/875ca822-4339-44a7-a557-3895a8856040-istiod-ca-cert\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.162399 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.162280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-credential-socket\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.162399 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.162316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/875ca822-4339-44a7-a557-3895a8856040-istio-podinfo\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.162399 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.162377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-istio-data\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.162399 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.162396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-workload-socket\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.162554 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.162412 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-workload-certs\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.162554 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.162434 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-748zt\" (UniqueName: \"kubernetes.io/projected/875ca822-4339-44a7-a557-3895a8856040-kube-api-access-748zt\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.162554 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.162516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-istio-envoy\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.263533 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.263501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-istio-envoy\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.263746 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.263553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/875ca822-4339-44a7-a557-3895a8856040-istio-token\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.263746 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.263581 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/875ca822-4339-44a7-a557-3895a8856040-istiod-ca-cert\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.263746 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.263633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-credential-socket\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.263746 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.263659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/875ca822-4339-44a7-a557-3895a8856040-istio-podinfo\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.263746 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.263721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-istio-data\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.263746 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.263747 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-workload-socket\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.264067 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.263773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-workload-certs\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.264067 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.263801 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-748zt\" (UniqueName: \"kubernetes.io/projected/875ca822-4339-44a7-a557-3895a8856040-kube-api-access-748zt\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.264067 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.264040 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-credential-socket\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.264227 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.264179 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-istio-data\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.264326 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.264310 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-workload-socket\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.264391 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.264374 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/875ca822-4339-44a7-a557-3895a8856040-istiod-ca-cert\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.264432 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.264392 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-workload-certs\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.265846 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.265824 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-istio-envoy\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.266134 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.266117 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/875ca822-4339-44a7-a557-3895a8856040-istio-podinfo\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.271826 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.271801 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/875ca822-4339-44a7-a557-3895a8856040-istio-token\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.271961 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.271942 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-748zt\" (UniqueName: \"kubernetes.io/projected/875ca822-4339-44a7-a557-3895a8856040-kube-api-access-748zt\") pod \"e2e-mt-9826013b-openshift-default-6459b64dff-45bk6\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.392495 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.392397 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:09:59.534456 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.534429 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6"] Jul 16 18:09:59.536547 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:09:59.536518 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod875ca822_4339_44a7_a557_3895a8856040.slice/crio-4fc141f4c2d3f71942743e8a3d99bf3457e0bee3a5829864ec0c0ff2b3d7de5e WatchSource:0}: Error finding container 4fc141f4c2d3f71942743e8a3d99bf3457e0bee3a5829864ec0c0ff2b3d7de5e: Status 404 returned error can't find the container with id 4fc141f4c2d3f71942743e8a3d99bf3457e0bee3a5829864ec0c0ff2b3d7de5e Jul 16 18:09:59.538640 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.538611 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:09:59.538743 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.538675 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:09:59.538743 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:09:59.538703 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:10:00.179142 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:00.179108 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" event={"ID":"875ca822-4339-44a7-a557-3895a8856040","Type":"ContainerStarted","Data":"2b37cff86295e96130da6f24c9bb58f91679294fafa979b21eb12169a5812f1d"} Jul 16 18:10:00.179570 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:00.179159 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" event={"ID":"875ca822-4339-44a7-a557-3895a8856040","Type":"ContainerStarted","Data":"4fc141f4c2d3f71942743e8a3d99bf3457e0bee3a5829864ec0c0ff2b3d7de5e"} Jul 16 18:10:00.203799 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:00.203737 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" podStartSLOduration=1.203717516 podStartE2EDuration="1.203717516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:09:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:10:00.202420919 +0000 UTC m=+2233.142952823" watchObservedRunningTime="2026-07-16 18:10:00.203717516 +0000 UTC m=+2233.144249421" Jul 16 18:10:00.393350 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:00.393310 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:10:00.398517 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:00.398486 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:10:01.184324 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:01.184293 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:10:01.185444 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:01.185423 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:10:16.238521 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:16.237488 2577 patch_prober.go:28] interesting pod/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": read tcp 10.133.0.2:60620->10.133.0.35:15021: read: connection reset by peer" start-of-body= Jul 16 18:10:16.238521 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:16.237583 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": read tcp 10.133.0.2:60620->10.133.0.35:15021: read: connection reset by peer" Jul 16 18:10:17.256398 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:17.256362 2577 generic.go:356] "Generic (PLEG): container finished" podID="875ca822-4339-44a7-a557-3895a8856040" containerID="2b37cff86295e96130da6f24c9bb58f91679294fafa979b21eb12169a5812f1d" exitCode=0 Jul 16 18:10:17.256859 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:17.256436 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" event={"ID":"875ca822-4339-44a7-a557-3895a8856040","Type":"ContainerDied","Data":"2b37cff86295e96130da6f24c9bb58f91679294fafa979b21eb12169a5812f1d"} Jul 16 18:10:17.256859 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:17.256838 2577 scope.go:117] "RemoveContainer" containerID="2b37cff86295e96130da6f24c9bb58f91679294fafa979b21eb12169a5812f1d" Jul 16 18:10:17.257923 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:17.257895 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:10:17.258002 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:17.257971 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:10:17.258050 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:17.258001 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:10:18.262934 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:18.262901 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" event={"ID":"875ca822-4339-44a7-a557-3895a8856040","Type":"ContainerStarted","Data":"32cb670eabaa9f0f0929c6db06fdda151a1dd426c3fc8355ecdc6b1c7bafd234"} Jul 16 18:10:18.393810 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:18.393777 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:10:18.394272 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:18.394225 2577 patch_prober.go:28] interesting pod/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 16 18:10:18.394466 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:18.394431 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 16 18:10:19.393755 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:19.393712 2577 patch_prober.go:28] interesting pod/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 16 18:10:19.394282 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:19.393781 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 16 18:10:20.393437 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:20.393401 2577 patch_prober.go:28] interesting pod/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 16 18:10:20.393732 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:20.393703 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 16 18:10:21.393369 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:21.393327 2577 patch_prober.go:28] interesting pod/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 16 18:10:21.393903 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:21.393397 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 16 18:10:22.396326 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:22.396296 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:10:22.396792 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:22.396549 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:10:22.397151 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:22.397136 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:10:37.125701 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:37.125668 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6"] Jul 16 18:10:37.126216 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:37.125922 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" containerID="cri-o://32cb670eabaa9f0f0929c6db06fdda151a1dd426c3fc8355ecdc6b1c7bafd234" gracePeriod=30 Jul 16 18:10:37.399068 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:37.398984 2577 patch_prober.go:28] interesting pod/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 16 18:10:37.399068 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:37.399047 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 18:10:42.371164 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.371129 2577 generic.go:356] "Generic (PLEG): container finished" podID="875ca822-4339-44a7-a557-3895a8856040" containerID="32cb670eabaa9f0f0929c6db06fdda151a1dd426c3fc8355ecdc6b1c7bafd234" exitCode=0 Jul 16 18:10:42.371561 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.371177 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" event={"ID":"875ca822-4339-44a7-a557-3895a8856040","Type":"ContainerDied","Data":"32cb670eabaa9f0f0929c6db06fdda151a1dd426c3fc8355ecdc6b1c7bafd234"} Jul 16 18:10:42.371561 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.371232 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" event={"ID":"875ca822-4339-44a7-a557-3895a8856040","Type":"ContainerDied","Data":"4fc141f4c2d3f71942743e8a3d99bf3457e0bee3a5829864ec0c0ff2b3d7de5e"} Jul 16 18:10:42.371561 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.371272 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fc141f4c2d3f71942743e8a3d99bf3457e0bee3a5829864ec0c0ff2b3d7de5e" Jul 16 18:10:42.371561 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.371286 2577 scope.go:117] "RemoveContainer" containerID="2b37cff86295e96130da6f24c9bb58f91679294fafa979b21eb12169a5812f1d" Jul 16 18:10:42.381037 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.381018 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:10:42.460898 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.460797 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/875ca822-4339-44a7-a557-3895a8856040-istio-token\") pod \"875ca822-4339-44a7-a557-3895a8856040\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " Jul 16 18:10:42.460898 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.460858 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-748zt\" (UniqueName: \"kubernetes.io/projected/875ca822-4339-44a7-a557-3895a8856040-kube-api-access-748zt\") pod \"875ca822-4339-44a7-a557-3895a8856040\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " Jul 16 18:10:42.460898 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.460899 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/875ca822-4339-44a7-a557-3895a8856040-istiod-ca-cert\") pod \"875ca822-4339-44a7-a557-3895a8856040\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " Jul 16 18:10:42.461185 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.460946 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/875ca822-4339-44a7-a557-3895a8856040-istio-podinfo\") pod \"875ca822-4339-44a7-a557-3895a8856040\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " Jul 16 18:10:42.461185 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.461011 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-istio-data\") pod \"875ca822-4339-44a7-a557-3895a8856040\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " Jul 16 18:10:42.461185 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.461035 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-istio-envoy\") pod \"875ca822-4339-44a7-a557-3895a8856040\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " Jul 16 18:10:42.461185 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.461082 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-workload-socket\") pod \"875ca822-4339-44a7-a557-3895a8856040\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " Jul 16 18:10:42.461185 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.461125 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-workload-certs\") pod \"875ca822-4339-44a7-a557-3895a8856040\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " Jul 16 18:10:42.461185 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.461171 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-credential-socket\") pod \"875ca822-4339-44a7-a557-3895a8856040\" (UID: \"875ca822-4339-44a7-a557-3895a8856040\") " Jul 16 18:10:42.461516 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.461319 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/875ca822-4339-44a7-a557-3895a8856040-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "875ca822-4339-44a7-a557-3895a8856040" (UID: "875ca822-4339-44a7-a557-3895a8856040"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:10:42.461653 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.461475 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "875ca822-4339-44a7-a557-3895a8856040" (UID: "875ca822-4339-44a7-a557-3895a8856040"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:10:42.461737 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.461638 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/875ca822-4339-44a7-a557-3895a8856040-istiod-ca-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:10:42.461737 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.461555 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "875ca822-4339-44a7-a557-3895a8856040" (UID: "875ca822-4339-44a7-a557-3895a8856040"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:10:42.461835 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.461730 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "875ca822-4339-44a7-a557-3895a8856040" (UID: "875ca822-4339-44a7-a557-3895a8856040"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:10:42.461989 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.461963 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-istio-data" (OuterVolumeSpecName: "istio-data") pod "875ca822-4339-44a7-a557-3895a8856040" (UID: "875ca822-4339-44a7-a557-3895a8856040"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:10:42.463230 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.463206 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/875ca822-4339-44a7-a557-3895a8856040-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "875ca822-4339-44a7-a557-3895a8856040" (UID: "875ca822-4339-44a7-a557-3895a8856040"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 18:10:42.463376 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.463359 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "875ca822-4339-44a7-a557-3895a8856040" (UID: "875ca822-4339-44a7-a557-3895a8856040"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:10:42.463578 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.463551 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/875ca822-4339-44a7-a557-3895a8856040-kube-api-access-748zt" (OuterVolumeSpecName: "kube-api-access-748zt") pod "875ca822-4339-44a7-a557-3895a8856040" (UID: "875ca822-4339-44a7-a557-3895a8856040"). InnerVolumeSpecName "kube-api-access-748zt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:10:42.463680 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.463573 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/875ca822-4339-44a7-a557-3895a8856040-istio-token" (OuterVolumeSpecName: "istio-token") pod "875ca822-4339-44a7-a557-3895a8856040" (UID: "875ca822-4339-44a7-a557-3895a8856040"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:10:42.562193 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.562159 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/875ca822-4339-44a7-a557-3895a8856040-istio-podinfo\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:10:42.562193 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.562186 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-istio-data\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:10:42.562193 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.562196 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-istio-envoy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:10:42.562446 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.562204 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-workload-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:10:42.562446 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.562218 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-workload-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:10:42.562446 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.562228 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/875ca822-4339-44a7-a557-3895a8856040-credential-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:10:42.562446 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.562238 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/875ca822-4339-44a7-a557-3895a8856040-istio-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:10:42.562446 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:42.562246 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-748zt\" (UniqueName: \"kubernetes.io/projected/875ca822-4339-44a7-a557-3895a8856040-kube-api-access-748zt\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:10:43.377018 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:43.376992 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6" Jul 16 18:10:43.412816 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:43.412779 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6"] Jul 16 18:10:43.415469 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:43.415446 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9826013b-openshift-default-6459b64dff-45bk6"] Jul 16 18:10:43.578960 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:43.578916 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="875ca822-4339-44a7-a557-3895a8856040" path="/var/lib/kubelet/pods/875ca822-4339-44a7-a557-3895a8856040/volumes" Jul 16 18:10:59.040881 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.040843 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw"] Jul 16 18:10:59.041387 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.041365 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" Jul 16 18:10:59.041467 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.041390 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" Jul 16 18:10:59.041467 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.041404 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" Jul 16 18:10:59.041467 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.041411 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" Jul 16 18:10:59.041612 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.041516 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" Jul 16 18:10:59.041612 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.041530 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="875ca822-4339-44a7-a557-3895a8856040" containerName="istio-proxy" Jul 16 18:10:59.044740 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.044718 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.046799 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.046779 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7a2e4989-openshift-default-dockercfg-sjkh7\"" Jul 16 18:10:59.063242 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.063213 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw"] Jul 16 18:10:59.113924 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.113889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmtt9\" (UniqueName: \"kubernetes.io/projected/f0815983-0427-416f-bf33-954af4bf84aa-kube-api-access-jmtt9\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.114101 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.113938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0815983-0427-416f-bf33-954af4bf84aa-istiod-ca-cert\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.114101 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.113958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-istio-data\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.114101 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.114029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-workload-certs\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.114101 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.114086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-workload-socket\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.114311 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.114118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0815983-0427-416f-bf33-954af4bf84aa-istio-token\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.114311 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.114147 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-istio-envoy\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.114311 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.114161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0815983-0427-416f-bf33-954af4bf84aa-istio-podinfo\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.114311 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.114226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-credential-socket\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215144 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0815983-0427-416f-bf33-954af4bf84aa-istio-podinfo\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215373 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-credential-socket\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215373 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmtt9\" (UniqueName: \"kubernetes.io/projected/f0815983-0427-416f-bf33-954af4bf84aa-kube-api-access-jmtt9\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215373 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0815983-0427-416f-bf33-954af4bf84aa-istiod-ca-cert\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215373 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-istio-data\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215373 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-workload-certs\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215641 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215381 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-workload-socket\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215641 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0815983-0427-416f-bf33-954af4bf84aa-istio-token\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215641 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-istio-envoy\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215641 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215579 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-credential-socket\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215839 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215639 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-istio-data\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215839 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215733 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-workload-certs\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.215946 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.215842 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-workload-socket\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.216042 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.216018 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0815983-0427-416f-bf33-954af4bf84aa-istiod-ca-cert\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.217734 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.217703 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0815983-0427-416f-bf33-954af4bf84aa-istio-podinfo\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.217850 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.217784 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-istio-envoy\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.229225 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.229200 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0815983-0427-416f-bf33-954af4bf84aa-istio-token\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.229353 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.229225 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmtt9\" (UniqueName: \"kubernetes.io/projected/f0815983-0427-416f-bf33-954af4bf84aa-kube-api-access-jmtt9\") pod \"e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.355432 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.355353 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:10:59.496062 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.496032 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw"] Jul 16 18:10:59.498721 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:10:59.498693 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0815983_0427_416f_bf33_954af4bf84aa.slice/crio-7550e028385368bb1911f6ad0b529b87cd9fdb45a6fa166097a8e4298c617d0e WatchSource:0}: Error finding container 7550e028385368bb1911f6ad0b529b87cd9fdb45a6fa166097a8e4298c617d0e: Status 404 returned error can't find the container with id 7550e028385368bb1911f6ad0b529b87cd9fdb45a6fa166097a8e4298c617d0e Jul 16 18:10:59.500749 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.500715 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:10:59.500853 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.500778 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:10:59.500853 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:10:59.500806 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:11:00.453586 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:00.453546 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" event={"ID":"f0815983-0427-416f-bf33-954af4bf84aa","Type":"ContainerStarted","Data":"a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a"} Jul 16 18:11:00.453976 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:00.453609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" event={"ID":"f0815983-0427-416f-bf33-954af4bf84aa","Type":"ContainerStarted","Data":"7550e028385368bb1911f6ad0b529b87cd9fdb45a6fa166097a8e4298c617d0e"} Jul 16 18:11:00.479975 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:00.479926 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" podStartSLOduration=1.479909329 podStartE2EDuration="1.479909329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:10:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:11:00.477977827 +0000 UTC m=+2293.418509734" watchObservedRunningTime="2026-07-16 18:11:00.479909329 +0000 UTC m=+2293.420441232" Jul 16 18:11:01.355635 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:01.355603 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:11:01.360444 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:01.360415 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:11:01.457898 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:01.457866 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:11:01.458781 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:01.458763 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:11:15.531659 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:15.531622 2577 generic.go:356] "Generic (PLEG): container finished" podID="f0815983-0427-416f-bf33-954af4bf84aa" containerID="a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a" exitCode=0 Jul 16 18:11:15.532077 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:15.531701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" event={"ID":"f0815983-0427-416f-bf33-954af4bf84aa","Type":"ContainerDied","Data":"a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a"} Jul 16 18:11:15.532122 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:15.532110 2577 scope.go:117] "RemoveContainer" containerID="a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a" Jul 16 18:11:15.533101 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:15.533075 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:11:15.533202 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:15.533157 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:11:15.533287 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:15.533204 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:11:16.458505 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:16.458469 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:11:16.538610 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:16.538575 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" event={"ID":"f0815983-0427-416f-bf33-954af4bf84aa","Type":"ContainerStarted","Data":"bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111"} Jul 16 18:11:17.355730 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:17.355689 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:11:17.356816 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:17.356792 2577 patch_prober.go:28] interesting pod/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 16 18:11:17.356931 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:17.356843 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" podUID="f0815983-0427-416f-bf33-954af4bf84aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 16 18:11:18.356214 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:18.356175 2577 patch_prober.go:28] interesting pod/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 16 18:11:18.356659 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:18.356235 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" podUID="f0815983-0427-416f-bf33-954af4bf84aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 16 18:11:19.355942 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:19.355904 2577 patch_prober.go:28] interesting pod/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 16 18:11:19.356120 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:19.355962 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" podUID="f0815983-0427-416f-bf33-954af4bf84aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 16 18:11:20.394017 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:20.393989 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:11:20.394479 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:20.394275 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:11:20.395107 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:11:20.395091 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:12:47.602973 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:47.602946 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 18:12:47.605068 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:47.605048 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 18:12:54.347267 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:54.347217 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw"] Jul 16 18:12:54.347658 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:54.347477 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" podUID="f0815983-0427-416f-bf33-954af4bf84aa" containerName="istio-proxy" containerID="cri-o://bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111" gracePeriod=30 Jul 16 18:12:59.598868 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.598839 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:12:59.699726 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.699650 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-workload-socket\") pod \"f0815983-0427-416f-bf33-954af4bf84aa\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " Jul 16 18:12:59.699726 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.699701 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0815983-0427-416f-bf33-954af4bf84aa-istio-podinfo\") pod \"f0815983-0427-416f-bf33-954af4bf84aa\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " Jul 16 18:12:59.699726 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.699728 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0815983-0427-416f-bf33-954af4bf84aa-istiod-ca-cert\") pod \"f0815983-0427-416f-bf33-954af4bf84aa\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " Jul 16 18:12:59.699952 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.699767 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmtt9\" (UniqueName: \"kubernetes.io/projected/f0815983-0427-416f-bf33-954af4bf84aa-kube-api-access-jmtt9\") pod \"f0815983-0427-416f-bf33-954af4bf84aa\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " Jul 16 18:12:59.699952 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.699783 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0815983-0427-416f-bf33-954af4bf84aa-istio-token\") pod \"f0815983-0427-416f-bf33-954af4bf84aa\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " Jul 16 18:12:59.699952 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.699829 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-workload-certs\") pod \"f0815983-0427-416f-bf33-954af4bf84aa\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " Jul 16 18:12:59.699952 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.699887 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-credential-socket\") pod \"f0815983-0427-416f-bf33-954af4bf84aa\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " Jul 16 18:12:59.699952 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.699930 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-istio-envoy\") pod \"f0815983-0427-416f-bf33-954af4bf84aa\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " Jul 16 18:12:59.700200 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.699944 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f0815983-0427-416f-bf33-954af4bf84aa" (UID: "f0815983-0427-416f-bf33-954af4bf84aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:12:59.700200 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.699961 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-istio-data\") pod \"f0815983-0427-416f-bf33-954af4bf84aa\" (UID: \"f0815983-0427-416f-bf33-954af4bf84aa\") " Jul 16 18:12:59.700200 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.700141 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f0815983-0427-416f-bf33-954af4bf84aa" (UID: "f0815983-0427-416f-bf33-954af4bf84aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:12:59.700200 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.700191 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f0815983-0427-416f-bf33-954af4bf84aa" (UID: "f0815983-0427-416f-bf33-954af4bf84aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:12:59.700414 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.700216 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0815983-0427-416f-bf33-954af4bf84aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f0815983-0427-416f-bf33-954af4bf84aa" (UID: "f0815983-0427-416f-bf33-954af4bf84aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:12:59.700414 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.700308 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-workload-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:12:59.700414 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.700350 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-credential-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:12:59.700414 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.700366 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-workload-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:12:59.700414 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.700381 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0815983-0427-416f-bf33-954af4bf84aa-istiod-ca-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:12:59.701149 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.701124 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "f0815983-0427-416f-bf33-954af4bf84aa" (UID: "f0815983-0427-416f-bf33-954af4bf84aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:12:59.701929 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.701895 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0815983-0427-416f-bf33-954af4bf84aa-kube-api-access-jmtt9" (OuterVolumeSpecName: "kube-api-access-jmtt9") pod "f0815983-0427-416f-bf33-954af4bf84aa" (UID: "f0815983-0427-416f-bf33-954af4bf84aa"). InnerVolumeSpecName "kube-api-access-jmtt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:12:59.702185 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.702164 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f0815983-0427-416f-bf33-954af4bf84aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f0815983-0427-416f-bf33-954af4bf84aa" (UID: "f0815983-0427-416f-bf33-954af4bf84aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 18:12:59.702285 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.702243 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0815983-0427-416f-bf33-954af4bf84aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "f0815983-0427-416f-bf33-954af4bf84aa" (UID: "f0815983-0427-416f-bf33-954af4bf84aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:12:59.702379 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.702313 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f0815983-0427-416f-bf33-954af4bf84aa" (UID: "f0815983-0427-416f-bf33-954af4bf84aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:12:59.800819 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.800788 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmtt9\" (UniqueName: \"kubernetes.io/projected/f0815983-0427-416f-bf33-954af4bf84aa-kube-api-access-jmtt9\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:12:59.800819 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.800815 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0815983-0427-416f-bf33-954af4bf84aa-istio-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:12:59.800819 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.800826 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-istio-envoy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:12:59.801041 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.800834 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0815983-0427-416f-bf33-954af4bf84aa-istio-data\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:12:59.801041 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:12:59.800848 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0815983-0427-416f-bf33-954af4bf84aa-istio-podinfo\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:13:00.001677 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:00.001643 2577 generic.go:356] "Generic (PLEG): container finished" podID="f0815983-0427-416f-bf33-954af4bf84aa" containerID="bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111" exitCode=0 Jul 16 18:13:00.001877 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:00.001703 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" Jul 16 18:13:00.001877 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:00.001728 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" event={"ID":"f0815983-0427-416f-bf33-954af4bf84aa","Type":"ContainerDied","Data":"bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111"} Jul 16 18:13:00.001877 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:00.001787 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw" event={"ID":"f0815983-0427-416f-bf33-954af4bf84aa","Type":"ContainerDied","Data":"7550e028385368bb1911f6ad0b529b87cd9fdb45a6fa166097a8e4298c617d0e"} Jul 16 18:13:00.001877 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:00.001815 2577 scope.go:117] "RemoveContainer" containerID="bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111" Jul 16 18:13:00.010870 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:00.010852 2577 scope.go:117] "RemoveContainer" containerID="a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a" Jul 16 18:13:00.018567 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:00.018550 2577 scope.go:117] "RemoveContainer" containerID="bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111" Jul 16 18:13:00.018806 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:13:00.018788 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111\": container with ID starting with bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111 not found: ID does not exist" containerID="bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111" Jul 16 18:13:00.018852 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:00.018815 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111"} err="failed to get container status \"bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111\": rpc error: code = NotFound desc = could not find container \"bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111\": container with ID starting with bcf164b64d45457c0569a602e2337c44d2b0d46449c4b93da78d5772f6e0d111 not found: ID does not exist" Jul 16 18:13:00.018852 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:00.018831 2577 scope.go:117] "RemoveContainer" containerID="a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a" Jul 16 18:13:00.019042 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:13:00.019028 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a\": container with ID starting with a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a not found: ID does not exist" containerID="a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a" Jul 16 18:13:00.019085 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:00.019045 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a"} err="failed to get container status \"a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a\": rpc error: code = NotFound desc = could not find container \"a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a\": container with ID starting with a806e0e0f406a9cf33a197573fe652b18f5d49ad355de11189536992eca7f22a not found: ID does not exist" Jul 16 18:13:00.060735 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:00.060706 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw"] Jul 16 18:13:00.096924 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:00.096896 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7a2e4989-openshift-default-6ddc5c4767-znwqw"] Jul 16 18:13:01.578370 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:01.578336 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0815983-0427-416f-bf33-954af4bf84aa" path="/var/lib/kubelet/pods/f0815983-0427-416f-bf33-954af4bf84aa/volumes" Jul 16 18:13:55.501003 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.500968 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr"] Jul 16 18:13:55.501476 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.501407 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0815983-0427-416f-bf33-954af4bf84aa" containerName="istio-proxy" Jul 16 18:13:55.501476 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.501421 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0815983-0427-416f-bf33-954af4bf84aa" containerName="istio-proxy" Jul 16 18:13:55.501568 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.501489 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0815983-0427-416f-bf33-954af4bf84aa" containerName="istio-proxy" Jul 16 18:13:55.501568 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.501497 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0815983-0427-416f-bf33-954af4bf84aa" containerName="istio-proxy" Jul 16 18:13:55.504451 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.504433 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.506719 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.506697 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a1a1f5-openshift-default-dockercfg-fprnv\"" Jul 16 18:13:55.520983 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.520956 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr"] Jul 16 18:13:55.602987 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.602945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6jsk\" (UniqueName: \"kubernetes.io/projected/c2d23aa5-73f4-4536-b021-fc5f366c5631-kube-api-access-f6jsk\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.603196 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.602990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-token\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.603196 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.603039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-workload-socket\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.603196 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.603066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2d23aa5-73f4-4536-b021-fc5f366c5631-istiod-ca-cert\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.603196 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.603125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-credential-socket\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.603196 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.603161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-podinfo\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.603196 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.603191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-envoy\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.603557 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.603330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-workload-certs\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.603557 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.603349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-data\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.703952 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.703921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-workload-socket\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.704146 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.703968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2d23aa5-73f4-4536-b021-fc5f366c5631-istiod-ca-cert\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.704146 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.704013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-credential-socket\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.704146 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.704042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-podinfo\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.704346 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.704160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-envoy\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.704346 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.704217 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-workload-certs\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.704346 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.704245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-data\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.704501 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.704354 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6jsk\" (UniqueName: \"kubernetes.io/projected/c2d23aa5-73f4-4536-b021-fc5f366c5631-kube-api-access-f6jsk\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.704501 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.704386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-token\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.704845 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.704813 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-workload-socket\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.704969 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.704848 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-workload-certs\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.705043 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.705014 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-credential-socket\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.705103 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.705053 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-data\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.705164 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.705139 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2d23aa5-73f4-4536-b021-fc5f366c5631-istiod-ca-cert\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.706606 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.706579 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-envoy\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.706727 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.706709 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-podinfo\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.716315 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.716289 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6jsk\" (UniqueName: \"kubernetes.io/projected/c2d23aa5-73f4-4536-b021-fc5f366c5631-kube-api-access-f6jsk\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.716423 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.716407 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-token\") pod \"e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.814511 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.814429 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:55.953995 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.953963 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr"] Jul 16 18:13:55.956389 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:13:55.956364 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d23aa5_73f4_4536_b021_fc5f366c5631.slice/crio-26b2ced3c7782338b1ff0efb7cd47f8453ded013e77fe3ca42c8b1d6328d33d2 WatchSource:0}: Error finding container 26b2ced3c7782338b1ff0efb7cd47f8453ded013e77fe3ca42c8b1d6328d33d2: Status 404 returned error can't find the container with id 26b2ced3c7782338b1ff0efb7cd47f8453ded013e77fe3ca42c8b1d6328d33d2 Jul 16 18:13:55.958438 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.958405 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:13:55.958527 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.958469 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:13:55.958527 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:55.958497 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:13:56.257243 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:56.257209 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" event={"ID":"c2d23aa5-73f4-4536-b021-fc5f366c5631","Type":"ContainerStarted","Data":"ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170"} Jul 16 18:13:56.257434 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:56.257291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" event={"ID":"c2d23aa5-73f4-4536-b021-fc5f366c5631","Type":"ContainerStarted","Data":"26b2ced3c7782338b1ff0efb7cd47f8453ded013e77fe3ca42c8b1d6328d33d2"} Jul 16 18:13:56.281613 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:56.281475 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" podStartSLOduration=1.281456765 podStartE2EDuration="1.281456765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:13:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:13:56.279999848 +0000 UTC m=+2469.220531751" watchObservedRunningTime="2026-07-16 18:13:56.281456765 +0000 UTC m=+2469.221988670" Jul 16 18:13:56.814933 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:56.814893 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:57.820128 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:57.820104 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:58.266593 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:58.266563 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:13:58.267421 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:13:58.267404 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:14:03.961904 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.961875 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s"] Jul 16 18:14:03.962418 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.962398 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0815983-0427-416f-bf33-954af4bf84aa" containerName="istio-proxy" Jul 16 18:14:03.962470 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.962421 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0815983-0427-416f-bf33-954af4bf84aa" containerName="istio-proxy" Jul 16 18:14:03.965603 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.965588 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:03.969736 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.969716 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-28bbcf-openshift-default-dockercfg-6fnv4\"" Jul 16 18:14:03.980523 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.980501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-credential-socket\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:03.980639 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.980538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-workload-certs\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:03.980687 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.980642 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5470422b-9265-481a-a341-49e8fa64d147-istiod-ca-cert\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:03.980687 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.980675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5470422b-9265-481a-a341-49e8fa64d147-istio-token\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:03.980770 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.980700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b62nk\" (UniqueName: \"kubernetes.io/projected/5470422b-9265-481a-a341-49e8fa64d147-kube-api-access-b62nk\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:03.980770 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.980732 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-workload-socket\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:03.980854 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.980764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5470422b-9265-481a-a341-49e8fa64d147-istio-podinfo\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:03.980854 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.980821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-istio-envoy\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:03.980923 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.980851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-istio-data\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:03.987905 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:03.987872 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s"] Jul 16 18:14:04.081294 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.081241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5470422b-9265-481a-a341-49e8fa64d147-istio-token\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.081294 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.081299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b62nk\" (UniqueName: \"kubernetes.io/projected/5470422b-9265-481a-a341-49e8fa64d147-kube-api-access-b62nk\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.081543 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.081324 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-workload-socket\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.081543 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.081354 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5470422b-9265-481a-a341-49e8fa64d147-istio-podinfo\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.081543 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.081461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-istio-envoy\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.081543 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.081496 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-istio-data\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.081744 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.081553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-credential-socket\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.081744 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.081591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-workload-certs\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.081744 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.081665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5470422b-9265-481a-a341-49e8fa64d147-istiod-ca-cert\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.081910 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.081750 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-workload-socket\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.082025 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.082002 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-istio-data\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.082095 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.082050 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-credential-socket\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.082141 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.082083 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-workload-certs\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.082497 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.082475 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5470422b-9265-481a-a341-49e8fa64d147-istiod-ca-cert\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.083820 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.083792 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-istio-envoy\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.083951 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.083931 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5470422b-9265-481a-a341-49e8fa64d147-istio-podinfo\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.092346 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.092315 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b62nk\" (UniqueName: \"kubernetes.io/projected/5470422b-9265-481a-a341-49e8fa64d147-kube-api-access-b62nk\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.092673 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.092655 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5470422b-9265-481a-a341-49e8fa64d147-istio-token\") pod \"e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.275755 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.275718 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:04.427788 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.427747 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s"] Jul 16 18:14:04.430590 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:14:04.430561 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5470422b_9265_481a_a341_49e8fa64d147.slice/crio-79aa8a7c95c562266d69c84a66f34a2e5808c3d8af8161035777a01ab19449c8 WatchSource:0}: Error finding container 79aa8a7c95c562266d69c84a66f34a2e5808c3d8af8161035777a01ab19449c8: Status 404 returned error can't find the container with id 79aa8a7c95c562266d69c84a66f34a2e5808c3d8af8161035777a01ab19449c8 Jul 16 18:14:04.432649 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.432618 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:14:04.432714 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.432686 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:14:04.432751 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:04.432715 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:14:05.299300 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:05.299244 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" event={"ID":"5470422b-9265-481a-a341-49e8fa64d147","Type":"ContainerStarted","Data":"bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914"} Jul 16 18:14:05.299784 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:05.299328 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" event={"ID":"5470422b-9265-481a-a341-49e8fa64d147","Type":"ContainerStarted","Data":"79aa8a7c95c562266d69c84a66f34a2e5808c3d8af8161035777a01ab19449c8"} Jul 16 18:14:05.330303 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:05.330243 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" podStartSLOduration=2.33022851 podStartE2EDuration="2.33022851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:14:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:14:05.327465763 +0000 UTC m=+2478.267997662" watchObservedRunningTime="2026-07-16 18:14:05.33022851 +0000 UTC m=+2478.270760413" Jul 16 18:14:06.276143 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:06.276104 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:06.280883 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:06.280857 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:06.303726 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:06.303700 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:06.304558 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:06.304542 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:14.308550 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:14.308434 2577 patch_prober.go:28] interesting pod/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 16 18:14:14.308550 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:14.308527 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 16 18:14:17.357572 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:17.357533 2577 generic.go:356] "Generic (PLEG): container finished" podID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerID="ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170" exitCode=0 Jul 16 18:14:17.358047 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:17.357611 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" event={"ID":"c2d23aa5-73f4-4536-b021-fc5f366c5631","Type":"ContainerDied","Data":"ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170"} Jul 16 18:14:17.358119 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:17.358075 2577 scope.go:117] "RemoveContainer" containerID="ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170" Jul 16 18:14:17.359131 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:17.359104 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:14:17.359212 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:17.359173 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:14:17.359285 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:17.359211 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:14:18.364727 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:18.364686 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" event={"ID":"c2d23aa5-73f4-4536-b021-fc5f366c5631","Type":"ContainerStarted","Data":"7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841"} Jul 16 18:14:18.815077 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:18.815031 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:14:18.815356 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:18.815328 2577 patch_prober.go:28] interesting pod/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 16 18:14:18.815413 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:18.815390 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 16 18:14:19.815596 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:19.815556 2577 patch_prober.go:28] interesting pod/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 16 18:14:19.815979 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:19.815608 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 16 18:14:20.815927 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:20.815737 2577 patch_prober.go:28] interesting pod/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 16 18:14:20.815927 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:20.815827 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 16 18:14:21.306046 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:21.305715 2577 patch_prober.go:28] interesting pod/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 16 18:14:21.306046 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:21.305775 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" podUID="5470422b-9265-481a-a341-49e8fa64d147" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 16 18:14:21.380768 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:21.380735 2577 generic.go:356] "Generic (PLEG): container finished" podID="5470422b-9265-481a-a341-49e8fa64d147" containerID="bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914" exitCode=0 Jul 16 18:14:21.380934 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:21.380810 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" event={"ID":"5470422b-9265-481a-a341-49e8fa64d147","Type":"ContainerDied","Data":"bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914"} Jul 16 18:14:21.381218 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:21.381203 2577 scope.go:117] "RemoveContainer" containerID="bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914" Jul 16 18:14:21.382155 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:21.382128 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:14:21.382210 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:21.382194 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:14:21.382245 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:21.382225 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:14:21.815155 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:21.815111 2577 patch_prober.go:28] interesting pod/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 16 18:14:21.815368 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:21.815182 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 16 18:14:22.387613 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:22.387569 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" event={"ID":"5470422b-9265-481a-a341-49e8fa64d147","Type":"ContainerStarted","Data":"3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775"} Jul 16 18:14:22.818600 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:22.818569 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:14:22.818886 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:22.818861 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:14:22.819516 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:22.819497 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:14:23.276098 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:23.276064 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:23.276347 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:23.276323 2577 patch_prober.go:28] interesting pod/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 16 18:14:23.276405 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:23.276374 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" podUID="5470422b-9265-481a-a341-49e8fa64d147" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 16 18:14:24.276723 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:24.276684 2577 patch_prober.go:28] interesting pod/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 16 18:14:24.277120 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:24.276740 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" podUID="5470422b-9265-481a-a341-49e8fa64d147" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 16 18:14:25.276454 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:25.276413 2577 patch_prober.go:28] interesting pod/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 16 18:14:25.276650 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:25.276487 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" podUID="5470422b-9265-481a-a341-49e8fa64d147" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 16 18:14:26.276345 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:26.276307 2577 patch_prober.go:28] interesting pod/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 16 18:14:26.276749 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:26.276378 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" podUID="5470422b-9265-481a-a341-49e8fa64d147" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 16 18:14:27.279987 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:27.279959 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:27.280392 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:27.280222 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:14:27.280943 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:14:27.280926 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:16:36.012261 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:36.012210 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr"] Jul 16 18:16:36.012693 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:36.012517 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" containerID="cri-o://7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841" gracePeriod=30 Jul 16 18:16:37.821868 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:37.821831 2577 patch_prober.go:28] interesting pod/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 18:16:37.822223 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:37.821900 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 18:16:41.263481 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.263457 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:16:41.458727 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.458621 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-workload-certs\") pod \"c2d23aa5-73f4-4536-b021-fc5f366c5631\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " Jul 16 18:16:41.458727 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.458674 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-podinfo\") pod \"c2d23aa5-73f4-4536-b021-fc5f366c5631\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " Jul 16 18:16:41.458727 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.458725 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-credential-socket\") pod \"c2d23aa5-73f4-4536-b021-fc5f366c5631\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " Jul 16 18:16:41.459013 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.458752 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6jsk\" (UniqueName: \"kubernetes.io/projected/c2d23aa5-73f4-4536-b021-fc5f366c5631-kube-api-access-f6jsk\") pod \"c2d23aa5-73f4-4536-b021-fc5f366c5631\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " Jul 16 18:16:41.459013 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.458778 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2d23aa5-73f4-4536-b021-fc5f366c5631-istiod-ca-cert\") pod \"c2d23aa5-73f4-4536-b021-fc5f366c5631\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " Jul 16 18:16:41.459013 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.458930 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-data\") pod \"c2d23aa5-73f4-4536-b021-fc5f366c5631\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " Jul 16 18:16:41.459013 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.458977 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-envoy\") pod \"c2d23aa5-73f4-4536-b021-fc5f366c5631\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " Jul 16 18:16:41.459306 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.458993 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c2d23aa5-73f4-4536-b021-fc5f366c5631" (UID: "c2d23aa5-73f4-4536-b021-fc5f366c5631"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:16:41.459306 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.459024 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-workload-socket\") pod \"c2d23aa5-73f4-4536-b021-fc5f366c5631\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " Jul 16 18:16:41.459306 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.459108 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-token\") pod \"c2d23aa5-73f4-4536-b021-fc5f366c5631\" (UID: \"c2d23aa5-73f4-4536-b021-fc5f366c5631\") " Jul 16 18:16:41.459306 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.459163 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d23aa5-73f4-4536-b021-fc5f366c5631-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c2d23aa5-73f4-4536-b021-fc5f366c5631" (UID: "c2d23aa5-73f4-4536-b021-fc5f366c5631"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:16:41.459306 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.459292 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c2d23aa5-73f4-4536-b021-fc5f366c5631" (UID: "c2d23aa5-73f4-4536-b021-fc5f366c5631"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:16:41.459580 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.459424 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c2d23aa5-73f4-4536-b021-fc5f366c5631" (UID: "c2d23aa5-73f4-4536-b021-fc5f366c5631"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:16:41.459580 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.459549 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-workload-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:16:41.459580 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.459569 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-workload-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:16:41.459727 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.459583 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-credential-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:16:41.459727 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.459596 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2d23aa5-73f4-4536-b021-fc5f366c5631-istiod-ca-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:16:41.459808 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.459784 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-data" (OuterVolumeSpecName: "istio-data") pod "c2d23aa5-73f4-4536-b021-fc5f366c5631" (UID: "c2d23aa5-73f4-4536-b021-fc5f366c5631"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:16:41.461113 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.461093 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c2d23aa5-73f4-4536-b021-fc5f366c5631" (UID: "c2d23aa5-73f4-4536-b021-fc5f366c5631"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 18:16:41.461205 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.461137 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c2d23aa5-73f4-4536-b021-fc5f366c5631" (UID: "c2d23aa5-73f4-4536-b021-fc5f366c5631"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:16:41.461437 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.461418 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d23aa5-73f4-4536-b021-fc5f366c5631-kube-api-access-f6jsk" (OuterVolumeSpecName: "kube-api-access-f6jsk") pod "c2d23aa5-73f4-4536-b021-fc5f366c5631" (UID: "c2d23aa5-73f4-4536-b021-fc5f366c5631"). InnerVolumeSpecName "kube-api-access-f6jsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:16:41.461506 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.461480 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-token" (OuterVolumeSpecName: "istio-token") pod "c2d23aa5-73f4-4536-b021-fc5f366c5631" (UID: "c2d23aa5-73f4-4536-b021-fc5f366c5631"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:16:41.560984 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.560946 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-data\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:16:41.560984 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.560974 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-envoy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:16:41.560984 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.560984 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:16:41.560984 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.560992 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2d23aa5-73f4-4536-b021-fc5f366c5631-istio-podinfo\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:16:41.561246 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:41.561001 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6jsk\" (UniqueName: \"kubernetes.io/projected/c2d23aa5-73f4-4536-b021-fc5f366c5631-kube-api-access-f6jsk\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:16:42.041868 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:42.041829 2577 generic.go:356] "Generic (PLEG): container finished" podID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerID="7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841" exitCode=0 Jul 16 18:16:42.042068 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:42.041887 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" Jul 16 18:16:42.042068 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:42.041916 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" event={"ID":"c2d23aa5-73f4-4536-b021-fc5f366c5631","Type":"ContainerDied","Data":"7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841"} Jul 16 18:16:42.042068 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:42.041971 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr" event={"ID":"c2d23aa5-73f4-4536-b021-fc5f366c5631","Type":"ContainerDied","Data":"26b2ced3c7782338b1ff0efb7cd47f8453ded013e77fe3ca42c8b1d6328d33d2"} Jul 16 18:16:42.042068 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:42.041995 2577 scope.go:117] "RemoveContainer" containerID="7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841" Jul 16 18:16:42.050547 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:42.050533 2577 scope.go:117] "RemoveContainer" containerID="ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170" Jul 16 18:16:42.057872 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:42.057854 2577 scope.go:117] "RemoveContainer" containerID="7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841" Jul 16 18:16:42.058121 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:16:42.058101 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841\": container with ID starting with 7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841 not found: ID does not exist" containerID="7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841" Jul 16 18:16:42.058184 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:42.058131 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841"} err="failed to get container status \"7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841\": rpc error: code = NotFound desc = could not find container \"7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841\": container with ID starting with 7875dcab0ea93fba1dd65bd423a098b455492dde78b3789324f6f4895d06e841 not found: ID does not exist" Jul 16 18:16:42.058184 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:42.058148 2577 scope.go:117] "RemoveContainer" containerID="ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170" Jul 16 18:16:42.058406 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:16:42.058390 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170\": container with ID starting with ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170 not found: ID does not exist" containerID="ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170" Jul 16 18:16:42.058454 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:42.058411 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170"} err="failed to get container status \"ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170\": rpc error: code = NotFound desc = could not find container \"ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170\": container with ID starting with ed9a7efe0205fcf0e7ea7ea1339f486f9fd3a77591e0f132bc5ef0fcef3f3170 not found: ID does not exist" Jul 16 18:16:42.061618 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:42.061595 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr"] Jul 16 18:16:42.066538 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:42.066518 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a1a1f5-openshift-default-dc467f579-nlhmr"] Jul 16 18:16:43.580661 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:43.580625 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" path="/var/lib/kubelet/pods/c2d23aa5-73f4-4536-b021-fc5f366c5631/volumes" Jul 16 18:16:47.709342 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:47.709312 2577 scope.go:117] "RemoveContainer" containerID="32cb670eabaa9f0f0929c6db06fdda151a1dd426c3fc8355ecdc6b1c7bafd234" Jul 16 18:16:58.787714 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:58.787681 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s"] Jul 16 18:16:58.788121 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:58.787870 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" podUID="5470422b-9265-481a-a341-49e8fa64d147" containerName="istio-proxy" containerID="cri-o://3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775" gracePeriod=30 Jul 16 18:16:59.825296 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.825245 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s"] Jul 16 18:16:59.825776 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.825755 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" Jul 16 18:16:59.825870 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.825781 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" Jul 16 18:16:59.825870 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.825800 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" Jul 16 18:16:59.825870 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.825809 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" Jul 16 18:16:59.826022 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.825925 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" Jul 16 18:16:59.826022 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.825940 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d23aa5-73f4-4536-b021-fc5f366c5631" containerName="istio-proxy" Jul 16 18:16:59.829068 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.829047 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:16:59.831228 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.831208 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-e55530-openshift-default-dockercfg-4rxnf\"" Jul 16 18:16:59.842739 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.842718 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s"] Jul 16 18:16:59.918544 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.918505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-workload-socket\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:16:59.918544 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.918548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-credential-socket\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:16:59.918812 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.918576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-token\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:16:59.918812 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.918624 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istiod-ca-cert\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:16:59.918812 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.918650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-podinfo\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:16:59.918812 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.918678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-data\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:16:59.918812 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.918745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-workload-certs\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:16:59.918812 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.918765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbmxc\" (UniqueName: \"kubernetes.io/projected/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-kube-api-access-pbmxc\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:16:59.919101 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:16:59.918836 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-envoy\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.019373 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.019331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-workload-socket\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.019570 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.019380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-credential-socket\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.019570 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.019416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-token\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.019570 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.019438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istiod-ca-cert\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.019570 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.019477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-podinfo\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.019795 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.019518 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-data\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.019795 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.019649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-workload-certs\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.019795 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.019680 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbmxc\" (UniqueName: \"kubernetes.io/projected/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-kube-api-access-pbmxc\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.019795 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.019735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-envoy\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.020000 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.019863 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-credential-socket\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.020357 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.020309 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-workload-certs\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.020357 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.020335 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-data\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.020552 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.020360 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istiod-ca-cert\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.020552 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.020389 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-workload-socket\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.022183 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.022154 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-envoy\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.022520 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.022497 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-podinfo\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.027575 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.027552 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-token\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.027710 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.027637 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbmxc\" (UniqueName: \"kubernetes.io/projected/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-kube-api-access-pbmxc\") pod \"e2e-api-a-e55530-openshift-default-5d59688685-8885s\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.139210 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.139124 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:00.275805 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.275780 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s"] Jul 16 18:17:00.278424 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:17:00.278392 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5672d8_65a3_4be1_9fca_bfce1b8bcbce.slice/crio-b5f355be7c08c03b316cda06615b07a6bd075492bd74ccecf98281b8d53e95a1 WatchSource:0}: Error finding container b5f355be7c08c03b316cda06615b07a6bd075492bd74ccecf98281b8d53e95a1: Status 404 returned error can't find the container with id b5f355be7c08c03b316cda06615b07a6bd075492bd74ccecf98281b8d53e95a1 Jul 16 18:17:00.280475 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.280447 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:17:00.280553 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.280508 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:17:00.280553 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:00.280536 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:17:01.138440 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:01.138402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" event={"ID":"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce","Type":"ContainerStarted","Data":"a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701"} Jul 16 18:17:01.138805 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:01.138487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" event={"ID":"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce","Type":"ContainerStarted","Data":"b5f355be7c08c03b316cda06615b07a6bd075492bd74ccecf98281b8d53e95a1"} Jul 16 18:17:01.139751 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:01.139735 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:01.144311 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:01.144291 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:01.163330 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:01.163285 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" podStartSLOduration=2.163247715 podStartE2EDuration="2.163247715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:16:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:17:01.161145539 +0000 UTC m=+2654.101677528" watchObservedRunningTime="2026-07-16 18:17:01.163247715 +0000 UTC m=+2654.103779625" Jul 16 18:17:02.142861 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:02.142823 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:02.143837 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:02.143813 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:04.039373 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.039349 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:17:04.153082 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.152992 2577 generic.go:356] "Generic (PLEG): container finished" podID="5470422b-9265-481a-a341-49e8fa64d147" containerID="3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775" exitCode=0 Jul 16 18:17:04.153082 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.153065 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" Jul 16 18:17:04.153082 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.153069 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" event={"ID":"5470422b-9265-481a-a341-49e8fa64d147","Type":"ContainerDied","Data":"3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775"} Jul 16 18:17:04.153341 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.153128 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s" event={"ID":"5470422b-9265-481a-a341-49e8fa64d147","Type":"ContainerDied","Data":"79aa8a7c95c562266d69c84a66f34a2e5808c3d8af8161035777a01ab19449c8"} Jul 16 18:17:04.153341 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.153154 2577 scope.go:117] "RemoveContainer" containerID="3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775" Jul 16 18:17:04.158350 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158331 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5470422b-9265-481a-a341-49e8fa64d147-istiod-ca-cert\") pod \"5470422b-9265-481a-a341-49e8fa64d147\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " Jul 16 18:17:04.158465 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158358 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-istio-envoy\") pod \"5470422b-9265-481a-a341-49e8fa64d147\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " Jul 16 18:17:04.158465 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158389 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-workload-socket\") pod \"5470422b-9265-481a-a341-49e8fa64d147\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " Jul 16 18:17:04.158465 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158419 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-istio-data\") pod \"5470422b-9265-481a-a341-49e8fa64d147\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " Jul 16 18:17:04.158465 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158455 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5470422b-9265-481a-a341-49e8fa64d147-istio-podinfo\") pod \"5470422b-9265-481a-a341-49e8fa64d147\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " Jul 16 18:17:04.158666 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158475 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-workload-certs\") pod \"5470422b-9265-481a-a341-49e8fa64d147\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " Jul 16 18:17:04.158666 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158505 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5470422b-9265-481a-a341-49e8fa64d147-istio-token\") pod \"5470422b-9265-481a-a341-49e8fa64d147\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " Jul 16 18:17:04.158666 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158557 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-credential-socket\") pod \"5470422b-9265-481a-a341-49e8fa64d147\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " Jul 16 18:17:04.158666 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158585 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b62nk\" (UniqueName: \"kubernetes.io/projected/5470422b-9265-481a-a341-49e8fa64d147-kube-api-access-b62nk\") pod \"5470422b-9265-481a-a341-49e8fa64d147\" (UID: \"5470422b-9265-481a-a341-49e8fa64d147\") " Jul 16 18:17:04.158666 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158638 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5470422b-9265-481a-a341-49e8fa64d147" (UID: "5470422b-9265-481a-a341-49e8fa64d147"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:17:04.158924 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158824 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5470422b-9265-481a-a341-49e8fa64d147-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5470422b-9265-481a-a341-49e8fa64d147" (UID: "5470422b-9265-481a-a341-49e8fa64d147"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:17:04.158924 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158894 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5470422b-9265-481a-a341-49e8fa64d147" (UID: "5470422b-9265-481a-a341-49e8fa64d147"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:17:04.158924 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158903 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-workload-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:04.159180 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.158820 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5470422b-9265-481a-a341-49e8fa64d147" (UID: "5470422b-9265-481a-a341-49e8fa64d147"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:17:04.159741 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.159711 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-istio-data" (OuterVolumeSpecName: "istio-data") pod "5470422b-9265-481a-a341-49e8fa64d147" (UID: "5470422b-9265-481a-a341-49e8fa64d147"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:17:04.160937 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.160910 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5470422b-9265-481a-a341-49e8fa64d147" (UID: "5470422b-9265-481a-a341-49e8fa64d147"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:17:04.161014 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.160957 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5470422b-9265-481a-a341-49e8fa64d147-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5470422b-9265-481a-a341-49e8fa64d147" (UID: "5470422b-9265-481a-a341-49e8fa64d147"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 18:17:04.161108 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.161082 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5470422b-9265-481a-a341-49e8fa64d147-istio-token" (OuterVolumeSpecName: "istio-token") pod "5470422b-9265-481a-a341-49e8fa64d147" (UID: "5470422b-9265-481a-a341-49e8fa64d147"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:17:04.161221 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.161122 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5470422b-9265-481a-a341-49e8fa64d147-kube-api-access-b62nk" (OuterVolumeSpecName: "kube-api-access-b62nk") pod "5470422b-9265-481a-a341-49e8fa64d147" (UID: "5470422b-9265-481a-a341-49e8fa64d147"). InnerVolumeSpecName "kube-api-access-b62nk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:17:04.162107 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.162093 2577 scope.go:117] "RemoveContainer" containerID="bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914" Jul 16 18:17:04.177800 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.177780 2577 scope.go:117] "RemoveContainer" containerID="3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775" Jul 16 18:17:04.178067 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:17:04.178045 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775\": container with ID starting with 3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775 not found: ID does not exist" containerID="3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775" Jul 16 18:17:04.178114 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.178076 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775"} err="failed to get container status \"3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775\": rpc error: code = NotFound desc = could not find container \"3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775\": container with ID starting with 3c400047b29fe179c170e9c1dd86c90d164f81dc4c3704d82bb0aee6ee5f7775 not found: ID does not exist" Jul 16 18:17:04.178114 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.178095 2577 scope.go:117] "RemoveContainer" containerID="bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914" Jul 16 18:17:04.178320 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:17:04.178304 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914\": container with ID starting with bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914 not found: ID does not exist" containerID="bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914" Jul 16 18:17:04.178370 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.178324 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914"} err="failed to get container status \"bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914\": rpc error: code = NotFound desc = could not find container \"bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914\": container with ID starting with bbb27c3332c3350542e9f4b89024cebb4ee5499e35a94b5521fbc8ecf5c28914 not found: ID does not exist" Jul 16 18:17:04.259974 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.259940 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5470422b-9265-481a-a341-49e8fa64d147-istio-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:04.259974 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.259968 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-credential-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:04.259974 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.259977 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b62nk\" (UniqueName: \"kubernetes.io/projected/5470422b-9265-481a-a341-49e8fa64d147-kube-api-access-b62nk\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:04.259974 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.259986 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5470422b-9265-481a-a341-49e8fa64d147-istiod-ca-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:04.260351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.259995 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-istio-envoy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:04.260351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.260002 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-istio-data\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:04.260351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.260011 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5470422b-9265-481a-a341-49e8fa64d147-istio-podinfo\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:04.260351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.260025 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5470422b-9265-481a-a341-49e8fa64d147-workload-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:04.476509 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.476483 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s"] Jul 16 18:17:04.481434 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:04.481411 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-28bbcf-openshift-default-6dfdd49665-lpl4s"] Jul 16 18:17:05.578583 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:05.578541 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5470422b-9265-481a-a341-49e8fa64d147" path="/var/lib/kubelet/pods/5470422b-9265-481a-a341-49e8fa64d147/volumes" Jul 16 18:17:08.620968 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.620918 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs"] Jul 16 18:17:08.621377 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.621361 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5470422b-9265-481a-a341-49e8fa64d147" containerName="istio-proxy" Jul 16 18:17:08.621425 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.621379 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5470422b-9265-481a-a341-49e8fa64d147" containerName="istio-proxy" Jul 16 18:17:08.621425 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.621387 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5470422b-9265-481a-a341-49e8fa64d147" containerName="istio-proxy" Jul 16 18:17:08.621425 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.621395 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5470422b-9265-481a-a341-49e8fa64d147" containerName="istio-proxy" Jul 16 18:17:08.621531 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.621463 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5470422b-9265-481a-a341-49e8fa64d147" containerName="istio-proxy" Jul 16 18:17:08.621531 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.621471 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5470422b-9265-481a-a341-49e8fa64d147" containerName="istio-proxy" Jul 16 18:17:08.625947 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.625928 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.628386 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.628368 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-502744-openshift-default-dockercfg-jkh9k\"" Jul 16 18:17:08.635383 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.635360 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs"] Jul 16 18:17:08.701967 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.701939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-workload-socket\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.702127 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.701974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4713b18a-bee9-4096-832f-06a62a6ad6f4-istiod-ca-cert\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.702127 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.701998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-envoy\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.702127 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.702032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-data\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.702127 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.702064 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-credential-socket\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.702127 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.702096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-workload-certs\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.702316 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.702138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-podinfo\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.702316 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.702173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-token\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.702316 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.702228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lztl\" (UniqueName: \"kubernetes.io/projected/4713b18a-bee9-4096-832f-06a62a6ad6f4-kube-api-access-9lztl\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.803129 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.803093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-token\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.803351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.803150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lztl\" (UniqueName: \"kubernetes.io/projected/4713b18a-bee9-4096-832f-06a62a6ad6f4-kube-api-access-9lztl\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.803351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.803175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-workload-socket\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.803351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.803198 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4713b18a-bee9-4096-832f-06a62a6ad6f4-istiod-ca-cert\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.803351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.803216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-envoy\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.803351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.803245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-data\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.803351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.803304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-credential-socket\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.803351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.803348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-workload-certs\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.803728 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.803391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-podinfo\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.803728 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.803672 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-workload-socket\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.803832 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.803816 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-workload-certs\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.804058 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.804032 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-data\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.804179 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.804057 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-credential-socket\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.804179 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.804154 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4713b18a-bee9-4096-832f-06a62a6ad6f4-istiod-ca-cert\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.805557 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.805538 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-envoy\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.805829 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.805795 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-podinfo\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.811704 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.811683 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-token\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.811990 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.811971 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lztl\" (UniqueName: \"kubernetes.io/projected/4713b18a-bee9-4096-832f-06a62a6ad6f4-kube-api-access-9lztl\") pod \"e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:08.936631 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:08.936545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:09.075649 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:09.075623 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs"] Jul 16 18:17:09.077770 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:17:09.077730 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4713b18a_bee9_4096_832f_06a62a6ad6f4.slice/crio-fd3e788b6db486b8a20e9c8c3e71ad0305c6ffd6ec4e710cdaeb629f5d3cae5e WatchSource:0}: Error finding container fd3e788b6db486b8a20e9c8c3e71ad0305c6ffd6ec4e710cdaeb629f5d3cae5e: Status 404 returned error can't find the container with id fd3e788b6db486b8a20e9c8c3e71ad0305c6ffd6ec4e710cdaeb629f5d3cae5e Jul 16 18:17:09.079965 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:09.079933 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:17:09.080061 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:09.079995 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:17:09.080061 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:09.080025 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:17:09.181293 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:09.181233 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" event={"ID":"4713b18a-bee9-4096-832f-06a62a6ad6f4","Type":"ContainerStarted","Data":"e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3"} Jul 16 18:17:09.181488 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:09.181329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" event={"ID":"4713b18a-bee9-4096-832f-06a62a6ad6f4","Type":"ContainerStarted","Data":"fd3e788b6db486b8a20e9c8c3e71ad0305c6ffd6ec4e710cdaeb629f5d3cae5e"} Jul 16 18:17:09.936640 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:09.936614 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:10.942795 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:10.942768 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:10.966050 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:10.965996 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" podStartSLOduration=2.965980192 podStartE2EDuration="2.965980192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:17:09.225519507 +0000 UTC m=+2662.166051412" watchObservedRunningTime="2026-07-16 18:17:10.965980192 +0000 UTC m=+2663.906512095" Jul 16 18:17:11.197058 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:11.196977 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:11.209925 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:11.209685 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:17.144803 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:17.144723 2577 patch_prober.go:28] interesting pod/e2e-api-a-e55530-openshift-default-5d59688685-8885s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 16 18:17:17.144803 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:17.144776 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 16 18:17:17.230737 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:17.230653 2577 generic.go:356] "Generic (PLEG): container finished" podID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerID="a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701" exitCode=0 Jul 16 18:17:17.230886 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:17.230731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" event={"ID":"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce","Type":"ContainerDied","Data":"a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701"} Jul 16 18:17:17.231163 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:17.231149 2577 scope.go:117] "RemoveContainer" containerID="a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701" Jul 16 18:17:17.232168 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:17.232139 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:17:17.232312 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:17.232206 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:17:17.232312 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:17.232234 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:17:18.237015 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:18.236977 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" event={"ID":"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce","Type":"ContainerStarted","Data":"57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4"} Jul 16 18:17:19.139784 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:19.139745 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:19.140081 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:19.140061 2577 patch_prober.go:28] interesting pod/e2e-api-a-e55530-openshift-default-5d59688685-8885s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 16 18:17:19.140130 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:19.140104 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 16 18:17:20.140042 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:20.140002 2577 patch_prober.go:28] interesting pod/e2e-api-a-e55530-openshift-default-5d59688685-8885s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 16 18:17:20.140475 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:20.140078 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 16 18:17:21.139805 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:21.139762 2577 patch_prober.go:28] interesting pod/e2e-api-a-e55530-openshift-default-5d59688685-8885s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 16 18:17:21.139999 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:21.139839 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 16 18:17:22.140429 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:22.140387 2577 patch_prober.go:28] interesting pod/e2e-api-a-e55530-openshift-default-5d59688685-8885s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 16 18:17:22.140826 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:22.140465 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 16 18:17:23.145070 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:23.145032 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:23.145575 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:23.145451 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:23.146064 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:23.146044 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:24.269150 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:24.269118 2577 generic.go:356] "Generic (PLEG): container finished" podID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerID="e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3" exitCode=0 Jul 16 18:17:24.269590 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:24.269195 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" event={"ID":"4713b18a-bee9-4096-832f-06a62a6ad6f4","Type":"ContainerDied","Data":"e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3"} Jul 16 18:17:24.269754 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:24.269739 2577 scope.go:117] "RemoveContainer" containerID="e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3" Jul 16 18:17:24.270670 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:24.270642 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:17:24.270794 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:24.270721 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:17:24.270794 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:24.270768 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:17:25.275883 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:25.275845 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" event={"ID":"4713b18a-bee9-4096-832f-06a62a6ad6f4","Type":"ContainerStarted","Data":"5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95"} Jul 16 18:17:25.937147 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:25.937111 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:25.938280 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:25.938240 2577 patch_prober.go:28] interesting pod/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 16 18:17:25.938356 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:25.938306 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" podUID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 16 18:17:26.196948 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:26.196846 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:26.936916 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:26.936879 2577 patch_prober.go:28] interesting pod/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 16 18:17:26.937428 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:26.936942 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" podUID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 16 18:17:27.937619 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:27.937585 2577 patch_prober.go:28] interesting pod/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 16 18:17:27.938049 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:27.937643 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" podUID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 16 18:17:28.937911 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:28.937876 2577 patch_prober.go:28] interesting pod/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 16 18:17:28.938343 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:28.937934 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" podUID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 16 18:17:29.941428 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:29.941398 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:29.942316 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:29.942296 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:17:47.632147 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:47.632067 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 18:17:47.634422 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:47.634398 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 18:17:52.000108 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:52.000070 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s"] Jul 16 18:17:52.000512 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:52.000283 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" containerID="cri-o://57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4" gracePeriod=30 Jul 16 18:17:53.147539 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:53.147505 2577 patch_prober.go:28] interesting pod/e2e-api-a-e55530-openshift-default-5d59688685-8885s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 18:17:53.147913 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:53.147571 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 18:17:57.248713 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.248682 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:57.386437 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386351 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-podinfo\") pod \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " Jul 16 18:17:57.386437 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386394 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-envoy\") pod \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " Jul 16 18:17:57.386437 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386411 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-workload-certs\") pod \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " Jul 16 18:17:57.386706 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386445 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-data\") pod \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " Jul 16 18:17:57.386706 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386479 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-credential-socket\") pod \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " Jul 16 18:17:57.386706 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386496 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbmxc\" (UniqueName: \"kubernetes.io/projected/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-kube-api-access-pbmxc\") pod \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " Jul 16 18:17:57.386706 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386517 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-token\") pod \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " Jul 16 18:17:57.386706 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386538 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-workload-socket\") pod \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " Jul 16 18:17:57.386706 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386595 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istiod-ca-cert\") pod \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\" (UID: \"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce\") " Jul 16 18:17:57.387017 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386832 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" (UID: "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:17:57.387017 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386847 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" (UID: "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:17:57.387017 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386936 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-workload-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:57.387017 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.386953 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-credential-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:57.387243 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.387126 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" (UID: "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:17:57.387243 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.387172 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" (UID: "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:17:57.387490 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.387460 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" (UID: "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:17:57.388652 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.388627 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" (UID: "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 18:17:57.388763 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.388669 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" (UID: "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:17:57.388763 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.388688 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-kube-api-access-pbmxc" (OuterVolumeSpecName: "kube-api-access-pbmxc") pod "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" (UID: "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce"). InnerVolumeSpecName "kube-api-access-pbmxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:17:57.388935 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.388913 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" (UID: "aa5672d8-65a3-4be1-9fca-bfce1b8bcbce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:17:57.427840 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.427809 2577 generic.go:356] "Generic (PLEG): container finished" podID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerID="57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4" exitCode=0 Jul 16 18:17:57.427981 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.427856 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" Jul 16 18:17:57.427981 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.427882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" event={"ID":"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce","Type":"ContainerDied","Data":"57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4"} Jul 16 18:17:57.427981 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.427948 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s" event={"ID":"aa5672d8-65a3-4be1-9fca-bfce1b8bcbce","Type":"ContainerDied","Data":"b5f355be7c08c03b316cda06615b07a6bd075492bd74ccecf98281b8d53e95a1"} Jul 16 18:17:57.427981 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.427970 2577 scope.go:117] "RemoveContainer" containerID="57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4" Jul 16 18:17:57.436629 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.436611 2577 scope.go:117] "RemoveContainer" containerID="a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701" Jul 16 18:17:57.447613 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.447594 2577 scope.go:117] "RemoveContainer" containerID="57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4" Jul 16 18:17:57.447877 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:17:57.447860 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4\": container with ID starting with 57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4 not found: ID does not exist" containerID="57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4" Jul 16 18:17:57.447950 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.447890 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4"} err="failed to get container status \"57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4\": rpc error: code = NotFound desc = could not find container \"57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4\": container with ID starting with 57252e289e8325a4a33997fc29578ecfcdc8bcba534a1fc8f35fd16d363c79a4 not found: ID does not exist" Jul 16 18:17:57.447950 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.447913 2577 scope.go:117] "RemoveContainer" containerID="a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701" Jul 16 18:17:57.448273 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:17:57.448226 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701\": container with ID starting with a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701 not found: ID does not exist" containerID="a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701" Jul 16 18:17:57.448365 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.448269 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701"} err="failed to get container status \"a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701\": rpc error: code = NotFound desc = could not find container \"a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701\": container with ID starting with a0e079be9f866c2c25a8009d7427636d10b72e2d51491cec1fc70346d4065701 not found: ID does not exist" Jul 16 18:17:57.450757 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.450733 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s"] Jul 16 18:17:57.457178 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.457159 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-e55530-openshift-default-5d59688685-8885s"] Jul 16 18:17:57.488001 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.487975 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:57.488001 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.487999 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-workload-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:57.488126 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.488008 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istiod-ca-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:57.488126 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.488016 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-podinfo\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:57.488126 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.488025 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-envoy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:57.488126 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.488032 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-istio-data\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:57.488126 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.488039 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbmxc\" (UniqueName: \"kubernetes.io/projected/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce-kube-api-access-pbmxc\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:17:57.579818 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:17:57.579778 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" path="/var/lib/kubelet/pods/aa5672d8-65a3-4be1-9fca-bfce1b8bcbce/volumes" Jul 16 18:18:19.652101 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:19.652062 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs"] Jul 16 18:18:19.652589 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:19.652412 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" podUID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerName="istio-proxy" containerID="cri-o://5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95" gracePeriod=30 Jul 16 18:18:20.582378 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.582347 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj"] Jul 16 18:18:20.582691 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.582680 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" Jul 16 18:18:20.582734 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.582693 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" Jul 16 18:18:20.582734 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.582710 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" Jul 16 18:18:20.582734 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.582715 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" Jul 16 18:18:20.582821 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.582766 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" Jul 16 18:18:20.582821 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.582774 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa5672d8-65a3-4be1-9fca-bfce1b8bcbce" containerName="istio-proxy" Jul 16 18:18:20.587207 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.587184 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.589342 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.589324 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-a0389e-openshift-default-dockercfg-6jk6v\"" Jul 16 18:18:20.598473 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.598450 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj"] Jul 16 18:18:20.710991 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.710954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq456\" (UniqueName: \"kubernetes.io/projected/77375994-7ad6-4e9d-88f5-614e1200ef52-kube-api-access-zq456\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.711510 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.711031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-credential-socket\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.711510 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.711105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-workload-certs\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.711510 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.711285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-data\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.711510 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.711321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-envoy\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.711510 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.711342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77375994-7ad6-4e9d-88f5-614e1200ef52-istiod-ca-cert\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.711510 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.711412 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-token\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.711510 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.711437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-podinfo\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.711510 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.711464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-workload-socket\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.812155 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq456\" (UniqueName: \"kubernetes.io/projected/77375994-7ad6-4e9d-88f5-614e1200ef52-kube-api-access-zq456\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.812366 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-credential-socket\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.812366 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-workload-certs\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.812366 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-data\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.812366 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-envoy\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.812589 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77375994-7ad6-4e9d-88f5-614e1200ef52-istiod-ca-cert\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.812589 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-token\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.812589 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-podinfo\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.812747 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812726 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-credential-socket\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.812823 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812762 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-workload-certs\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.812823 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-workload-socket\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.812928 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812819 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-data\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.813029 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.812999 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-workload-socket\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.813183 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.813164 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77375994-7ad6-4e9d-88f5-614e1200ef52-istiod-ca-cert\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.820006 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.814780 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-envoy\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.820604 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.820574 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-podinfo\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.822148 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.822123 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-token\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.822300 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.822283 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq456\" (UniqueName: \"kubernetes.io/projected/77375994-7ad6-4e9d-88f5-614e1200ef52-kube-api-access-zq456\") pod \"e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:20.897449 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:20.897362 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:21.038595 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:21.038570 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj"] Jul 16 18:18:21.040936 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:18:21.040907 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77375994_7ad6_4e9d_88f5_614e1200ef52.slice/crio-ac718a11f64b9d39a2f1ff42e024b104c25bde01f574d9a79b0dab46062e5737 WatchSource:0}: Error finding container ac718a11f64b9d39a2f1ff42e024b104c25bde01f574d9a79b0dab46062e5737: Status 404 returned error can't find the container with id ac718a11f64b9d39a2f1ff42e024b104c25bde01f574d9a79b0dab46062e5737 Jul 16 18:18:21.043243 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:21.043202 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:18:21.043361 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:21.043316 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:18:21.043403 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:21.043360 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:18:21.536211 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:21.536177 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" event={"ID":"77375994-7ad6-4e9d-88f5-614e1200ef52","Type":"ContainerStarted","Data":"30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb"} Jul 16 18:18:21.536448 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:21.536231 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" event={"ID":"77375994-7ad6-4e9d-88f5-614e1200ef52","Type":"ContainerStarted","Data":"ac718a11f64b9d39a2f1ff42e024b104c25bde01f574d9a79b0dab46062e5737"} Jul 16 18:18:21.558677 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:21.558627 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" podStartSLOduration=1.558612705 podStartE2EDuration="1.558612705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:18:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:18:21.556419727 +0000 UTC m=+2734.496951632" watchObservedRunningTime="2026-07-16 18:18:21.558612705 +0000 UTC m=+2734.499144609" Jul 16 18:18:21.897519 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:21.897431 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:22.902535 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:22.902509 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:23.545345 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:23.545313 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:23.546404 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:23.546384 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:24.904821 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:24.904799 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:18:25.053164 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053130 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-credential-socket\") pod \"4713b18a-bee9-4096-832f-06a62a6ad6f4\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " Jul 16 18:18:25.053364 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053175 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-data\") pod \"4713b18a-bee9-4096-832f-06a62a6ad6f4\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " Jul 16 18:18:25.053364 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053222 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4713b18a-bee9-4096-832f-06a62a6ad6f4-istiod-ca-cert\") pod \"4713b18a-bee9-4096-832f-06a62a6ad6f4\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " Jul 16 18:18:25.053364 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053245 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-podinfo\") pod \"4713b18a-bee9-4096-832f-06a62a6ad6f4\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " Jul 16 18:18:25.053364 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053292 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lztl\" (UniqueName: \"kubernetes.io/projected/4713b18a-bee9-4096-832f-06a62a6ad6f4-kube-api-access-9lztl\") pod \"4713b18a-bee9-4096-832f-06a62a6ad6f4\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " Jul 16 18:18:25.053548 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053438 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-workload-socket\") pod \"4713b18a-bee9-4096-832f-06a62a6ad6f4\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " Jul 16 18:18:25.053548 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053500 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-workload-certs\") pod \"4713b18a-bee9-4096-832f-06a62a6ad6f4\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " Jul 16 18:18:25.053548 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053531 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-envoy\") pod \"4713b18a-bee9-4096-832f-06a62a6ad6f4\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " Jul 16 18:18:25.053704 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053517 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4713b18a-bee9-4096-832f-06a62a6ad6f4" (UID: "4713b18a-bee9-4096-832f-06a62a6ad6f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:18:25.053704 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053571 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-token\") pod \"4713b18a-bee9-4096-832f-06a62a6ad6f4\" (UID: \"4713b18a-bee9-4096-832f-06a62a6ad6f4\") " Jul 16 18:18:25.053817 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053729 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4713b18a-bee9-4096-832f-06a62a6ad6f4" (UID: "4713b18a-bee9-4096-832f-06a62a6ad6f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:18:25.053817 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053748 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4713b18a-bee9-4096-832f-06a62a6ad6f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4713b18a-bee9-4096-832f-06a62a6ad6f4" (UID: "4713b18a-bee9-4096-832f-06a62a6ad6f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:18:25.053940 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053910 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-credential-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:18:25.053940 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053929 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4713b18a-bee9-4096-832f-06a62a6ad6f4-istiod-ca-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:18:25.054046 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.053943 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-workload-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:18:25.054046 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.054011 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4713b18a-bee9-4096-832f-06a62a6ad6f4" (UID: "4713b18a-bee9-4096-832f-06a62a6ad6f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:18:25.054217 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.054196 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "4713b18a-bee9-4096-832f-06a62a6ad6f4" (UID: "4713b18a-bee9-4096-832f-06a62a6ad6f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:18:25.055977 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.055953 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4713b18a-bee9-4096-832f-06a62a6ad6f4" (UID: "4713b18a-bee9-4096-832f-06a62a6ad6f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 18:18:25.055977 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.055969 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4713b18a-bee9-4096-832f-06a62a6ad6f4-kube-api-access-9lztl" (OuterVolumeSpecName: "kube-api-access-9lztl") pod "4713b18a-bee9-4096-832f-06a62a6ad6f4" (UID: "4713b18a-bee9-4096-832f-06a62a6ad6f4"). InnerVolumeSpecName "kube-api-access-9lztl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:18:25.056206 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.056179 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "4713b18a-bee9-4096-832f-06a62a6ad6f4" (UID: "4713b18a-bee9-4096-832f-06a62a6ad6f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:18:25.056206 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.056175 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4713b18a-bee9-4096-832f-06a62a6ad6f4" (UID: "4713b18a-bee9-4096-832f-06a62a6ad6f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:18:25.154723 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.154682 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-podinfo\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:18:25.154723 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.154713 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lztl\" (UniqueName: \"kubernetes.io/projected/4713b18a-bee9-4096-832f-06a62a6ad6f4-kube-api-access-9lztl\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:18:25.154723 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.154724 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-workload-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:18:25.154723 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.154734 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-envoy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:18:25.154996 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.154743 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:18:25.154996 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.154750 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4713b18a-bee9-4096-832f-06a62a6ad6f4-istio-data\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:18:25.556711 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.556682 2577 generic.go:356] "Generic (PLEG): container finished" podID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerID="5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95" exitCode=0 Jul 16 18:18:25.556890 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.556732 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" Jul 16 18:18:25.556890 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.556760 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" event={"ID":"4713b18a-bee9-4096-832f-06a62a6ad6f4","Type":"ContainerDied","Data":"5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95"} Jul 16 18:18:25.556890 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.556825 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs" event={"ID":"4713b18a-bee9-4096-832f-06a62a6ad6f4","Type":"ContainerDied","Data":"fd3e788b6db486b8a20e9c8c3e71ad0305c6ffd6ec4e710cdaeb629f5d3cae5e"} Jul 16 18:18:25.556890 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.556855 2577 scope.go:117] "RemoveContainer" containerID="5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95" Jul 16 18:18:25.565782 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.565763 2577 scope.go:117] "RemoveContainer" containerID="e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3" Jul 16 18:18:25.573310 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.573292 2577 scope.go:117] "RemoveContainer" containerID="5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95" Jul 16 18:18:25.573553 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:18:25.573533 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95\": container with ID starting with 5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95 not found: ID does not exist" containerID="5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95" Jul 16 18:18:25.573606 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.573562 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95"} err="failed to get container status \"5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95\": rpc error: code = NotFound desc = could not find container \"5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95\": container with ID starting with 5d10f06caebd7efc8d695d83f5ad4b5495578fbe8922a1e7b947508d30de7d95 not found: ID does not exist" Jul 16 18:18:25.573606 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.573580 2577 scope.go:117] "RemoveContainer" containerID="e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3" Jul 16 18:18:25.573833 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:18:25.573813 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3\": container with ID starting with e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3 not found: ID does not exist" containerID="e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3" Jul 16 18:18:25.573876 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.573837 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3"} err="failed to get container status \"e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3\": rpc error: code = NotFound desc = could not find container \"e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3\": container with ID starting with e930b7bb7f910d201d35f8dddfce9f9f4ccac7d9be75f5ef462d7bc6acf0c4b3 not found: ID does not exist" Jul 16 18:18:25.581395 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.581373 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs"] Jul 16 18:18:25.586193 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:25.586174 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-502744-openshift-default-cb9fcf6f-gbwzs"] Jul 16 18:18:27.578517 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:27.578487 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4713b18a-bee9-4096-832f-06a62a6ad6f4" path="/var/lib/kubelet/pods/4713b18a-bee9-4096-832f-06a62a6ad6f4/volumes" Jul 16 18:18:28.793394 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.793361 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv"] Jul 16 18:18:28.793769 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.793717 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerName="istio-proxy" Jul 16 18:18:28.793769 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.793728 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerName="istio-proxy" Jul 16 18:18:28.793850 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.793806 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerName="istio-proxy" Jul 16 18:18:28.793850 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.793814 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerName="istio-proxy" Jul 16 18:18:28.797093 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.797073 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.801144 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.801121 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-bc54de-openshift-default-dockercfg-k55tm\"" Jul 16 18:18:28.812118 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.812095 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv"] Jul 16 18:18:28.890617 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.890566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-credential-socket\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.890617 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.890620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istiod-ca-cert\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.890872 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.890784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-podinfo\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.890872 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.890814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-token\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.890980 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.890926 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-workload-certs\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.890980 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.890973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-envoy\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.891090 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.891004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-workload-socket\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.891090 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.891041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-data\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.891090 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.891075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ldq8\" (UniqueName: \"kubernetes.io/projected/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-kube-api-access-8ldq8\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.992306 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-envoy\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.992306 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992306 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-workload-socket\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.992564 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-data\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.992564 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ldq8\" (UniqueName: \"kubernetes.io/projected/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-kube-api-access-8ldq8\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.992564 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992374 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-credential-socket\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.992564 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istiod-ca-cert\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.992564 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-podinfo\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.992564 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-token\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.992564 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-workload-certs\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.992926 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992769 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-workload-socket\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.992926 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992804 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-data\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.992926 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992887 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-workload-certs\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.993069 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.992981 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-credential-socket\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.993334 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.993308 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istiod-ca-cert\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.994647 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.994626 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-envoy\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:28.994968 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:28.994950 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-podinfo\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:29.006188 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:29.006164 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-token\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:29.013281 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:29.013241 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ldq8\" (UniqueName: \"kubernetes.io/projected/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-kube-api-access-8ldq8\") pod \"e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:29.107241 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:29.107145 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:29.241522 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:29.241497 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv"] Jul 16 18:18:29.243845 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:18:29.243818 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dcf5c00_2c8f_4dcb_93d2_c4991ba1970a.slice/crio-2c7491fcb51734a6e4ff4bd2ed4c75b95df873695bb87f6dba77021b0f925acf WatchSource:0}: Error finding container 2c7491fcb51734a6e4ff4bd2ed4c75b95df873695bb87f6dba77021b0f925acf: Status 404 returned error can't find the container with id 2c7491fcb51734a6e4ff4bd2ed4c75b95df873695bb87f6dba77021b0f925acf Jul 16 18:18:29.245888 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:29.245858 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:18:29.245989 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:29.245940 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:18:29.245989 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:29.245982 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:18:29.579993 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:29.579958 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" event={"ID":"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a","Type":"ContainerStarted","Data":"fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702"} Jul 16 18:18:29.580172 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:29.580013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" event={"ID":"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a","Type":"ContainerStarted","Data":"2c7491fcb51734a6e4ff4bd2ed4c75b95df873695bb87f6dba77021b0f925acf"} Jul 16 18:18:29.608654 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:29.608605 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" podStartSLOduration=1.608588135 podStartE2EDuration="1.608588135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:18:29.606276794 +0000 UTC m=+2742.546808689" watchObservedRunningTime="2026-07-16 18:18:29.608588135 +0000 UTC m=+2742.549120038" Jul 16 18:18:30.108169 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:30.108133 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:30.113641 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:30.113615 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:30.582320 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:30.582289 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:30.583337 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:30.583322 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:39.574351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:39.573508 2577 patch_prober.go:28] interesting pod/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 16 18:18:39.574351 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:39.573607 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" podUID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 16 18:18:39.632361 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:39.632326 2577 generic.go:356] "Generic (PLEG): container finished" podID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerID="30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb" exitCode=0 Jul 16 18:18:39.632519 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:39.632399 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" event={"ID":"77375994-7ad6-4e9d-88f5-614e1200ef52","Type":"ContainerDied","Data":"30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb"} Jul 16 18:18:39.632806 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:39.632793 2577 scope.go:117] "RemoveContainer" containerID="30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb" Jul 16 18:18:39.633855 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:39.633821 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:18:39.633929 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:39.633894 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:18:39.633929 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:39.633924 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:18:40.640406 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:40.640372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" event={"ID":"77375994-7ad6-4e9d-88f5-614e1200ef52","Type":"ContainerStarted","Data":"be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91"} Jul 16 18:18:40.898721 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:40.898617 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:40.898913 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:40.898787 2577 patch_prober.go:28] interesting pod/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 16 18:18:40.898913 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:40.898865 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" podUID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 16 18:18:41.898609 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:41.898559 2577 patch_prober.go:28] interesting pod/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 16 18:18:41.899140 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:41.898631 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" podUID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 16 18:18:42.898767 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:42.898722 2577 patch_prober.go:28] interesting pod/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 16 18:18:42.899321 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:42.898807 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" podUID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 16 18:18:43.898647 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:43.898550 2577 patch_prober.go:28] interesting pod/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 16 18:18:43.898931 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:43.898901 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" podUID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 16 18:18:44.901660 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:44.901622 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:44.902166 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:44.902109 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:44.902863 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:44.902841 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:18:46.472889 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:46.471812 2577 patch_prober.go:28] interesting pod/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": read tcp 10.133.0.2:36412->10.133.0.42:15021: read: connection reset by peer" start-of-body= Jul 16 18:18:46.472889 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:46.471903 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" podUID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": read tcp 10.133.0.2:36412->10.133.0.42:15021: read: connection reset by peer" Jul 16 18:18:46.669701 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:46.669605 2577 generic.go:356] "Generic (PLEG): container finished" podID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" containerID="fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702" exitCode=0 Jul 16 18:18:46.669885 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:46.669708 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" event={"ID":"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a","Type":"ContainerDied","Data":"fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702"} Jul 16 18:18:46.670233 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:46.670214 2577 scope.go:117] "RemoveContainer" containerID="fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702" Jul 16 18:18:46.671177 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:46.671151 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:18:46.671241 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:46.671228 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:18:46.671303 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:46.671277 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 18:18:47.676529 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:47.676494 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" event={"ID":"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a","Type":"ContainerStarted","Data":"9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2"} Jul 16 18:18:48.107539 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:48.107499 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:48.107778 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:48.107754 2577 patch_prober.go:28] interesting pod/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 16 18:18:48.107865 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:48.107810 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" podUID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 16 18:18:49.107701 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:49.107667 2577 patch_prober.go:28] interesting pod/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 16 18:18:49.108099 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:49.107722 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" podUID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 16 18:18:50.108005 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:50.107966 2577 patch_prober.go:28] interesting pod/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 16 18:18:50.108461 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:50.108024 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" podUID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 16 18:18:51.107892 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:51.107853 2577 patch_prober.go:28] interesting pod/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 16 18:18:51.108074 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:51.107923 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" podUID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 16 18:18:52.111796 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:52.111762 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:52.112399 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:52.112125 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:18:52.112762 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:18:52.112747 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:22:47.659774 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:22:47.659742 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 18:22:47.663499 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:22:47.663479 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sqlkj_9f55f400-d31e-4974-bb5e-bcb9a2176c34/ovn-acl-logging/0.log" Jul 16 18:25:07.100024 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:07.099991 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj"] Jul 16 18:25:07.100512 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:07.100237 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" podUID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerName="istio-proxy" containerID="cri-o://be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91" gracePeriod=30 Jul 16 18:25:12.356163 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.356133 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:25:12.445005 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.444918 2577 generic.go:356] "Generic (PLEG): container finished" podID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerID="be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91" exitCode=0 Jul 16 18:25:12.445005 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.444979 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" Jul 16 18:25:12.445005 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.444996 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" event={"ID":"77375994-7ad6-4e9d-88f5-614e1200ef52","Type":"ContainerDied","Data":"be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91"} Jul 16 18:25:12.445210 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.445068 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj" event={"ID":"77375994-7ad6-4e9d-88f5-614e1200ef52","Type":"ContainerDied","Data":"ac718a11f64b9d39a2f1ff42e024b104c25bde01f574d9a79b0dab46062e5737"} Jul 16 18:25:12.445210 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.445094 2577 scope.go:117] "RemoveContainer" containerID="be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91" Jul 16 18:25:12.453430 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.453412 2577 scope.go:117] "RemoveContainer" containerID="30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb" Jul 16 18:25:12.460912 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.460884 2577 scope.go:117] "RemoveContainer" containerID="be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91" Jul 16 18:25:12.461161 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:25:12.461142 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91\": container with ID starting with be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91 not found: ID does not exist" containerID="be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91" Jul 16 18:25:12.461234 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.461178 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91"} err="failed to get container status \"be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91\": rpc error: code = NotFound desc = could not find container \"be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91\": container with ID starting with be98b276cda5b909dc339d5ace3005e99a4c3260820224fabc352f4964267b91 not found: ID does not exist" Jul 16 18:25:12.461234 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.461205 2577 scope.go:117] "RemoveContainer" containerID="30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb" Jul 16 18:25:12.461453 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:25:12.461435 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb\": container with ID starting with 30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb not found: ID does not exist" containerID="30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb" Jul 16 18:25:12.461507 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.461460 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb"} err="failed to get container status \"30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb\": rpc error: code = NotFound desc = could not find container \"30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb\": container with ID starting with 30bad2a72e9f68000266eec4910e485201c82801b83bf3c4ee36be62218f7ffb not found: ID does not exist" Jul 16 18:25:12.504810 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.504772 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-token\") pod \"77375994-7ad6-4e9d-88f5-614e1200ef52\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " Jul 16 18:25:12.504961 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.504832 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-podinfo\") pod \"77375994-7ad6-4e9d-88f5-614e1200ef52\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " Jul 16 18:25:12.504961 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.504860 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-credential-socket\") pod \"77375994-7ad6-4e9d-88f5-614e1200ef52\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " Jul 16 18:25:12.504961 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.504881 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-envoy\") pod \"77375994-7ad6-4e9d-88f5-614e1200ef52\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " Jul 16 18:25:12.505136 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.504969 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-data\") pod \"77375994-7ad6-4e9d-88f5-614e1200ef52\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " Jul 16 18:25:12.505136 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.505009 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-workload-socket\") pod \"77375994-7ad6-4e9d-88f5-614e1200ef52\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " Jul 16 18:25:12.505136 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.505036 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq456\" (UniqueName: \"kubernetes.io/projected/77375994-7ad6-4e9d-88f5-614e1200ef52-kube-api-access-zq456\") pod \"77375994-7ad6-4e9d-88f5-614e1200ef52\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " Jul 16 18:25:12.505136 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.505127 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-workload-certs\") pod \"77375994-7ad6-4e9d-88f5-614e1200ef52\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " Jul 16 18:25:12.505416 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.505165 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77375994-7ad6-4e9d-88f5-614e1200ef52-istiod-ca-cert\") pod \"77375994-7ad6-4e9d-88f5-614e1200ef52\" (UID: \"77375994-7ad6-4e9d-88f5-614e1200ef52\") " Jul 16 18:25:12.505416 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.505200 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "77375994-7ad6-4e9d-88f5-614e1200ef52" (UID: "77375994-7ad6-4e9d-88f5-614e1200ef52"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:25:12.505521 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.505414 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "77375994-7ad6-4e9d-88f5-614e1200ef52" (UID: "77375994-7ad6-4e9d-88f5-614e1200ef52"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:25:12.505577 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.505547 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-workload-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:12.505634 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.505565 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-credential-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:12.505789 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.505753 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "77375994-7ad6-4e9d-88f5-614e1200ef52" (UID: "77375994-7ad6-4e9d-88f5-614e1200ef52"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:25:12.505851 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.505793 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77375994-7ad6-4e9d-88f5-614e1200ef52-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "77375994-7ad6-4e9d-88f5-614e1200ef52" (UID: "77375994-7ad6-4e9d-88f5-614e1200ef52"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:25:12.505916 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.505857 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-data" (OuterVolumeSpecName: "istio-data") pod "77375994-7ad6-4e9d-88f5-614e1200ef52" (UID: "77375994-7ad6-4e9d-88f5-614e1200ef52"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:25:12.507122 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.507101 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "77375994-7ad6-4e9d-88f5-614e1200ef52" (UID: "77375994-7ad6-4e9d-88f5-614e1200ef52"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 18:25:12.507555 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.507530 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "77375994-7ad6-4e9d-88f5-614e1200ef52" (UID: "77375994-7ad6-4e9d-88f5-614e1200ef52"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:25:12.507657 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.507537 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77375994-7ad6-4e9d-88f5-614e1200ef52-kube-api-access-zq456" (OuterVolumeSpecName: "kube-api-access-zq456") pod "77375994-7ad6-4e9d-88f5-614e1200ef52" (UID: "77375994-7ad6-4e9d-88f5-614e1200ef52"). InnerVolumeSpecName "kube-api-access-zq456". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:25:12.507851 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.507832 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-token" (OuterVolumeSpecName: "istio-token") pod "77375994-7ad6-4e9d-88f5-614e1200ef52" (UID: "77375994-7ad6-4e9d-88f5-614e1200ef52"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:25:12.606615 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.606584 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-podinfo\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:12.606615 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.606610 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-envoy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:12.606615 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.606618 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-data\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:12.606853 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.606626 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77375994-7ad6-4e9d-88f5-614e1200ef52-workload-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:12.606853 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.606634 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq456\" (UniqueName: \"kubernetes.io/projected/77375994-7ad6-4e9d-88f5-614e1200ef52-kube-api-access-zq456\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:12.606853 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.606645 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77375994-7ad6-4e9d-88f5-614e1200ef52-istiod-ca-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:12.606853 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.606652 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77375994-7ad6-4e9d-88f5-614e1200ef52-istio-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:12.774465 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.774432 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj"] Jul 16 18:25:12.777590 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:12.777561 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-a0389e-openshift-default-5fc4d6b55f-mgczj"] Jul 16 18:25:13.579804 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:13.579773 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77375994-7ad6-4e9d-88f5-614e1200ef52" path="/var/lib/kubelet/pods/77375994-7ad6-4e9d-88f5-614e1200ef52/volumes" Jul 16 18:25:30.169915 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:30.169883 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv"] Jul 16 18:25:30.170416 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:30.170105 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" podUID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" containerName="istio-proxy" containerID="cri-o://9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2" gracePeriod=30 Jul 16 18:25:35.422796 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.422769 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:25:35.508928 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.508901 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-envoy\") pod \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " Jul 16 18:25:35.509120 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.508939 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-workload-socket\") pod \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " Jul 16 18:25:35.509120 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.508988 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ldq8\" (UniqueName: \"kubernetes.io/projected/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-kube-api-access-8ldq8\") pod \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " Jul 16 18:25:35.509120 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.509011 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-workload-certs\") pod \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " Jul 16 18:25:35.509120 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.509047 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-credential-socket\") pod \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " Jul 16 18:25:35.509120 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.509089 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-data\") pod \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " Jul 16 18:25:35.509448 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.509134 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-podinfo\") pod \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " Jul 16 18:25:35.509448 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.509160 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-token\") pod \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " Jul 16 18:25:35.509448 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.509220 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istiod-ca-cert\") pod \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\" (UID: \"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a\") " Jul 16 18:25:35.509448 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.509232 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" (UID: "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:25:35.509675 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.509454 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" (UID: "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:25:35.509675 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.509645 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" (UID: "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:25:35.509675 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.509650 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-workload-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:35.509838 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.509685 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-workload-certs\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:35.509838 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.509819 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" (UID: "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:25:35.510069 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.510051 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-data" (OuterVolumeSpecName: "istio-data") pod "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" (UID: "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:25:35.511431 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.511398 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-token" (OuterVolumeSpecName: "istio-token") pod "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" (UID: "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:25:35.511544 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.511449 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-kube-api-access-8ldq8" (OuterVolumeSpecName: "kube-api-access-8ldq8") pod "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" (UID: "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a"). InnerVolumeSpecName "kube-api-access-8ldq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:25:35.511626 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.511611 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" (UID: "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:25:35.511746 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.511729 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" (UID: "8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 18:25:35.548432 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.548401 2577 generic.go:356] "Generic (PLEG): container finished" podID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" containerID="9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2" exitCode=0 Jul 16 18:25:35.548593 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.548449 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" Jul 16 18:25:35.548593 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.548494 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" event={"ID":"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a","Type":"ContainerDied","Data":"9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2"} Jul 16 18:25:35.548593 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.548570 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv" event={"ID":"8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a","Type":"ContainerDied","Data":"2c7491fcb51734a6e4ff4bd2ed4c75b95df873695bb87f6dba77021b0f925acf"} Jul 16 18:25:35.548593 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.548593 2577 scope.go:117] "RemoveContainer" containerID="9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2" Jul 16 18:25:35.560758 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.560736 2577 scope.go:117] "RemoveContainer" containerID="fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702" Jul 16 18:25:35.568958 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.568940 2577 scope.go:117] "RemoveContainer" containerID="9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2" Jul 16 18:25:35.569233 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:25:35.569213 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2\": container with ID starting with 9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2 not found: ID does not exist" containerID="9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2" Jul 16 18:25:35.569314 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.569243 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2"} err="failed to get container status \"9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2\": rpc error: code = NotFound desc = could not find container \"9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2\": container with ID starting with 9c91d6250b5080e67c563fc36789568e0c86341fa02be20cd2ee98f9835663c2 not found: ID does not exist" Jul 16 18:25:35.569314 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.569285 2577 scope.go:117] "RemoveContainer" containerID="fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702" Jul 16 18:25:35.569521 ip-10-0-129-222 kubenswrapper[2577]: E0716 18:25:35.569504 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702\": container with ID starting with fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702 not found: ID does not exist" containerID="fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702" Jul 16 18:25:35.569595 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.569523 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702"} err="failed to get container status \"fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702\": rpc error: code = NotFound desc = could not find container \"fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702\": container with ID starting with fe386abbe7116942053cbc16a25cc54af89132905154ac8090a47a716efb3702 not found: ID does not exist" Jul 16 18:25:35.580422 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.580398 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv"] Jul 16 18:25:35.581844 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.581820 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-bc54de-openshift-default-f74dd6487-29jtv"] Jul 16 18:25:35.611148 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.611117 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istiod-ca-cert\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:35.611148 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.611142 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-envoy\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:35.611352 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.611155 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ldq8\" (UniqueName: \"kubernetes.io/projected/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-kube-api-access-8ldq8\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:35.611352 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.611168 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-credential-socket\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:35.611352 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.611181 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-data\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:35.611352 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.611191 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-podinfo\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:35.611352 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:35.611202 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a-istio-token\") on node \"ip-10-0-129-222.ec2.internal\" DevicePath \"\"" Jul 16 18:25:37.578171 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:37.578138 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" path="/var/lib/kubelet/pods/8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a/volumes" Jul 16 18:25:37.602829 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:37.602803 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674ff8dd58-njn5v_904bf456-97aa-4093-965b-a765746bc0d3/copy-manifests/0.log" Jul 16 18:25:37.622747 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:37.622722 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674ff8dd58-njn5v_904bf456-97aa-4093-965b-a765746bc0d3/manager/0.log" Jul 16 18:25:42.675768 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:42.675726 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4445rf_1049330f-4785-4d6c-aeb5-af6831e2e89c/istio-proxy/0.log" Jul 16 18:25:42.807033 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:42.806997 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pvhk4_f4049429-e353-4de8-a447-1c594101df1c/discovery/0.log" Jul 16 18:25:43.189226 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:43.189197 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hjs4n_22226c95-2436-43e0-8a2a-48983c28fde2/istio-proxy/1.log" Jul 16 18:25:43.593695 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:43.593671 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-888fdc5b4-t2mnk_2cc3e58e-979d-4b16-ac6c-0ecbfba2218a/router/0.log" Jul 16 18:25:43.964602 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:43.964525 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wg77g_5a6958fb-4062-4c05-b40d-5c97858ddc8a/main/0.log" Jul 16 18:25:44.203270 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:44.203223 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7ghlm_711d609e-fde2-4761-b1b4-6f76f92adb27/main/0.log" Jul 16 18:25:54.374129 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:54.374098 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p7p9n_1173efa3-a211-4936-a680-60ba616fdbb8/global-pull-secret-syncer/0.log" Jul 16 18:25:54.644309 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:54.644218 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hcmhf_aa41f90e-2f65-4314-b287-d9411e8b6260/konnectivity-agent/0.log" Jul 16 18:25:54.787814 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:25:54.787779 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-222.ec2.internal_ad0da4cc9750f83a93b2d4592a26c80f/haproxy/0.log" Jul 16 18:26:02.814916 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:02.814878 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxf68_59064270-e550-4975-8463-6b228ed49015/node-exporter/0.log" Jul 16 18:26:02.846446 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:02.846415 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxf68_59064270-e550-4975-8463-6b228ed49015/kube-rbac-proxy/0.log" Jul 16 18:26:02.878693 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:02.878667 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxf68_59064270-e550-4975-8463-6b228ed49015/init-textfile/0.log" Jul 16 18:26:03.069857 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.069769 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbff22df-bbe5-4b24-bdd3-952773ca3a01/prometheus/0.log" Jul 16 18:26:03.111420 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.111385 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbff22df-bbe5-4b24-bdd3-952773ca3a01/config-reloader/0.log" Jul 16 18:26:03.183063 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.183038 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbff22df-bbe5-4b24-bdd3-952773ca3a01/thanos-sidecar/0.log" Jul 16 18:26:03.241034 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.241006 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbff22df-bbe5-4b24-bdd3-952773ca3a01/kube-rbac-proxy-web/0.log" Jul 16 18:26:03.277431 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.277407 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbff22df-bbe5-4b24-bdd3-952773ca3a01/kube-rbac-proxy/0.log" Jul 16 18:26:03.311051 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.311024 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbff22df-bbe5-4b24-bdd3-952773ca3a01/kube-rbac-proxy-thanos/0.log" Jul 16 18:26:03.340168 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.340106 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bbff22df-bbe5-4b24-bdd3-952773ca3a01/init-config-reloader/0.log" Jul 16 18:26:03.576842 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.576814 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68fd4c6647-tb5fb_d08a3099-62b3-484c-bfa7-5e3e369ed7ec/thanos-query/0.log" Jul 16 18:26:03.605381 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.605306 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68fd4c6647-tb5fb_d08a3099-62b3-484c-bfa7-5e3e369ed7ec/kube-rbac-proxy-web/0.log" Jul 16 18:26:03.634614 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.634588 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68fd4c6647-tb5fb_d08a3099-62b3-484c-bfa7-5e3e369ed7ec/kube-rbac-proxy/0.log" Jul 16 18:26:03.661958 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.661927 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68fd4c6647-tb5fb_d08a3099-62b3-484c-bfa7-5e3e369ed7ec/prom-label-proxy/0.log" Jul 16 18:26:03.688672 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.688649 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68fd4c6647-tb5fb_d08a3099-62b3-484c-bfa7-5e3e369ed7ec/kube-rbac-proxy-rules/0.log" Jul 16 18:26:03.716227 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:03.716194 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68fd4c6647-tb5fb_d08a3099-62b3-484c-bfa7-5e3e369ed7ec/kube-rbac-proxy-metrics/0.log" Jul 16 18:26:04.945903 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.945865 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c"] Jul 16 18:26:04.946283 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.946194 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" containerName="istio-proxy" Jul 16 18:26:04.946283 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.946206 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" containerName="istio-proxy" Jul 16 18:26:04.946283 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.946223 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerName="istio-proxy" Jul 16 18:26:04.946283 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.946229 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4713b18a-bee9-4096-832f-06a62a6ad6f4" containerName="istio-proxy" Jul 16 18:26:04.946283 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.946237 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerName="istio-proxy" Jul 16 18:26:04.946283 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.946243 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerName="istio-proxy" Jul 16 18:26:04.946283 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.946272 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerName="istio-proxy" Jul 16 18:26:04.946283 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.946278 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerName="istio-proxy" Jul 16 18:26:04.946539 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.946324 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" containerName="istio-proxy" Jul 16 18:26:04.946539 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.946334 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="77375994-7ad6-4e9d-88f5-614e1200ef52" containerName="istio-proxy" Jul 16 18:26:04.946539 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.946341 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dcf5c00-2c8f-4dcb-93d2-c4991ba1970a" containerName="istio-proxy" Jul 16 18:26:04.949470 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.949451 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:04.952089 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.952065 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p6ppj\"/\"kube-root-ca.crt\"" Jul 16 18:26:04.952632 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.952612 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p6ppj\"/\"default-dockercfg-46jhl\"" Jul 16 18:26:04.952748 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.952616 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p6ppj\"/\"openshift-service-ca.crt\"" Jul 16 18:26:04.964678 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:04.964657 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c"] Jul 16 18:26:05.076526 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.076490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9052ae59-ced6-498b-a5dd-5c14de7066b6-podres\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.076526 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.076524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9052ae59-ced6-498b-a5dd-5c14de7066b6-proc\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.076759 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.076556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnrm9\" (UniqueName: \"kubernetes.io/projected/9052ae59-ced6-498b-a5dd-5c14de7066b6-kube-api-access-tnrm9\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.076759 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.076615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9052ae59-ced6-498b-a5dd-5c14de7066b6-lib-modules\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.076759 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.076696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9052ae59-ced6-498b-a5dd-5c14de7066b6-sys\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.178178 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.178144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9052ae59-ced6-498b-a5dd-5c14de7066b6-sys\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.178178 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.178184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9052ae59-ced6-498b-a5dd-5c14de7066b6-podres\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.178442 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.178201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9052ae59-ced6-498b-a5dd-5c14de7066b6-proc\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.178442 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.178226 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnrm9\" (UniqueName: \"kubernetes.io/projected/9052ae59-ced6-498b-a5dd-5c14de7066b6-kube-api-access-tnrm9\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.178442 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.178310 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9052ae59-ced6-498b-a5dd-5c14de7066b6-sys\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.178442 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.178338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9052ae59-ced6-498b-a5dd-5c14de7066b6-lib-modules\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.178442 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.178310 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9052ae59-ced6-498b-a5dd-5c14de7066b6-proc\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.178442 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.178348 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9052ae59-ced6-498b-a5dd-5c14de7066b6-podres\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.178442 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.178428 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9052ae59-ced6-498b-a5dd-5c14de7066b6-lib-modules\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.188013 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.187983 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnrm9\" (UniqueName: \"kubernetes.io/projected/9052ae59-ced6-498b-a5dd-5c14de7066b6-kube-api-access-tnrm9\") pod \"perf-node-gather-daemonset-2gw6c\" (UID: \"9052ae59-ced6-498b-a5dd-5c14de7066b6\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.259973 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.259938 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.391364 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.391335 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c"] Jul 16 18:26:05.393902 ip-10-0-129-222 kubenswrapper[2577]: W0716 18:26:05.393864 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9052ae59_ced6_498b_a5dd_5c14de7066b6.slice/crio-d88a68e4937a5b7c2a47081488a26df21071558f97356457ca9c11cbb9968c8d WatchSource:0}: Error finding container d88a68e4937a5b7c2a47081488a26df21071558f97356457ca9c11cbb9968c8d: Status 404 returned error can't find the container with id d88a68e4937a5b7c2a47081488a26df21071558f97356457ca9c11cbb9968c8d Jul 16 18:26:05.680011 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.679914 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" event={"ID":"9052ae59-ced6-498b-a5dd-5c14de7066b6","Type":"ContainerStarted","Data":"fa9085c3ad0a7cd5148a1614a2100aa27890020ab62ac8a0b449c3cbf0e6503d"} Jul 16 18:26:05.680011 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.679976 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:05.680011 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.679993 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" event={"ID":"9052ae59-ced6-498b-a5dd-5c14de7066b6","Type":"ContainerStarted","Data":"d88a68e4937a5b7c2a47081488a26df21071558f97356457ca9c11cbb9968c8d"} Jul 16 18:26:05.706770 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:05.706722 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" podStartSLOduration=1.706707804 podStartE2EDuration="1.706707804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:26:05.704727966 +0000 UTC m=+3198.645259873" watchObservedRunningTime="2026-07-16 18:26:05.706707804 +0000 UTC m=+3198.647239709" Jul 16 18:26:06.060108 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:06.060078 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d6cb8b778-phm2x_0c10e9dd-4884-43eb-84e8-476398ff66f3/console/0.log" Jul 16 18:26:06.830693 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:06.830652 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-59wcz_324b5cb9-1cd4-4c83-ab85-276957f8d6ef/volume-data-source-validator/0.log" Jul 16 18:26:08.048122 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:08.048092 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7d46w_b5895f08-d52d-4dc1-9921-e4523fd27d58/dns/0.log" Jul 16 18:26:08.075598 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:08.075569 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7d46w_b5895f08-d52d-4dc1-9921-e4523fd27d58/kube-rbac-proxy/0.log" Jul 16 18:26:08.252585 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:08.252550 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6tpzc_0c7914f1-c169-4959-9d39-56a6d052f692/dns-node-resolver/0.log" Jul 16 18:26:08.989463 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:08.989433 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mxbdc_26a79d40-1b3d-4683-9fdf-07f374b976b9/node-ca/0.log" Jul 16 18:26:10.072585 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:10.072548 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4445rf_1049330f-4785-4d6c-aeb5-af6831e2e89c/istio-proxy/0.log" Jul 16 18:26:10.198724 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:10.198692 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pvhk4_f4049429-e353-4de8-a447-1c594101df1c/discovery/0.log" Jul 16 18:26:10.293028 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:10.292997 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hjs4n_22226c95-2436-43e0-8a2a-48983c28fde2/istio-proxy/0.log" Jul 16 18:26:10.319721 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:10.319692 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hjs4n_22226c95-2436-43e0-8a2a-48983c28fde2/istio-proxy/1.log" Jul 16 18:26:10.420052 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:10.419968 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-888fdc5b4-t2mnk_2cc3e58e-979d-4b16-ac6c-0ecbfba2218a/router/0.log" Jul 16 18:26:11.223922 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:11.223892 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wk7j4_680b111a-3188-4fc7-9719-a81a6fdbdd45/serve-healthcheck-canary/0.log" Jul 16 18:26:11.694537 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:11.694513 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-2gw6c" Jul 16 18:26:11.901853 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:11.901828 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kmbnr_b0ec04eb-15ab-4513-a103-30a8bdcd66cf/kube-rbac-proxy/0.log" Jul 16 18:26:11.945414 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:11.945340 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kmbnr_b0ec04eb-15ab-4513-a103-30a8bdcd66cf/exporter/0.log" Jul 16 18:26:11.975892 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:11.975867 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kmbnr_b0ec04eb-15ab-4513-a103-30a8bdcd66cf/extractor/0.log" Jul 16 18:26:14.177673 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:14.177640 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4445rf_1049330f-4785-4d6c-aeb5-af6831e2e89c/istio-proxy/0.log" Jul 16 18:26:14.298747 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:14.298712 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pvhk4_f4049429-e353-4de8-a447-1c594101df1c/discovery/0.log" Jul 16 18:26:14.390002 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:14.389972 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hjs4n_22226c95-2436-43e0-8a2a-48983c28fde2/istio-proxy/0.log" Jul 16 18:26:14.422832 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:14.422800 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hjs4n_22226c95-2436-43e0-8a2a-48983c28fde2/istio-proxy/1.log" Jul 16 18:26:14.517920 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:14.517890 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-888fdc5b4-t2mnk_2cc3e58e-979d-4b16-ac6c-0ecbfba2218a/router/0.log" Jul 16 18:26:15.480140 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:15.480060 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674ff8dd58-njn5v_904bf456-97aa-4093-965b-a765746bc0d3/manager/0.log" Jul 16 18:26:15.528528 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:15.528498 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674ff8dd58-njn5v_904bf456-97aa-4093-965b-a765746bc0d3/copy-manifests/0.log" Jul 16 18:26:15.816848 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:15.816819 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4445rf_1049330f-4785-4d6c-aeb5-af6831e2e89c/istio-proxy/0.log" Jul 16 18:26:15.937362 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:15.937329 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pvhk4_f4049429-e353-4de8-a447-1c594101df1c/discovery/0.log" Jul 16 18:26:15.994987 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:15.994960 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hjs4n_22226c95-2436-43e0-8a2a-48983c28fde2/istio-proxy/0.log" Jul 16 18:26:16.024950 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:16.024914 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hjs4n_22226c95-2436-43e0-8a2a-48983c28fde2/istio-proxy/1.log" Jul 16 18:26:16.096272 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:16.096175 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-888fdc5b4-t2mnk_2cc3e58e-979d-4b16-ac6c-0ecbfba2218a/router/0.log" Jul 16 18:26:17.122637 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:17.122609 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65794b4fd8-pcvd2_d984d7f7-14ba-420b-9f86-8405ac890218/manager/0.log" Jul 16 18:26:17.230298 ip-10-0-129-222 kubenswrapper[2577]: I0716 18:26:17.230272 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tr5nl_285c16e9-733c-4351-8f10-ba649b72f2ed/openshift-lws-operator/0.log"