Jul 09 16:19:33.294587 ip-10-0-136-68 systemd[1]: Starting Kubernetes Kubelet... Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.756848 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.760959 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.760970 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.760973 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.760977 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.760980 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.760983 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.760985 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:19:33.800738 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.760988 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.760993 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.760997 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761000 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761003 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761006 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761009 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761012 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761015 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761018 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761021 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761024 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761027 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761030 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761033 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761035 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761038 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761041 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761043 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:19:34.048769 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761046 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:19:33.829176 ip-10-0-136-68 systemd[1]: Started Kubernetes Kubelet. Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761050 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761054 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761057 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761062 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761066 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761070 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761073 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761076 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761079 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761081 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761084 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761087 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761090 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761092 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761095 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761097 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761100 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761103 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:19:34.066203 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761106 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761108 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761112 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761114 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761117 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761119 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761122 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761124 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761126 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761129 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761132 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761134 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761137 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761140 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761143 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761145 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761148 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761150 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761153 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761155 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:19:34.067063 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761158 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761160 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761163 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761165 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761168 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761170 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761173 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761175 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761180 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761183 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761185 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761188 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761190 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761193 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761196 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761199 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761201 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761203 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761206 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761208 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:19:34.068270 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761211 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761214 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761216 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761218 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761221 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761224 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761227 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761229 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761232 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761234 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761237 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761240 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761242 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761245 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761972 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761979 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761982 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761985 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761988 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:19:34.068891 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761990 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761993 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761995 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.761998 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762000 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762003 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762005 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762008 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762012 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762014 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762017 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762019 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762021 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762024 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762026 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762029 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762031 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762033 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762036 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762039 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:19:34.069910 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762042 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762045 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762047 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762050 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762052 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762055 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762057 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762059 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762062 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762064 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762067 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762070 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762072 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762075 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762077 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762080 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762082 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762085 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762087 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762090 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:19:34.070575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762092 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762095 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762098 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762100 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762105 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762108 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762111 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762114 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762117 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762121 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762126 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762132 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762135 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762138 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762141 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762143 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762146 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762148 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762151 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:19:34.071236 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762154 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762156 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762159 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762162 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762164 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762168 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762172 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762175 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762178 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762180 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762183 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762186 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762189 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762191 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762194 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762198 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762201 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762205 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762208 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:19:34.071964 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762210 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762213 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762217 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762219 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762222 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762226 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762229 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762231 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762234 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762236 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762239 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762241 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762244 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762247 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762249 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762252 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762705 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762711 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762715 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762718 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:19:34.072542 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762721 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762724 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762727 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762730 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762733 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762735 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762737 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762740 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762743 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762746 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762749 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762753 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762758 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762761 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762763 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762766 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762768 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762775 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762778 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762780 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:19:34.073083 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762783 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762785 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762788 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762790 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762793 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762796 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762798 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762801 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762803 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762806 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762808 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762811 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762813 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762816 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762818 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762823 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762825 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762828 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762831 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:19:34.073647 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762833 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762836 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762840 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762843 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762846 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762848 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762851 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762853 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762856 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762858 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762863 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762866 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762869 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762871 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762874 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762876 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762879 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762882 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762884 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762886 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:19:34.074144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762889 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762892 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762894 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762897 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762899 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762902 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762904 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762907 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762910 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762912 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762915 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762918 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762920 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762922 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762925 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762928 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762930 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762933 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762935 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762938 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:19:34.074655 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762940 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762943 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762947 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762949 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762952 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762954 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762957 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762961 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762967 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762971 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762974 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762977 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762980 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762983 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762986 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.762989 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763061 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763072 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763078 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763083 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 16:19:34.075144 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763087 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763091 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763095 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763099 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763104 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763108 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763113 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763117 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763123 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763127 2579 flags.go:64] FLAG: --cgroup-root="" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763131 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763135 2579 flags.go:64] FLAG: --client-ca-file="" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763140 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763145 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763152 2579 flags.go:64] FLAG: --cluster-domain="" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763156 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763161 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763165 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763170 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763176 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763181 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763186 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763193 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763197 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 09 16:19:34.075647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763202 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763206 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763211 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763215 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763222 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763227 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763231 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763236 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763240 2579 flags.go:64] FLAG: --enable-server="true" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763245 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763252 2579 flags.go:64] FLAG: --event-burst="100" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763256 2579 flags.go:64] FLAG: --event-qps="50" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763259 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763262 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763264 2579 flags.go:64] FLAG: --eviction-hard="" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763268 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763271 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763275 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763278 2579 flags.go:64] FLAG: --eviction-soft="" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763281 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763284 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763287 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763291 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763294 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763297 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 16:19:34.076211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763300 2579 flags.go:64] FLAG: --feature-gates="" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763304 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763307 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763310 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763328 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763335 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763338 2579 flags.go:64] FLAG: --help="false" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763341 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763345 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763347 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763350 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763354 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763358 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763360 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763363 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763366 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763368 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763371 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763375 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763377 2579 flags.go:64] FLAG: --kube-reserved="" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763380 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763383 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763386 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763389 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 16:19:34.076876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763392 2579 flags.go:64] FLAG: --lock-file="" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763395 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763398 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763401 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763406 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763411 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763413 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763416 2579 flags.go:64] FLAG: --logging-format="text" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763419 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763422 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763425 2579 flags.go:64] FLAG: --manifest-url="" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763428 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763432 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763436 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763440 2579 flags.go:64] FLAG: --max-pods="110" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763443 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763446 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763449 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763452 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763455 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763458 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763461 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763468 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763471 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763474 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 16:19:34.077485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763477 2579 flags.go:64] FLAG: --pod-cidr="" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763480 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763485 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763488 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763491 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763494 2579 flags.go:64] FLAG: --port="10250" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763497 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763500 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-093b1a63cbebb9e3b" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763503 2579 flags.go:64] FLAG: --qos-reserved="" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763511 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763514 2579 flags.go:64] FLAG: --register-node="true" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763517 2579 flags.go:64] FLAG: --register-with-taints="" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763521 2579 flags.go:64] FLAG: --registry-burst="10" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763525 2579 flags.go:64] FLAG: --registry-qps="5" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763527 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763530 2579 flags.go:64] FLAG: --reserved-memory="" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763534 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763537 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763540 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763543 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763547 2579 flags.go:64] FLAG: --runonce="false" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763549 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763552 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763555 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763558 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 16:19:34.078162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763561 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763564 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763568 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763571 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763573 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763577 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763579 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763582 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763585 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763588 2579 flags.go:64] FLAG: --system-cgroups="" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763591 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763596 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763599 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763601 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763605 2579 flags.go:64] FLAG: --tls-min-version="" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763608 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763611 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763614 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763617 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763620 2579 flags.go:64] FLAG: --v="2" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763625 2579 flags.go:64] FLAG: --version="false" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763629 2579 flags.go:64] FLAG: --vmodule="" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763633 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.763636 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763754 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:19:34.078793 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763758 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763761 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763765 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763768 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763770 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763773 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763776 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763779 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763781 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763784 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763787 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763789 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763792 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763794 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763797 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763799 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763801 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763804 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763806 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763809 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:19:34.079401 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763812 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763814 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763817 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763819 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763823 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763827 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763830 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763848 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763852 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763855 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763858 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763860 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763863 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763865 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763870 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763872 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763875 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763877 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763880 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763883 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:19:34.079875 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763885 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763888 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763890 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763893 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763895 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763898 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763900 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763903 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763905 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763908 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763910 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763913 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763915 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763918 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763920 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763923 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763925 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763928 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763931 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763935 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:19:34.080421 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763938 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763940 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763943 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763945 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763948 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763951 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763957 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763960 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763962 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763965 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763969 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763973 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763976 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763979 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763981 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763984 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763987 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763990 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763993 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:19:34.080911 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763996 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.763998 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764001 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764004 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764006 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764009 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764011 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764014 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764016 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764018 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764021 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764024 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764029 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764032 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764034 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764037 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764039 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764042 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:19:34.081396 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.764044 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.764816 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.774056 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.774071 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.774089 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.774094 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774147 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774152 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774156 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774159 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774162 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774164 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774167 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774169 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774172 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:19:34.081829 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774175 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774178 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774180 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774183 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774186 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774188 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774191 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774194 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774197 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774201 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774205 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774208 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774211 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774215 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774219 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774222 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774225 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774228 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774231 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:19:34.082210 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774235 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774239 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774243 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774246 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774249 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774252 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774254 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774257 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774260 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774263 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774266 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774269 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774271 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774275 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774277 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774280 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774283 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774286 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774289 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:19:34.082704 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774292 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774294 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774297 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774300 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774302 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774305 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774308 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774310 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774313 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774335 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774338 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774341 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774344 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774347 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774350 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774354 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774357 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774359 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774362 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774365 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:19:34.083154 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774367 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774370 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774372 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774375 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774377 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774380 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774383 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774385 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774387 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774390 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774392 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774395 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774400 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774403 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774405 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774408 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774410 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774413 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774415 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774418 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:19:34.083657 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774420 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774423 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774426 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774429 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774431 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774434 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774437 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774439 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774445 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774448 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774451 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774454 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.774459 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774571 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774576 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:19:34.084132 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774579 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774583 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774585 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774588 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774591 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774593 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774596 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774598 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774601 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774603 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774608 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774611 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774613 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774616 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774618 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774621 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774623 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774626 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774628 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774631 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:19:34.084508 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774634 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774637 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774641 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774644 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774646 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774649 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774652 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774654 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774657 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774659 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774662 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774665 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774667 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774669 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774672 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774674 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774677 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774680 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774682 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774685 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:19:34.084988 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774687 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774689 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774695 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774698 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774701 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774703 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774706 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774708 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774712 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774716 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774719 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774721 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774724 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774727 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774730 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774733 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774735 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774738 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774741 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:19:34.085492 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774744 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774746 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774749 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774751 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774754 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774756 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774759 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774761 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774764 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774766 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774769 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774771 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774773 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774776 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774778 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774782 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774786 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774790 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774793 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774796 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:19:34.085948 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774798 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774801 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774804 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774806 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774809 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774812 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774816 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774820 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774822 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774825 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774828 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774830 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774833 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774836 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774839 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774842 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774844 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:19:34.086449 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:33.774847 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:19:34.086858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.774852 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:19:34.086858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.774955 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 16:19:34.086858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.777422 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 16:19:34.086858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.779159 2579 server.go:1019] "Starting client certificate rotation" Jul 09 16:19:34.086858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.779258 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 16:19:34.086858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.779289 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 16:19:34.086858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.781845 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 16:19:34.086858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.783343 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 16:19:34.086858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.792401 2579 log.go:25] "Validated CRI v1 runtime API" Jul 09 16:19:34.086858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.794779 2579 log.go:25] "Validated CRI v1 image API" Jul 09 16:19:34.086858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.795531 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 16:19:34.086858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.800059 2579 fs.go:135] Filesystem UUIDs: map[0e849c90-2a15-4f20-bd5c-ffd03ed2791e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cec56319-4cf2-4374-9321-82d59750a325:/dev/nvme0n1p4] Jul 09 16:19:34.087155 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.800073 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 16:19:34.087185 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.805766 2579 manager.go:216] Machine: {Timestamp:2026-07-09 16:19:33.803403671 +0000 UTC m=+0.368663237 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102002 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b471b60ed9ca459d8b8b8922e7c77 SystemUUID:ec2b471b-60ed-9ca4-59d8-b8b8922e7c77 BootID:46835d2e-9432-4369-839c-23cccd73ed4a Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:51:5b:3e:9f:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:51:5b:3e:9f:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:0f:46:8e:bd:8f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 16:19:34.087185 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.805867 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 16:19:34.087185 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.805970 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 16:19:34.087185 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.809840 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 16:19:34.087185 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.809871 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 16:19:34.087185 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.810738 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 16:19:34.087185 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.810749 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 16:19:34.087185 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.810756 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.810769 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.812758 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.817205 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.817334 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.817375 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.817389 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.817402 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.817411 2579 kubelet.go:398] "Adding apiserver pod source" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.817419 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.817717 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.817731 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.817787 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.820652 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.822995 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823022 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823187 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823199 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823204 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823210 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823217 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823223 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823824 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823831 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823837 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823845 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823859 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.823867 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.825534 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.825548 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:33.828081 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:33.828088 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.828107 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.828471 2579 server.go:1268] "Started kubelet" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.828578 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.828611 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.828595 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.830094 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.830504 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 09 16:19:34.087438 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:33.836886 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.837903 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.837915 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.838225 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xpr8r" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:33.838267 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.838755 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.838755 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.838789 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.838906 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.838917 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.838948 2579 factory.go:55] Registering systemd factory Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.838965 2579 factory.go:223] Registration of the systemd container factory successfully Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.839241 2579 factory.go:153] Registering CRI-O factory Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.839257 2579 factory.go:223] Registration of the crio container factory successfully Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.839312 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.839350 2579 factory.go:103] Registering Raw factory Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.839364 2579 manager.go:1196] Started watching for new ooms in manager Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.839760 2579 manager.go:349] Starting recovery of all containers Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:33.844647 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:33.844869 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.845634 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xpr8r" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:33.844657 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-68.ec2.internal.18c0ab758e77af2b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-68.ec2.internal,UID:ip-10-0-136-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-68.ec2.internal,},FirstTimestamp:2026-07-09 16:19:33.828448043 +0000 UTC m=+0.393707589,LastTimestamp:2026-07-09 16:19:33.828448043 +0000 UTC m=+0.393707589,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-68.ec2.internal,}" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.851383 2579 manager.go:354] Recovery completed Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.855799 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.861178 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.861202 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.861212 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.861683 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.861694 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.861710 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.861727 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.862409 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:19:34.088438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.862434 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.862448 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.863583 2579 policy_none.go:49] "None policy: Start" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.863596 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.863608 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.865438 2579 policy_none.go:47] "Start" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.916338 2579 manager.go:337] "Starting Device Plugin manager" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:33.916497 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.916510 2579 server.go:87] "Starting device plugin registration server" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.916708 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.916717 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.916817 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.916900 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:33.916908 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:33.917403 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:33.917451 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.017113 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.017964 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.017990 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.018014 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.018045 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.024669 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:34.024686 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-68.ec2.internal\": node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:34.089208 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:34.049499 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:34.110613 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.110589 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 16:19:34.111761 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.111739 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 16:19:34.111831 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.111777 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 16:19:34.111831 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.111797 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 16:19:34.111919 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:34.111833 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 16:19:34.114176 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.114154 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:19:34.149861 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:34.149833 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:34.211943 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.211923 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-68.ec2.internal"] Jul 09 16:19:34.211999 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.211985 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:19:34.217516 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.217498 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:19:34.217583 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.217528 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:19:34.217583 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.217543 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:19:34.219751 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.219738 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:19:34.219890 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.219874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.219932 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.219902 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:19:34.220476 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.220462 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:19:34.220521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.220461 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:19:34.220521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.220490 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:19:34.220521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.220503 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:19:34.220521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.220507 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:19:34.220521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.220518 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:19:34.222752 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.222736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.222787 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.222767 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:19:34.223419 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.223405 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:19:34.223474 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.223430 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:19:34.223474 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.223439 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:19:34.239861 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:34.239844 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-68.ec2.internal\" not found" node="ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.239923 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.239840 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec63ca07b383a4359b0dcb3157d0357a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal\" (UID: \"ec63ca07b383a4359b0dcb3157d0357a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.239923 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.239896 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a636bbdd5023b50004b217a7742580f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-68.ec2.internal\" (UID: \"5a636bbdd5023b50004b217a7742580f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.240007 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.239927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec63ca07b383a4359b0dcb3157d0357a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal\" (UID: \"ec63ca07b383a4359b0dcb3157d0357a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.244190 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:34.244173 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-68.ec2.internal\" not found" node="ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.249963 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:34.249949 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:34.340691 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.340638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a636bbdd5023b50004b217a7742580f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-68.ec2.internal\" (UID: \"5a636bbdd5023b50004b217a7742580f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.340691 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.340667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec63ca07b383a4359b0dcb3157d0357a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal\" (UID: \"ec63ca07b383a4359b0dcb3157d0357a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.340818 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.340692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec63ca07b383a4359b0dcb3157d0357a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal\" (UID: \"ec63ca07b383a4359b0dcb3157d0357a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.340818 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.340733 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec63ca07b383a4359b0dcb3157d0357a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal\" (UID: \"ec63ca07b383a4359b0dcb3157d0357a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.340818 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.340746 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec63ca07b383a4359b0dcb3157d0357a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal\" (UID: \"ec63ca07b383a4359b0dcb3157d0357a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.340818 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:34.340732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a636bbdd5023b50004b217a7742580f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-68.ec2.internal\" (UID: \"5a636bbdd5023b50004b217a7742580f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-68.ec2.internal" Jul 09 16:19:34.350772 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:34.350744 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:34.451224 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:34.451204 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:36.188250 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:36.188227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" Jul 09 16:19:36.193887 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:36.193874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-68.ec2.internal" Jul 09 16:19:36.197964 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:36.197943 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:36.298527 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:36.298463 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:36.398936 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:36.398909 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:36.424850 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:36.424824 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 16:19:36.424978 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:36.424923 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 16:19:36.426609 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:36.426594 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:19:36.495995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:36.495969 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:19:36.496986 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:36.496963 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 16:14:35 +0000 UTC" deadline="2028-01-28 11:56:47.150093665 +0000 UTC" Jul 09 16:19:36.497065 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:36.496987 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13627h37m10.653109467s" Jul 09 16:19:36.498972 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:36.498957 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:36.599615 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:36.599548 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:36.700047 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:36.700019 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:36.800555 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:36.800526 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:36.845712 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:36.845682 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec63ca07b383a4359b0dcb3157d0357a.slice/crio-ed317076b9826dad140ab01ddf273eb6664a6906c35a375ee501a9628d56496e WatchSource:0}: Error finding container ed317076b9826dad140ab01ddf273eb6664a6906c35a375ee501a9628d56496e: Status 404 returned error can't find the container with id ed317076b9826dad140ab01ddf273eb6664a6906c35a375ee501a9628d56496e Jul 09 16:19:36.845904 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:36.845885 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a636bbdd5023b50004b217a7742580f.slice/crio-3a84647320c3722aaa22c6370587b455a81500d25df2a9cbc772698b17af0051 WatchSource:0}: Error finding container 3a84647320c3722aaa22c6370587b455a81500d25df2a9cbc772698b17af0051: Status 404 returned error can't find the container with id 3a84647320c3722aaa22c6370587b455a81500d25df2a9cbc772698b17af0051 Jul 09 16:19:36.849735 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:36.849693 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:19:36.901394 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:36.901369 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-68.ec2.internal\" not found" Jul 09 16:19:36.958075 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:36.958056 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:19:36.986112 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:36.986085 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-68.ec2.internal" Jul 09 16:19:36.999371 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:36.999352 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 16:19:37.000245 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.000233 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" Jul 09 16:19:37.009972 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.009950 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 16:19:37.465149 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.465123 2579 apiserver.go:52] "Watching apiserver" Jul 09 16:19:37.475528 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.475502 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 16:19:37.475964 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.475933 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq","openshift-dns/node-resolver-vncrr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal","openshift-multus/multus-additional-cni-plugins-r9k6g","openshift-multus/multus-rcg8w","openshift-multus/network-metrics-daemon-m7dk6","openshift-network-diagnostics/network-check-target-x5wpm","kube-system/global-pull-secret-syncer-sv2vz","kube-system/kube-apiserver-proxy-ip-10-0-136-68.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5wh4n","openshift-image-registry/node-ca-rhv24","openshift-network-operator/iptables-alerter-5gbfk","openshift-ovn-kubernetes/ovnkube-node-2gz42","kube-system/konnectivity-agent-lrlzz"] Jul 09 16:19:37.478392 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.478355 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:37.478515 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:37.478473 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:37.480933 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.480910 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.483506 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.483489 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cgwdj\"" Jul 09 16:19:37.483601 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.483490 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 16:19:37.485100 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.485077 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 16:19:37.486220 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.485325 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 16:19:37.486220 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.485628 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 16:19:37.486220 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.485700 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 16:19:37.486220 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.485845 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 16:19:37.486220 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.485905 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 16:19:37.486496 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.486233 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lrlzz" Jul 09 16:19:37.488598 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.488577 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 16:19:37.488685 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.488622 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.488896 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.488876 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 16:19:37.489218 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.489198 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mp5mz\"" Jul 09 16:19:37.490947 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.490927 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.491677 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.491657 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 16:19:37.491768 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.491724 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 16:19:37.491831 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.491787 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 16:19:37.491886 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.491870 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dz6mk\"" Jul 09 16:19:37.492161 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.491942 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 16:19:37.492161 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.491982 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 16:19:37.493762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.493594 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:37.493762 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:37.493669 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:19:37.493920 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.493899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-etc-openvswitch\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.493979 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.493933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-cnibin\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.493979 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.493957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhd9t\" (UniqueName: \"kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t\") pod \"network-check-target-x5wpm\" (UID: \"91ef3c26-f109-4bf9-9b5d-2a5d18e653cf\") " pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:37.494097 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.493982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b350930-4666-4d3c-a663-d0940d49511e-konnectivity-ca\") pod \"konnectivity-agent-lrlzz\" (UID: \"3b350930-4666-4d3c-a663-d0940d49511e\") " pod="kube-system/konnectivity-agent-lrlzz" Jul 09 16:19:37.494097 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494024 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9sjh\" (UniqueName: \"kubernetes.io/projected/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-kube-api-access-p9sjh\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.494097 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-kubelet\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494097 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494088 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-run-netns\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494254 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-log-socket\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494254 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-cni-bin\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494254 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7090715-8cae-4699-9092-38e8bb46ce56-ovnkube-config\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494254 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.494396 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.494396 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494396 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494365 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b350930-4666-4d3c-a663-d0940d49511e-agent-certs\") pod \"konnectivity-agent-lrlzz\" (UID: \"3b350930-4666-4d3c-a663-d0940d49511e\") " pod="kube-system/konnectivity-agent-lrlzz" Jul 09 16:19:37.494396 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-slash\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494576 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494396 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ffv6z\"" Jul 09 16:19:37.494576 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-run-ovn\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494576 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-cni-netd\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494576 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494482 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7090715-8cae-4699-9092-38e8bb46ce56-env-overrides\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494576 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494488 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 16:19:37.494576 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494506 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7090715-8cae-4699-9092-38e8bb46ce56-ovn-node-metrics-cert\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494810 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-system-cni-dir\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.494810 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.494810 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-run-openvswitch\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494810 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7090715-8cae-4699-9092-38e8bb46ce56-ovnkube-script-lib\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494810 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.494962 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-systemd-units\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494962 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-run-systemd\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494962 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-var-lib-openvswitch\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494962 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494911 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-run-ovn-kubernetes\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.494962 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494940 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-os-release\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.495137 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.494962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-node-log\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.495137 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.495033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dj7j\" (UniqueName: \"kubernetes.io/projected/e7090715-8cae-4699-9092-38e8bb46ce56-kube-api-access-2dj7j\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.496083 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.495905 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:37.496083 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:37.495968 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:19:37.498344 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.498327 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.498433 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.498343 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 16:19:37.500841 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.500829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vncrr" Jul 09 16:19:37.501532 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.501510 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 16:19:37.501723 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.501707 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 16:19:37.502156 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.501997 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 16:19:37.502156 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.502132 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rlfsb\"" Jul 09 16:19:37.503337 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.503318 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vqtwq\"" Jul 09 16:19:37.504087 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.503650 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 16:19:37.504087 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.503820 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 16:19:37.504087 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.503974 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.506111 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.506096 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rhv24" Jul 09 16:19:37.506356 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.506338 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r2nlj\"" Jul 09 16:19:37.506580 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.506562 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:19:37.506896 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.506879 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 16:19:37.508529 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.508485 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5gbfk" Jul 09 16:19:37.509241 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.509191 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 16:19:37.509545 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.509524 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 16:19:37.509624 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.509574 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 16:19:37.509831 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.509814 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zds8c\"" Jul 09 16:19:37.510923 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.510904 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9wwf2\"" Jul 09 16:19:37.511047 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.511028 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:19:37.511120 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.511056 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 16:19:37.511186 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.511143 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 16:19:37.519827 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.519803 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cnssg" Jul 09 16:19:37.527744 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.527547 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cnssg" Jul 09 16:19:37.540384 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.540363 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:19:37.586783 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.586760 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 16:19:37.596256 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-etc-openvswitch\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.596370 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596276 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bc9ab36-d3a5-498c-b475-8ee3766e22ba-tmp-dir\") pod \"node-resolver-vncrr\" (UID: \"4bc9ab36-d3a5-498c-b475-8ee3766e22ba\") " pod="openshift-dns/node-resolver-vncrr" Jul 09 16:19:37.596370 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbzqf\" (UniqueName: \"kubernetes.io/projected/25d1d3b8-87e8-420e-bfe7-e911c28de230-kube-api-access-kbzqf\") pod \"node-ca-rhv24\" (UID: \"25d1d3b8-87e8-420e-bfe7-e911c28de230\") " pod="openshift-image-registry/node-ca-rhv24" Jul 09 16:19:37.596370 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596330 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhd9t\" (UniqueName: \"kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t\") pod \"network-check-target-x5wpm\" (UID: \"91ef3c26-f109-4bf9-9b5d-2a5d18e653cf\") " pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:37.596370 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596332 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-etc-openvswitch\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.596370 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-run-multus-certs\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.596625 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-kubelet\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.596625 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-log-socket\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.596625 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596450 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-cni-bin\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.596625 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596502 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-log-socket\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.596625 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-var-lib-cni-multus\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.596861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596637 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.596861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596663 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-socket-dir\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.596861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596687 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-sys-fs\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.596861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596710 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04cb3e55-4854-4cc6-af88-920e1811a6e3-iptables-alerter-script\") pod \"iptables-alerter-5gbfk\" (UID: \"04cb3e55-4854-4cc6-af88-920e1811a6e3\") " pod="openshift-network-operator/iptables-alerter-5gbfk" Jul 09 16:19:37.596861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-cnibin\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.596861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596755 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-run-netns\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.596861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596763 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-kubelet\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.596861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596729 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-cni-bin\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.596861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-hostroot\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.596861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-slash\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.596861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-run-ovn\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596905 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-slash\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-cni-netd\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596939 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-run-ovn\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.596968 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25d1d3b8-87e8-420e-bfe7-e911c28de230-host\") pod \"node-ca-rhv24\" (UID: \"25d1d3b8-87e8-420e-bfe7-e911c28de230\") " pod="openshift-image-registry/node-ca-rhv24" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597018 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-cni-netd\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-var-lib-kubelet\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-multus-conf-dir\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-run-openvswitch\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-sys\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-host\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597207 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-run-openvswitch\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597253 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-multus-cni-dir\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/384df07c-6bfc-4b00-b3cd-d2a1fb445456-cni-binary-copy\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-run-systemd\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.597762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-os-release\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6e6d712-640a-4715-80de-aafc48c77aff-tmp\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d7nf\" (UniqueName: \"kubernetes.io/projected/f6e6d712-640a-4715-80de-aafc48c77aff-kube-api-access-4d7nf\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25d1d3b8-87e8-420e-bfe7-e911c28de230-serviceca\") pod \"node-ca-rhv24\" (UID: \"25d1d3b8-87e8-420e-bfe7-e911c28de230\") " pod="openshift-image-registry/node-ca-rhv24" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04cb3e55-4854-4cc6-af88-920e1811a6e3-host-slash\") pod \"iptables-alerter-5gbfk\" (UID: \"04cb3e55-4854-4cc6-af88-920e1811a6e3\") " pod="openshift-network-operator/iptables-alerter-5gbfk" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-multus-socket-dir-parent\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-var-lib-cni-bin\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-node-log\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597619 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-registration-dir\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-etc-selinux\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597650 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-os-release\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-cnibin\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597748 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-run-systemd\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-modprobe-d\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.598503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-sysctl-conf\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597787 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-node-log\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597793 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-var-lib-kubelet\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-os-release\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597843 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-cnibin\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b350930-4666-4d3c-a663-d0940d49511e-konnectivity-ca\") pod \"konnectivity-agent-lrlzz\" (UID: \"3b350930-4666-4d3c-a663-d0940d49511e\") " pod="kube-system/konnectivity-agent-lrlzz" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9sjh\" (UniqueName: \"kubernetes.io/projected/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-kube-api-access-p9sjh\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg8nh\" (UniqueName: \"kubernetes.io/projected/4bc9ab36-d3a5-498c-b475-8ee3766e22ba-kube-api-access-rg8nh\") pod \"node-resolver-vncrr\" (UID: \"4bc9ab36-d3a5-498c-b475-8ee3766e22ba\") " pod="openshift-dns/node-resolver-vncrr" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-kubernetes\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.597994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6e6d712-640a-4715-80de-aafc48c77aff-etc-tuned\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76kkc\" (UniqueName: \"kubernetes.io/projected/04cb3e55-4854-4cc6-af88-920e1811a6e3-kube-api-access-76kkc\") pod \"iptables-alerter-5gbfk\" (UID: \"04cb3e55-4854-4cc6-af88-920e1811a6e3\") " pod="openshift-network-operator/iptables-alerter-5gbfk" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-system-cni-dir\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598060 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpkp9\" (UniqueName: \"kubernetes.io/projected/384df07c-6bfc-4b00-b3cd-d2a1fb445456-kube-api-access-zpkp9\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.599157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-run-netns\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7090715-8cae-4699-9092-38e8bb46ce56-ovnkube-config\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rf96\" (UniqueName: \"kubernetes.io/projected/9317c64f-d51f-422c-a451-9e6e408c9a92-kube-api-access-8rf96\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598276 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b350930-4666-4d3c-a663-d0940d49511e-agent-certs\") pod \"konnectivity-agent-lrlzz\" (UID: \"3b350930-4666-4d3c-a663-d0940d49511e\") " pod="kube-system/konnectivity-agent-lrlzz" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-lib-modules\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-device-dir\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7090715-8cae-4699-9092-38e8bb46ce56-env-overrides\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7090715-8cae-4699-9092-38e8bb46ce56-ovn-node-metrics-cert\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-system-cni-dir\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598538 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-sysctl-d\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.599778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598544 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b350930-4666-4d3c-a663-d0940d49511e-konnectivity-ca\") pod \"konnectivity-agent-lrlzz\" (UID: \"3b350930-4666-4d3c-a663-d0940d49511e\") " pod="kube-system/konnectivity-agent-lrlzz" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-systemd\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598563 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7090715-8cae-4699-9092-38e8bb46ce56-ovnkube-config\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-run-k8s-cni-cncf-io\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598617 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7090715-8cae-4699-9092-38e8bb46ce56-ovnkube-script-lib\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598623 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f72de83-30e7-44bf-aa2e-f506b2358e31-dbus\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/384df07c-6bfc-4b00-b3cd-d2a1fb445456-multus-daemon-config\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598746 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-etc-kubernetes\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598835 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-systemd-units\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-var-lib-openvswitch\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-run-ovn-kubernetes\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.600437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4bc9ab36-d3a5-498c-b475-8ee3766e22ba-hosts-file\") pod \"node-resolver-vncrr\" (UID: \"4bc9ab36-d3a5-498c-b475-8ee3766e22ba\") " pod="openshift-dns/node-resolver-vncrr" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598936 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-sysconfig\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598939 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7090715-8cae-4699-9092-38e8bb46ce56-env-overrides\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-run\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598975 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dj7j\" (UniqueName: \"kubernetes.io/projected/e7090715-8cae-4699-9092-38e8bb46ce56-kube-api-access-2dj7j\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.598993 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f72de83-30e7-44bf-aa2e-f506b2358e31-kubelet-config\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.599023 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvq9t\" (UniqueName: \"kubernetes.io/projected/c15d8f2f-8a45-42a9-a0c7-05824ad16867-kube-api-access-xvq9t\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.599119 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.599435 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7090715-8cae-4699-9092-38e8bb46ce56-ovnkube-script-lib\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.599436 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.599496 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-systemd-units\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.599533 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-var-lib-openvswitch\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.599557 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-run-ovn-kubernetes\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.599776 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-system-cni-dir\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.601146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.599785 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.601791 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.600102 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.601791 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.600286 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.601791 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.600463 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7090715-8cae-4699-9092-38e8bb46ce56-host-run-netns\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.604410 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.604390 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b350930-4666-4d3c-a663-d0940d49511e-agent-certs\") pod \"konnectivity-agent-lrlzz\" (UID: \"3b350930-4666-4d3c-a663-d0940d49511e\") " pod="kube-system/konnectivity-agent-lrlzz" Jul 09 16:19:37.604929 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.604906 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7090715-8cae-4699-9092-38e8bb46ce56-ovn-node-metrics-cert\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.610678 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:37.610659 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:19:37.610778 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:37.610685 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:19:37.610778 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:37.610710 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qhd9t for pod openshift-network-diagnostics/network-check-target-x5wpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:19:37.610872 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:37.610789 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t podName:91ef3c26-f109-4bf9-9b5d-2a5d18e653cf nodeName:}" failed. No retries permitted until 2026-07-09 16:19:38.110760703 +0000 UTC m=+3.029332018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qhd9t" (UniqueName: "kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t") pod "network-check-target-x5wpm" (UID: "91ef3c26-f109-4bf9-9b5d-2a5d18e653cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:19:37.617550 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.617528 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9sjh\" (UniqueName: \"kubernetes.io/projected/05665ae0-dbfa-4fdf-b7f8-223e87d067d2-kube-api-access-p9sjh\") pod \"multus-additional-cni-plugins-r9k6g\" (UID: \"05665ae0-dbfa-4fdf-b7f8-223e87d067d2\") " pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.618291 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.617918 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dj7j\" (UniqueName: \"kubernetes.io/projected/e7090715-8cae-4699-9092-38e8bb46ce56-kube-api-access-2dj7j\") pod \"ovnkube-node-2gz42\" (UID: \"e7090715-8cae-4699-9092-38e8bb46ce56\") " pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.700262 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25d1d3b8-87e8-420e-bfe7-e911c28de230-serviceca\") pod \"node-ca-rhv24\" (UID: \"25d1d3b8-87e8-420e-bfe7-e911c28de230\") " pod="openshift-image-registry/node-ca-rhv24" Jul 09 16:19:37.700421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04cb3e55-4854-4cc6-af88-920e1811a6e3-host-slash\") pod \"iptables-alerter-5gbfk\" (UID: \"04cb3e55-4854-4cc6-af88-920e1811a6e3\") " pod="openshift-network-operator/iptables-alerter-5gbfk" Jul 09 16:19:37.700421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-multus-socket-dir-parent\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.700421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-var-lib-cni-bin\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.700421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-registration-dir\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.700421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-etc-selinux\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700448 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-var-lib-cni-bin\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700481 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-etc-selinux\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700483 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-multus-socket-dir-parent\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-modprobe-d\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700529 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04cb3e55-4854-4cc6-af88-920e1811a6e3-host-slash\") pod \"iptables-alerter-5gbfk\" (UID: \"04cb3e55-4854-4cc6-af88-920e1811a6e3\") " pod="openshift-network-operator/iptables-alerter-5gbfk" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-sysctl-conf\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700539 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-registration-dir\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-var-lib-kubelet\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-os-release\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8nh\" (UniqueName: \"kubernetes.io/projected/4bc9ab36-d3a5-498c-b475-8ee3766e22ba-kube-api-access-rg8nh\") pod \"node-resolver-vncrr\" (UID: \"4bc9ab36-d3a5-498c-b475-8ee3766e22ba\") " pod="openshift-dns/node-resolver-vncrr" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700648 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-sysctl-conf\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700648 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-var-lib-kubelet\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.700668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-kubernetes\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6e6d712-640a-4715-80de-aafc48c77aff-etc-tuned\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700701 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-kubernetes\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:37.700724 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76kkc\" (UniqueName: \"kubernetes.io/projected/04cb3e55-4854-4cc6-af88-920e1811a6e3-kube-api-access-76kkc\") pod \"iptables-alerter-5gbfk\" (UID: \"04cb3e55-4854-4cc6-af88-920e1811a6e3\") " pod="openshift-network-operator/iptables-alerter-5gbfk" Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-system-cni-dir\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700770 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25d1d3b8-87e8-420e-bfe7-e911c28de230-serviceca\") pod \"node-ca-rhv24\" (UID: \"25d1d3b8-87e8-420e-bfe7-e911c28de230\") " pod="openshift-image-registry/node-ca-rhv24" Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:37.700780 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs podName:9317c64f-d51f-422c-a451-9e6e408c9a92 nodeName:}" failed. No retries permitted until 2026-07-09 16:19:38.200762465 +0000 UTC m=+3.119333790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs") pod "network-metrics-daemon-m7dk6" (UID: "9317c64f-d51f-422c-a451-9e6e408c9a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpkp9\" (UniqueName: \"kubernetes.io/projected/384df07c-6bfc-4b00-b3cd-d2a1fb445456-kube-api-access-zpkp9\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700801 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-system-cni-dir\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700611 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-modprobe-d\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700830 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rf96\" (UniqueName: \"kubernetes.io/projected/9317c64f-d51f-422c-a451-9e6e408c9a92-kube-api-access-8rf96\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-lib-modules\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-device-dir\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.701421 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-sysctl-d\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-systemd\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-run-k8s-cni-cncf-io\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.700980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f72de83-30e7-44bf-aa2e-f506b2358e31-dbus\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/384df07c-6bfc-4b00-b3cd-d2a1fb445456-multus-daemon-config\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-etc-kubernetes\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701070 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-os-release\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701091 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-run-k8s-cni-cncf-io\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4bc9ab36-d3a5-498c-b475-8ee3766e22ba-hosts-file\") pod \"node-resolver-vncrr\" (UID: \"4bc9ab36-d3a5-498c-b475-8ee3766e22ba\") " pod="openshift-dns/node-resolver-vncrr" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-sysconfig\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:37.701168 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701166 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-sysctl-d\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701201 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-run\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701241 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4bc9ab36-d3a5-498c-b475-8ee3766e22ba-hosts-file\") pod \"node-resolver-vncrr\" (UID: \"4bc9ab36-d3a5-498c-b475-8ee3766e22ba\") " pod="openshift-dns/node-resolver-vncrr" Jul 09 16:19:37.702108 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:37.701247 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret podName:6f72de83-30e7-44bf-aa2e-f506b2358e31 nodeName:}" failed. No retries permitted until 2026-07-09 16:19:38.201233615 +0000 UTC m=+3.119804925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret") pod "global-pull-secret-syncer-sv2vz" (UID: "6f72de83-30e7-44bf-aa2e-f506b2358e31") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701268 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-lib-modules\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701282 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f72de83-30e7-44bf-aa2e-f506b2358e31-dbus\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701286 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-sysconfig\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701290 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-etc-systemd\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-run\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701323 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-device-dir\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701330 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f72de83-30e7-44bf-aa2e-f506b2358e31-kubelet-config\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701121 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-etc-kubernetes\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvq9t\" (UniqueName: \"kubernetes.io/projected/c15d8f2f-8a45-42a9-a0c7-05824ad16867-kube-api-access-xvq9t\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701388 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bc9ab36-d3a5-498c-b475-8ee3766e22ba-tmp-dir\") pod \"node-resolver-vncrr\" (UID: \"4bc9ab36-d3a5-498c-b475-8ee3766e22ba\") " pod="openshift-dns/node-resolver-vncrr" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701392 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f72de83-30e7-44bf-aa2e-f506b2358e31-kubelet-config\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbzqf\" (UniqueName: \"kubernetes.io/projected/25d1d3b8-87e8-420e-bfe7-e911c28de230-kube-api-access-kbzqf\") pod \"node-ca-rhv24\" (UID: \"25d1d3b8-87e8-420e-bfe7-e911c28de230\") " pod="openshift-image-registry/node-ca-rhv24" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-run-multus-certs\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-var-lib-cni-multus\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.702854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701578 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701603 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-socket-dir\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-sys-fs\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04cb3e55-4854-4cc6-af88-920e1811a6e3-iptables-alerter-script\") pod \"iptables-alerter-5gbfk\" (UID: \"04cb3e55-4854-4cc6-af88-920e1811a6e3\") " pod="openshift-network-operator/iptables-alerter-5gbfk" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701658 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/384df07c-6bfc-4b00-b3cd-d2a1fb445456-multus-daemon-config\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701670 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701677 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-cnibin\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701710 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bc9ab36-d3a5-498c-b475-8ee3766e22ba-tmp-dir\") pod \"node-resolver-vncrr\" (UID: \"4bc9ab36-d3a5-498c-b475-8ee3766e22ba\") " pod="openshift-dns/node-resolver-vncrr" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701719 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-sys-fs\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701723 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-cnibin\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701625 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-var-lib-cni-multus\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701743 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-run-netns\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701752 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c15d8f2f-8a45-42a9-a0c7-05824ad16867-socket-dir\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-run-netns\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701777 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-run-multus-certs\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.703572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-hostroot\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25d1d3b8-87e8-420e-bfe7-e911c28de230-host\") pod \"node-ca-rhv24\" (UID: \"25d1d3b8-87e8-420e-bfe7-e911c28de230\") " pod="openshift-image-registry/node-ca-rhv24" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701853 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25d1d3b8-87e8-420e-bfe7-e911c28de230-host\") pod \"node-ca-rhv24\" (UID: \"25d1d3b8-87e8-420e-bfe7-e911c28de230\") " pod="openshift-image-registry/node-ca-rhv24" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701822 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-hostroot\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-var-lib-kubelet\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-multus-conf-dir\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701910 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-host-var-lib-kubelet\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-sys\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-host\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701951 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-multus-conf-dir\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-multus-cni-dir\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/384df07c-6bfc-4b00-b3cd-d2a1fb445456-cni-binary-copy\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.701997 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-sys\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.702029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6e6d712-640a-4715-80de-aafc48c77aff-host\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.702038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6e6d712-640a-4715-80de-aafc48c77aff-tmp\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.704265 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.702062 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d7nf\" (UniqueName: \"kubernetes.io/projected/f6e6d712-640a-4715-80de-aafc48c77aff-kube-api-access-4d7nf\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.704975 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.702070 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/384df07c-6bfc-4b00-b3cd-d2a1fb445456-multus-cni-dir\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.704975 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.702249 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04cb3e55-4854-4cc6-af88-920e1811a6e3-iptables-alerter-script\") pod \"iptables-alerter-5gbfk\" (UID: \"04cb3e55-4854-4cc6-af88-920e1811a6e3\") " pod="openshift-network-operator/iptables-alerter-5gbfk" Jul 09 16:19:37.704975 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.702491 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/384df07c-6bfc-4b00-b3cd-d2a1fb445456-cni-binary-copy\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.706881 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.706838 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6e6d712-640a-4715-80de-aafc48c77aff-etc-tuned\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.707601 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.707562 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6e6d712-640a-4715-80de-aafc48c77aff-tmp\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.718925 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.718847 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg8nh\" (UniqueName: \"kubernetes.io/projected/4bc9ab36-d3a5-498c-b475-8ee3766e22ba-kube-api-access-rg8nh\") pod \"node-resolver-vncrr\" (UID: \"4bc9ab36-d3a5-498c-b475-8ee3766e22ba\") " pod="openshift-dns/node-resolver-vncrr" Jul 09 16:19:37.720775 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.720734 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d7nf\" (UniqueName: \"kubernetes.io/projected/f6e6d712-640a-4715-80de-aafc48c77aff-kube-api-access-4d7nf\") pod \"tuned-5wh4n\" (UID: \"f6e6d712-640a-4715-80de-aafc48c77aff\") " pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.728921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.728899 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpkp9\" (UniqueName: \"kubernetes.io/projected/384df07c-6bfc-4b00-b3cd-d2a1fb445456-kube-api-access-zpkp9\") pod \"multus-rcg8w\" (UID: \"384df07c-6bfc-4b00-b3cd-d2a1fb445456\") " pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.729149 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.729128 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rf96\" (UniqueName: \"kubernetes.io/projected/9317c64f-d51f-422c-a451-9e6e408c9a92-kube-api-access-8rf96\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:37.734618 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.734592 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76kkc\" (UniqueName: \"kubernetes.io/projected/04cb3e55-4854-4cc6-af88-920e1811a6e3-kube-api-access-76kkc\") pod \"iptables-alerter-5gbfk\" (UID: \"04cb3e55-4854-4cc6-af88-920e1811a6e3\") " pod="openshift-network-operator/iptables-alerter-5gbfk" Jul 09 16:19:37.735130 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.735090 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbzqf\" (UniqueName: \"kubernetes.io/projected/25d1d3b8-87e8-420e-bfe7-e911c28de230-kube-api-access-kbzqf\") pod \"node-ca-rhv24\" (UID: \"25d1d3b8-87e8-420e-bfe7-e911c28de230\") " pod="openshift-image-registry/node-ca-rhv24" Jul 09 16:19:37.737134 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.737111 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvq9t\" (UniqueName: \"kubernetes.io/projected/c15d8f2f-8a45-42a9-a0c7-05824ad16867-kube-api-access-xvq9t\") pod \"aws-ebs-csi-driver-node-m8zpq\" (UID: \"c15d8f2f-8a45-42a9-a0c7-05824ad16867\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.763990 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.763944 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-68.ec2.internal" event={"ID":"5a636bbdd5023b50004b217a7742580f","Type":"ContainerStarted","Data":"3a84647320c3722aaa22c6370587b455a81500d25df2a9cbc772698b17af0051"} Jul 09 16:19:37.765427 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.765401 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" event={"ID":"ec63ca07b383a4359b0dcb3157d0357a","Type":"ContainerStarted","Data":"ed317076b9826dad140ab01ddf273eb6664a6906c35a375ee501a9628d56496e"} Jul 09 16:19:37.797048 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.796985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:19:37.804113 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.804088 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lrlzz" Jul 09 16:19:37.810527 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:37.810503 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7090715_8cae_4699_9092_38e8bb46ce56.slice/crio-b82e2bb690183acf90db546e1904dd109342bd634066373f386a67c3d307cb8a WatchSource:0}: Error finding container b82e2bb690183acf90db546e1904dd109342bd634066373f386a67c3d307cb8a: Status 404 returned error can't find the container with id b82e2bb690183acf90db546e1904dd109342bd634066373f386a67c3d307cb8a Jul 09 16:19:37.814213 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.814193 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9k6g" Jul 09 16:19:37.815069 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:37.815046 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b350930_4666_4d3c_a663_d0940d49511e.slice/crio-bfc37380da1b5e3d2f4f6c5ebf9f37239a2095ab5f978d1a7f090bef4e910e60 WatchSource:0}: Error finding container bfc37380da1b5e3d2f4f6c5ebf9f37239a2095ab5f978d1a7f090bef4e910e60: Status 404 returned error can't find the container with id bfc37380da1b5e3d2f4f6c5ebf9f37239a2095ab5f978d1a7f090bef4e910e60 Jul 09 16:19:37.821240 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.821131 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rcg8w" Jul 09 16:19:37.828767 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:37.828737 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05665ae0_dbfa_4fdf_b7f8_223e87d067d2.slice/crio-0802655d56af4084a4806a6d65d390dc493808729236ccd78552779a6b24231c WatchSource:0}: Error finding container 0802655d56af4084a4806a6d65d390dc493808729236ccd78552779a6b24231c: Status 404 returned error can't find the container with id 0802655d56af4084a4806a6d65d390dc493808729236ccd78552779a6b24231c Jul 09 16:19:37.830813 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.830721 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" Jul 09 16:19:37.833366 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:37.833343 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384df07c_6bfc_4b00_b3cd_d2a1fb445456.slice/crio-f7dd6dc2bd4e863779d8a98a8c413c901d0b3816a2fa37534c3ec3040c08780f WatchSource:0}: Error finding container f7dd6dc2bd4e863779d8a98a8c413c901d0b3816a2fa37534c3ec3040c08780f: Status 404 returned error can't find the container with id f7dd6dc2bd4e863779d8a98a8c413c901d0b3816a2fa37534c3ec3040c08780f Jul 09 16:19:37.838276 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.838256 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vncrr" Jul 09 16:19:37.840807 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:37.840783 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc15d8f2f_8a45_42a9_a0c7_05824ad16867.slice/crio-0e1c9ee470eebb953075fe4542c8caef35a6660d910880ccffba2331111910ee WatchSource:0}: Error finding container 0e1c9ee470eebb953075fe4542c8caef35a6660d910880ccffba2331111910ee: Status 404 returned error can't find the container with id 0e1c9ee470eebb953075fe4542c8caef35a6660d910880ccffba2331111910ee Jul 09 16:19:37.846608 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.846586 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" Jul 09 16:19:37.857337 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.857318 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rhv24" Jul 09 16:19:37.865779 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:37.865760 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5gbfk" Jul 09 16:19:38.205453 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:38.205374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:38.205453 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:38.205427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:38.205649 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:38.205464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhd9t\" (UniqueName: \"kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t\") pod \"network-check-target-x5wpm\" (UID: \"91ef3c26-f109-4bf9-9b5d-2a5d18e653cf\") " pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:38.205649 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:38.205544 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:19:38.205649 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:38.205583 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:19:38.205649 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:38.205619 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs podName:9317c64f-d51f-422c-a451-9e6e408c9a92 nodeName:}" failed. No retries permitted until 2026-07-09 16:19:39.205598811 +0000 UTC m=+4.124170136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs") pod "network-metrics-daemon-m7dk6" (UID: "9317c64f-d51f-422c-a451-9e6e408c9a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:19:38.205649 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:38.205645 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret podName:6f72de83-30e7-44bf-aa2e-f506b2358e31 nodeName:}" failed. No retries permitted until 2026-07-09 16:19:39.205627352 +0000 UTC m=+4.124198695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret") pod "global-pull-secret-syncer-sv2vz" (UID: "6f72de83-30e7-44bf-aa2e-f506b2358e31") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:19:38.205649 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:38.205588 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:19:38.205854 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:38.205670 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:19:38.205854 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:38.205681 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qhd9t for pod openshift-network-diagnostics/network-check-target-x5wpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:19:38.205854 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:38.205710 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t podName:91ef3c26-f109-4bf9-9b5d-2a5d18e653cf nodeName:}" failed. No retries permitted until 2026-07-09 16:19:39.205703757 +0000 UTC m=+4.124275067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhd9t" (UniqueName: "kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t") pod "network-check-target-x5wpm" (UID: "91ef3c26-f109-4bf9-9b5d-2a5d18e653cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:19:38.532180 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:38.532080 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 16:14:37 +0000 UTC" deadline="2028-01-18 03:59:16.790251504 +0000 UTC" Jul 09 16:19:38.532180 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:38.532126 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13379h39m38.258128346s" Jul 09 16:19:38.759637 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:38.759175 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:38.759637 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:38.759304 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:19:38.759637 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:38.759180 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:38.759914 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:38.759718 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:38.768898 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:38.768870 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lrlzz" event={"ID":"3b350930-4666-4d3c-a663-d0940d49511e","Type":"ContainerStarted","Data":"bfc37380da1b5e3d2f4f6c5ebf9f37239a2095ab5f978d1a7f090bef4e910e60"} Jul 09 16:19:38.770425 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:38.770398 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" event={"ID":"e7090715-8cae-4699-9092-38e8bb46ce56","Type":"ContainerStarted","Data":"b82e2bb690183acf90db546e1904dd109342bd634066373f386a67c3d307cb8a"} Jul 09 16:19:38.771746 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:38.771720 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" event={"ID":"c15d8f2f-8a45-42a9-a0c7-05824ad16867","Type":"ContainerStarted","Data":"0e1c9ee470eebb953075fe4542c8caef35a6660d910880ccffba2331111910ee"} Jul 09 16:19:38.773020 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:38.772985 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rcg8w" event={"ID":"384df07c-6bfc-4b00-b3cd-d2a1fb445456","Type":"ContainerStarted","Data":"f7dd6dc2bd4e863779d8a98a8c413c901d0b3816a2fa37534c3ec3040c08780f"} Jul 09 16:19:38.774284 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:38.774255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9k6g" event={"ID":"05665ae0-dbfa-4fdf-b7f8-223e87d067d2","Type":"ContainerStarted","Data":"0802655d56af4084a4806a6d65d390dc493808729236ccd78552779a6b24231c"} Jul 09 16:19:39.041599 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:39.041533 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc9ab36_d3a5_498c_b475_8ee3766e22ba.slice/crio-6c4624d52bab82c1ba09825845853204cf96820fea097653ca7ad07ac7235cb6 WatchSource:0}: Error finding container 6c4624d52bab82c1ba09825845853204cf96820fea097653ca7ad07ac7235cb6: Status 404 returned error can't find the container with id 6c4624d52bab82c1ba09825845853204cf96820fea097653ca7ad07ac7235cb6 Jul 09 16:19:39.043575 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:39.043550 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6e6d712_640a_4715_80de_aafc48c77aff.slice/crio-e51572140be9b1feb89c5ef1acfe906f3ec230d04fc726935c97e2410fdc2f8f WatchSource:0}: Error finding container e51572140be9b1feb89c5ef1acfe906f3ec230d04fc726935c97e2410fdc2f8f: Status 404 returned error can't find the container with id e51572140be9b1feb89c5ef1acfe906f3ec230d04fc726935c97e2410fdc2f8f Jul 09 16:19:39.046559 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:39.046535 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d1d3b8_87e8_420e_bfe7_e911c28de230.slice/crio-97e240d15b54ca5233fc40fa2d1faa8766f0c3481f4a1ecf00b52be166da3fe6 WatchSource:0}: Error finding container 97e240d15b54ca5233fc40fa2d1faa8766f0c3481f4a1ecf00b52be166da3fe6: Status 404 returned error can't find the container with id 97e240d15b54ca5233fc40fa2d1faa8766f0c3481f4a1ecf00b52be166da3fe6 Jul 09 16:19:39.047592 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:19:39.047367 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04cb3e55_4854_4cc6_af88_920e1811a6e3.slice/crio-03ff2c63951c137242a5cb3d2248dfefea67963e8a399ecf997c531ded134752 WatchSource:0}: Error finding container 03ff2c63951c137242a5cb3d2248dfefea67963e8a399ecf997c531ded134752: Status 404 returned error can't find the container with id 03ff2c63951c137242a5cb3d2248dfefea67963e8a399ecf997c531ded134752 Jul 09 16:19:39.212704 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.212476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhd9t\" (UniqueName: \"kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t\") pod \"network-check-target-x5wpm\" (UID: \"91ef3c26-f109-4bf9-9b5d-2a5d18e653cf\") " pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:39.212890 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.212751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:39.212890 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.212806 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:39.213020 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:39.212932 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:19:39.213020 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:39.212997 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret podName:6f72de83-30e7-44bf-aa2e-f506b2358e31 nodeName:}" failed. No retries permitted until 2026-07-09 16:19:41.212978649 +0000 UTC m=+6.131549979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret") pod "global-pull-secret-syncer-sv2vz" (UID: "6f72de83-30e7-44bf-aa2e-f506b2358e31") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:19:39.213148 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:39.213113 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:19:39.213148 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:39.213129 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:19:39.213148 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:39.213142 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qhd9t for pod openshift-network-diagnostics/network-check-target-x5wpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:19:39.213288 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:39.213180 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t podName:91ef3c26-f109-4bf9-9b5d-2a5d18e653cf nodeName:}" failed. No retries permitted until 2026-07-09 16:19:41.213168057 +0000 UTC m=+6.131739386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhd9t" (UniqueName: "kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t") pod "network-check-target-x5wpm" (UID: "91ef3c26-f109-4bf9-9b5d-2a5d18e653cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:19:39.213288 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:39.213252 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:19:39.213288 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:39.213285 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs podName:9317c64f-d51f-422c-a451-9e6e408c9a92 nodeName:}" failed. No retries permitted until 2026-07-09 16:19:41.213274787 +0000 UTC m=+6.131846102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs") pod "network-metrics-daemon-m7dk6" (UID: "9317c64f-d51f-422c-a451-9e6e408c9a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:19:39.532661 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.532614 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 16:14:37 +0000 UTC" deadline="2028-01-19 05:51:47.828005819 +0000 UTC" Jul 09 16:19:39.532661 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.532656 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13405h32m8.295354714s" Jul 09 16:19:39.761580 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.761207 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:39.761580 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:39.761339 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:19:39.778459 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.778423 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5gbfk" event={"ID":"04cb3e55-4854-4cc6-af88-920e1811a6e3","Type":"ContainerStarted","Data":"03ff2c63951c137242a5cb3d2248dfefea67963e8a399ecf997c531ded134752"} Jul 09 16:19:39.780280 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.780250 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" event={"ID":"f6e6d712-640a-4715-80de-aafc48c77aff","Type":"ContainerStarted","Data":"e51572140be9b1feb89c5ef1acfe906f3ec230d04fc726935c97e2410fdc2f8f"} Jul 09 16:19:39.781903 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.781872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rhv24" event={"ID":"25d1d3b8-87e8-420e-bfe7-e911c28de230","Type":"ContainerStarted","Data":"97e240d15b54ca5233fc40fa2d1faa8766f0c3481f4a1ecf00b52be166da3fe6"} Jul 09 16:19:39.783485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.783461 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vncrr" event={"ID":"4bc9ab36-d3a5-498c-b475-8ee3766e22ba","Type":"ContainerStarted","Data":"6c4624d52bab82c1ba09825845853204cf96820fea097653ca7ad07ac7235cb6"} Jul 09 16:19:39.788198 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.786975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-68.ec2.internal" event={"ID":"5a636bbdd5023b50004b217a7742580f","Type":"ContainerStarted","Data":"9171df4082ce260d13325e1ed29b1a8be8f6c0ddc212956cbe7cb4404629b49a"} Jul 09 16:19:39.789897 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.789851 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" event={"ID":"ec63ca07b383a4359b0dcb3157d0357a","Type":"ContainerStarted","Data":"f568c32723fae606d4353aebd6628f623cd077f770f4a94af2eeb462770eeeac"} Jul 09 16:19:39.800529 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:39.800480 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-68.ec2.internal" podStartSLOduration=3.800464486 podStartE2EDuration="3.800464486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:19:39.799828954 +0000 UTC m=+4.718400287" watchObservedRunningTime="2026-07-09 16:19:39.800464486 +0000 UTC m=+4.719035820" Jul 09 16:19:40.761535 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:40.760865 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:40.761535 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:40.760996 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:19:40.761535 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:40.761395 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:40.761535 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:40.761484 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:40.805676 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:40.805640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9k6g" event={"ID":"05665ae0-dbfa-4fdf-b7f8-223e87d067d2","Type":"ContainerStarted","Data":"19379b69c2eb97c1c33c0b1f25b9c21045eaa53a59ec09429f0a7b0e9d95c6d8"} Jul 09 16:19:40.812538 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:40.810386 2579 generic.go:356] "Generic (PLEG): container finished" podID="ec63ca07b383a4359b0dcb3157d0357a" containerID="f568c32723fae606d4353aebd6628f623cd077f770f4a94af2eeb462770eeeac" exitCode=0 Jul 09 16:19:40.812538 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:40.811272 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" event={"ID":"ec63ca07b383a4359b0dcb3157d0357a","Type":"ContainerDied","Data":"f568c32723fae606d4353aebd6628f623cd077f770f4a94af2eeb462770eeeac"} Jul 09 16:19:41.229140 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:41.228243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhd9t\" (UniqueName: \"kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t\") pod \"network-check-target-x5wpm\" (UID: \"91ef3c26-f109-4bf9-9b5d-2a5d18e653cf\") " pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:41.229140 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:41.228314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:41.229140 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:41.228356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:41.229140 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:41.228483 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:19:41.229140 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:41.228541 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret podName:6f72de83-30e7-44bf-aa2e-f506b2358e31 nodeName:}" failed. No retries permitted until 2026-07-09 16:19:45.228522649 +0000 UTC m=+10.147093966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret") pod "global-pull-secret-syncer-sv2vz" (UID: "6f72de83-30e7-44bf-aa2e-f506b2358e31") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:19:41.229140 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:41.228634 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:19:41.229140 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:41.228649 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:19:41.229140 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:41.228662 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qhd9t for pod openshift-network-diagnostics/network-check-target-x5wpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:19:41.229140 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:41.228701 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t podName:91ef3c26-f109-4bf9-9b5d-2a5d18e653cf nodeName:}" failed. No retries permitted until 2026-07-09 16:19:45.228689136 +0000 UTC m=+10.147260448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhd9t" (UniqueName: "kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t") pod "network-check-target-x5wpm" (UID: "91ef3c26-f109-4bf9-9b5d-2a5d18e653cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:19:41.229140 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:41.228771 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:19:41.229140 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:41.228803 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs podName:9317c64f-d51f-422c-a451-9e6e408c9a92 nodeName:}" failed. No retries permitted until 2026-07-09 16:19:45.228792117 +0000 UTC m=+10.147363430 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs") pod "network-metrics-daemon-m7dk6" (UID: "9317c64f-d51f-422c-a451-9e6e408c9a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:19:41.760080 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:41.760042 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:41.760261 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:41.760200 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:19:42.758838 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:42.758802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:42.759430 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:42.758937 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:42.759430 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:42.758802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:42.759430 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:42.759367 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:19:43.759695 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:43.759663 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:43.760174 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:43.759783 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:19:43.820648 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:43.819913 2579 generic.go:356] "Generic (PLEG): container finished" podID="05665ae0-dbfa-4fdf-b7f8-223e87d067d2" containerID="19379b69c2eb97c1c33c0b1f25b9c21045eaa53a59ec09429f0a7b0e9d95c6d8" exitCode=0 Jul 09 16:19:43.820648 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:43.819966 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9k6g" event={"ID":"05665ae0-dbfa-4fdf-b7f8-223e87d067d2","Type":"ContainerDied","Data":"19379b69c2eb97c1c33c0b1f25b9c21045eaa53a59ec09429f0a7b0e9d95c6d8"} Jul 09 16:19:44.759682 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:44.759635 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:44.759875 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:44.759767 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:44.759875 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:44.759635 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:44.760329 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:44.759902 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:19:45.264320 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:45.264282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:45.264513 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:45.264349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:45.264513 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:45.264384 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhd9t\" (UniqueName: \"kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t\") pod \"network-check-target-x5wpm\" (UID: \"91ef3c26-f109-4bf9-9b5d-2a5d18e653cf\") " pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:45.264513 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:45.264439 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:19:45.264513 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:45.264497 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:19:45.264513 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:45.264516 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs podName:9317c64f-d51f-422c-a451-9e6e408c9a92 nodeName:}" failed. No retries permitted until 2026-07-09 16:19:53.264496962 +0000 UTC m=+18.183068272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs") pod "network-metrics-daemon-m7dk6" (UID: "9317c64f-d51f-422c-a451-9e6e408c9a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:19:45.264770 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:45.264559 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret podName:6f72de83-30e7-44bf-aa2e-f506b2358e31 nodeName:}" failed. No retries permitted until 2026-07-09 16:19:53.264541924 +0000 UTC m=+18.183113237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret") pod "global-pull-secret-syncer-sv2vz" (UID: "6f72de83-30e7-44bf-aa2e-f506b2358e31") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:19:45.264770 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:45.264504 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:19:45.264770 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:45.264588 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:19:45.264770 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:45.264602 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qhd9t for pod openshift-network-diagnostics/network-check-target-x5wpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:19:45.264770 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:45.264643 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t podName:91ef3c26-f109-4bf9-9b5d-2a5d18e653cf nodeName:}" failed. No retries permitted until 2026-07-09 16:19:53.264633326 +0000 UTC m=+18.183204637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhd9t" (UniqueName: "kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t") pod "network-check-target-x5wpm" (UID: "91ef3c26-f109-4bf9-9b5d-2a5d18e653cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:19:45.760723 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:45.760511 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:45.760723 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:45.760638 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:19:46.760294 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:46.759678 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:46.760294 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:46.759700 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:46.760294 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:46.759897 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:19:46.760294 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:46.759967 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:47.760083 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:47.759608 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:47.760083 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:47.759753 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:19:48.759446 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:48.759415 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:48.759590 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:48.759415 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:48.759590 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:48.759553 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:19:48.759695 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:48.759605 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:49.759538 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:49.759496 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:49.759939 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:49.759648 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:19:50.759669 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:50.759625 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:50.760096 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:50.759642 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:50.760096 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:50.759752 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:50.760096 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:50.759841 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:19:51.761920 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:51.761892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:51.762387 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:51.761892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:51.762387 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:51.762018 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:19:51.762387 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:51.762088 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:52.759288 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:52.759201 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:52.759479 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:52.759323 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:19:53.325644 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:53.325611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhd9t\" (UniqueName: \"kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t\") pod \"network-check-target-x5wpm\" (UID: \"91ef3c26-f109-4bf9-9b5d-2a5d18e653cf\") " pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:53.326105 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:53.325664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:53.326105 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:53.325712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:53.326105 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:53.325790 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:19:53.326105 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:53.325809 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:19:53.326105 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:53.325819 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qhd9t for pod openshift-network-diagnostics/network-check-target-x5wpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:19:53.326105 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:53.325831 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:19:53.326105 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:53.325877 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t podName:91ef3c26-f109-4bf9-9b5d-2a5d18e653cf nodeName:}" failed. No retries permitted until 2026-07-09 16:20:09.325860275 +0000 UTC m=+34.244431606 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhd9t" (UniqueName: "kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t") pod "network-check-target-x5wpm" (UID: "91ef3c26-f109-4bf9-9b5d-2a5d18e653cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:19:53.326105 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:53.325897 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs podName:9317c64f-d51f-422c-a451-9e6e408c9a92 nodeName:}" failed. No retries permitted until 2026-07-09 16:20:09.325887841 +0000 UTC m=+34.244459156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs") pod "network-metrics-daemon-m7dk6" (UID: "9317c64f-d51f-422c-a451-9e6e408c9a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:19:53.326105 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:53.325896 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:19:53.326105 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:53.325940 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret podName:6f72de83-30e7-44bf-aa2e-f506b2358e31 nodeName:}" failed. No retries permitted until 2026-07-09 16:20:09.325929602 +0000 UTC m=+34.244500913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret") pod "global-pull-secret-syncer-sv2vz" (UID: "6f72de83-30e7-44bf-aa2e-f506b2358e31") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:19:53.758941 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:53.758856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:53.759101 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:53.759017 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:53.759101 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:53.759000 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:19:53.759229 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:53.759097 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:54.759115 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:54.759074 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:54.759540 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:54.759202 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:19:55.759871 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:55.759837 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:55.760369 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:55.759941 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:55.760369 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:55.760071 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:55.760369 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:55.760193 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:19:56.759609 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:56.759579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:56.759771 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:56.759680 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:19:57.758928 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:57.758893 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:57.759425 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:57.758898 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:57.759425 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:57.759068 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:19:57.759425 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:57.759137 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:58.759361 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:58.759330 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:19:58.759788 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:58.759441 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:19:59.759507 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.759346 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:19:59.760388 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.759419 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:19:59.760388 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:59.759591 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:19:59.760388 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:19:59.759654 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:19:59.850397 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.850321 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" event={"ID":"c15d8f2f-8a45-42a9-a0c7-05824ad16867","Type":"ContainerStarted","Data":"94d62e4738c734ac5e8029d92ff73582c69fc2de30f4286a006035640ab1200e"} Jul 09 16:19:59.851647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.851621 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rcg8w" event={"ID":"384df07c-6bfc-4b00-b3cd-d2a1fb445456","Type":"ContainerStarted","Data":"303d669e4b161af999d25c78b1b8eff06112c17e5fd116fefc63aa18b58819e3"} Jul 09 16:19:59.854668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.854633 2579 generic.go:356] "Generic (PLEG): container finished" podID="05665ae0-dbfa-4fdf-b7f8-223e87d067d2" containerID="0970f262f5b878cadbe35df3ef4800282883b59146cd6ce3bd8fcec50b37a2bd" exitCode=0 Jul 09 16:19:59.854767 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.854688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9k6g" event={"ID":"05665ae0-dbfa-4fdf-b7f8-223e87d067d2","Type":"ContainerDied","Data":"0970f262f5b878cadbe35df3ef4800282883b59146cd6ce3bd8fcec50b37a2bd"} Jul 09 16:19:59.857991 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.857972 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:19:59.858327 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.858304 2579 generic.go:356] "Generic (PLEG): container finished" podID="e7090715-8cae-4699-9092-38e8bb46ce56" containerID="4dc49060da736959f41af5a9c5dc7664cbe946edae3a6fcd51bdf3a22eb92b8f" exitCode=1 Jul 09 16:19:59.858405 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.858362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" event={"ID":"e7090715-8cae-4699-9092-38e8bb46ce56","Type":"ContainerStarted","Data":"7eb552738a7cb6b7417114dd2a4b8d4e3a072c91040283460da64ace0d1b8344"} Jul 09 16:19:59.858463 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.858424 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" event={"ID":"e7090715-8cae-4699-9092-38e8bb46ce56","Type":"ContainerStarted","Data":"4c41e634af74def2d62061defbda966c17f95f09f94088c88a2c6ae15a1bc92b"} Jul 09 16:19:59.858510 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.858469 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" event={"ID":"e7090715-8cae-4699-9092-38e8bb46ce56","Type":"ContainerStarted","Data":"d401dc5c0f8214591a6630a8c352df593feaae87912d18ef91c1a5b7c38fe893"} Jul 09 16:19:59.858551 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.858514 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" event={"ID":"e7090715-8cae-4699-9092-38e8bb46ce56","Type":"ContainerStarted","Data":"f5a0a8868ba91899e1763b1e465460b3d634867f0ac3b42843e588a7f42bded3"} Jul 09 16:19:59.858551 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.858543 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" event={"ID":"e7090715-8cae-4699-9092-38e8bb46ce56","Type":"ContainerDied","Data":"4dc49060da736959f41af5a9c5dc7664cbe946edae3a6fcd51bdf3a22eb92b8f"} Jul 09 16:19:59.858611 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.858582 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" event={"ID":"e7090715-8cae-4699-9092-38e8bb46ce56","Type":"ContainerStarted","Data":"eabc16bf75cc644a305fecb04e0c23d96cb151284c9858101eb9126d36c50142"} Jul 09 16:19:59.859741 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.859717 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rhv24" event={"ID":"25d1d3b8-87e8-420e-bfe7-e911c28de230","Type":"ContainerStarted","Data":"01efe6cd95dde9adfe6ec65f07ecda4c2ddc2974c3f266bf8d15ecc2eee90a97"} Jul 09 16:19:59.861099 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.861077 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vncrr" event={"ID":"4bc9ab36-d3a5-498c-b475-8ee3766e22ba","Type":"ContainerStarted","Data":"b13464fc708b1cb5894fa8e09b29d7b61869d653a87f20f274a93bc92252e311"} Jul 09 16:19:59.862784 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.862765 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" event={"ID":"ec63ca07b383a4359b0dcb3157d0357a","Type":"ContainerStarted","Data":"ca09a09760dc83598ddca7eb6b4dfb18592779541a151a9bec1b311c18a1146b"} Jul 09 16:19:59.864150 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.864128 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lrlzz" event={"ID":"3b350930-4666-4d3c-a663-d0940d49511e","Type":"ContainerStarted","Data":"571dfcd9f8037cde62f51e2f7aa8d83dbb24c203db1000bf5dce350da2a6b918"} Jul 09 16:19:59.868544 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.868522 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" event={"ID":"f6e6d712-640a-4715-80de-aafc48c77aff","Type":"ContainerStarted","Data":"7110b3c9bed5eecabc6c5e030092782e976cc2e7057cc940568f179731e0c09d"} Jul 09 16:19:59.875821 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.875784 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rcg8w" podStartSLOduration=3.835090686 podStartE2EDuration="24.875773642s" totalImagesPullingTime="21.040682956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:19:59.875234076 +0000 UTC m=+24.793805420" watchObservedRunningTime="2026-07-09 16:19:59.875773642 +0000 UTC m=+24.794344973" Jul 09 16:19:59.932673 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.932639 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5wh4n" podStartSLOduration=5.128168814 podStartE2EDuration="24.932626981s" totalImagesPullingTime="19.804458167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:19:59.917124136 +0000 UTC m=+24.835695466" watchObservedRunningTime="2026-07-09 16:19:59.932626981 +0000 UTC m=+24.851198352" Jul 09 16:19:59.932884 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.932866 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lrlzz" podStartSLOduration=10.277950957 podStartE2EDuration="24.932860583s" totalImagesPullingTime="14.654909626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:19:59.932530406 +0000 UTC m=+24.851101735" watchObservedRunningTime="2026-07-09 16:19:59.932860583 +0000 UTC m=+24.851431914" Jul 09 16:19:59.948577 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.948537 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vncrr" podStartSLOduration=5.142570686 podStartE2EDuration="24.948525764s" totalImagesPullingTime="19.805955078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:19:59.948107821 +0000 UTC m=+24.866679152" watchObservedRunningTime="2026-07-09 16:19:59.948525764 +0000 UTC m=+24.867097093" Jul 09 16:19:59.980900 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.980868 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rhv24" podStartSLOduration=5.179747442 podStartE2EDuration="24.980858403s" totalImagesPullingTime="19.801110961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:19:59.964742548 +0000 UTC m=+24.883313878" watchObservedRunningTime="2026-07-09 16:19:59.980858403 +0000 UTC m=+24.899429735" Jul 09 16:19:59.981161 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:19:59.981141 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-68.ec2.internal" podStartSLOduration=22.981136488 podStartE2EDuration="22.981136488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:19:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:19:59.980837404 +0000 UTC m=+24.899408735" watchObservedRunningTime="2026-07-09 16:19:59.981136488 +0000 UTC m=+24.899707820" Jul 09 16:20:00.759138 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:00.759108 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:00.759388 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:00.759217 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:00.872597 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:00.872560 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5gbfk" event={"ID":"04cb3e55-4854-4cc6-af88-920e1811a6e3","Type":"ContainerStarted","Data":"26f55a9b773d36c1777cc5d7de0fc7fc5a6cb7d31823178022b231031c829a66"} Jul 09 16:20:00.900508 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:00.900459 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5gbfk" podStartSLOduration=6.122589733 podStartE2EDuration="25.900442182s" totalImagesPullingTime="19.777852449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:00.899973085 +0000 UTC m=+25.818544418" watchObservedRunningTime="2026-07-09 16:20:00.900442182 +0000 UTC m=+25.819013513" Jul 09 16:20:01.156217 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:01.156192 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lrlzz" Jul 09 16:20:01.156897 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:01.156877 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lrlzz" Jul 09 16:20:01.608996 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:01.608860 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 16:20:01.759112 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:01.759085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:01.759264 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:01.759085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:01.759567 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:01.759519 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:01.759781 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:01.759753 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:01.876637 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:01.876604 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" event={"ID":"c15d8f2f-8a45-42a9-a0c7-05824ad16867","Type":"ContainerStarted","Data":"60b51c0a0b4439989362e3257f80c97c1f1f90dd754e7c545d4df5c6590ca2ab"} Jul 09 16:20:01.879389 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:01.879370 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:20:01.879697 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:01.879674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" event={"ID":"e7090715-8cae-4699-9092-38e8bb46ce56","Type":"ContainerStarted","Data":"74a5bd2534ad92fd8fd743e27934298727db203a41af76593491d53f67005d9e"} Jul 09 16:20:02.576774 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:02.576645 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T16:20:01.608990323Z","UUID":"cb8fe1b3-2653-421c-946a-d627a70c71b6","Handler":null,"Name":"","Endpoint":""} Jul 09 16:20:02.578203 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:02.578185 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 16:20:02.578319 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:02.578219 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 16:20:02.759512 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:02.759442 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:02.759656 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:02.759543 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:02.884838 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:02.884806 2579 generic.go:356] "Generic (PLEG): container finished" podID="05665ae0-dbfa-4fdf-b7f8-223e87d067d2" containerID="3727dcb86647b4ec5f775eea1fd23196e2d21b43b8540859329cbc4448772621" exitCode=0 Jul 09 16:20:02.885605 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:02.884887 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9k6g" event={"ID":"05665ae0-dbfa-4fdf-b7f8-223e87d067d2","Type":"ContainerDied","Data":"3727dcb86647b4ec5f775eea1fd23196e2d21b43b8540859329cbc4448772621"} Jul 09 16:20:02.885605 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:02.884902 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 16:20:03.759712 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:03.759628 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:03.759858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:03.759628 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:03.759858 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:03.759778 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:03.759938 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:03.759903 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:03.888770 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:03.888636 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" event={"ID":"c15d8f2f-8a45-42a9-a0c7-05824ad16867","Type":"ContainerStarted","Data":"bdfaf0f6f681b89d7a89e6d8ca3ad441059a489584b312c94ceff52fbd0fe12a"} Jul 09 16:20:03.906675 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:03.906633 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8zpq" podStartSLOduration=3.799499526 podStartE2EDuration="28.906614911s" totalImagesPullingTime="25.107115385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:19:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:03.906311493 +0000 UTC m=+28.824882826" watchObservedRunningTime="2026-07-09 16:20:03.906614911 +0000 UTC m=+28.825186244" Jul 09 16:20:04.759623 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:04.759591 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:04.759793 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:04.759696 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:04.893156 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:04.893133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:20:04.893605 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:04.893435 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" event={"ID":"e7090715-8cae-4699-9092-38e8bb46ce56","Type":"ContainerStarted","Data":"e7cc25acd1d4df67f09fe96e9071f7cbc0f14e290275d2a6d27400ae416bee99"} Jul 09 16:20:04.893973 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:04.893958 2579 scope.go:117] "RemoveContainer" containerID="4dc49060da736959f41af5a9c5dc7664cbe946edae3a6fcd51bdf3a22eb92b8f" Jul 09 16:20:05.759569 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:05.759409 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:05.759770 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:05.759492 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:05.759770 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:05.759629 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:05.759770 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:05.759725 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:05.897996 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:05.897964 2579 generic.go:356] "Generic (PLEG): container finished" podID="05665ae0-dbfa-4fdf-b7f8-223e87d067d2" containerID="ab8df3f38755b899715dd3ad3712d7adf0832443467084216b5f2e6954f6a26c" exitCode=0 Jul 09 16:20:05.898435 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:05.898038 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9k6g" event={"ID":"05665ae0-dbfa-4fdf-b7f8-223e87d067d2","Type":"ContainerDied","Data":"ab8df3f38755b899715dd3ad3712d7adf0832443467084216b5f2e6954f6a26c"} Jul 09 16:20:05.901692 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:05.901675 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:20:05.902074 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:05.902054 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" event={"ID":"e7090715-8cae-4699-9092-38e8bb46ce56","Type":"ContainerStarted","Data":"2987d85674a9347b704e2189f0ea59ee1a172ada22c037f37ab57f604ca606d3"} Jul 09 16:20:05.902289 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:05.902273 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:20:05.902361 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:05.902330 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:20:05.902414 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:05.902366 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:20:05.917782 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:05.917759 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:20:05.920558 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:05.920528 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:20:05.949141 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:05.949102 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" podStartSLOduration=9.860693825 podStartE2EDuration="30.949088805s" totalImagesPullingTime="21.08839498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:05.947726348 +0000 UTC m=+30.866297679" watchObservedRunningTime="2026-07-09 16:20:05.949088805 +0000 UTC m=+30.867660118" Jul 09 16:20:06.759595 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:06.759563 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:06.759748 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:06.759663 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:07.694614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:07.694574 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lrlzz" Jul 09 16:20:07.695058 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:07.694692 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 16:20:07.695215 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:07.695198 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lrlzz" Jul 09 16:20:07.759467 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:07.759431 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:07.759621 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:07.759577 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:07.759680 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:07.759628 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:07.759752 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:07.759734 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:08.759667 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:08.759634 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:08.760143 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:08.759761 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:09.346638 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:09.346608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:09.346792 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:09.346651 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:09.346792 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:09.346686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhd9t\" (UniqueName: \"kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t\") pod \"network-check-target-x5wpm\" (UID: \"91ef3c26-f109-4bf9-9b5d-2a5d18e653cf\") " pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:09.346792 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:09.346760 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:20:09.346904 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:09.346791 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:20:09.346904 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:09.346808 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:20:09.346904 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:09.346820 2579 projected.go:196] Error preparing data for projected volume kube-api-access-qhd9t for pod openshift-network-diagnostics/network-check-target-x5wpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:20:09.346904 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:09.346822 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs podName:9317c64f-d51f-422c-a451-9e6e408c9a92 nodeName:}" failed. No retries permitted until 2026-07-09 16:20:41.346802431 +0000 UTC m=+66.265373754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs") pod "network-metrics-daemon-m7dk6" (UID: "9317c64f-d51f-422c-a451-9e6e408c9a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:20:09.346904 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:09.346760 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:20:09.346904 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:09.346852 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t podName:91ef3c26-f109-4bf9-9b5d-2a5d18e653cf nodeName:}" failed. No retries permitted until 2026-07-09 16:20:41.346841929 +0000 UTC m=+66.265413256 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhd9t" (UniqueName: "kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t") pod "network-check-target-x5wpm" (UID: "91ef3c26-f109-4bf9-9b5d-2a5d18e653cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:20:09.346904 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:09.346869 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret podName:6f72de83-30e7-44bf-aa2e-f506b2358e31 nodeName:}" failed. No retries permitted until 2026-07-09 16:20:41.346860393 +0000 UTC m=+66.265431703 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret") pod "global-pull-secret-syncer-sv2vz" (UID: "6f72de83-30e7-44bf-aa2e-f506b2358e31") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:20:09.759602 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:09.759517 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:09.759758 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:09.759695 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:09.759758 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:09.759746 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:09.760160 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:09.759865 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:10.759172 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:10.759132 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:10.759334 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:10.759269 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:11.759528 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:11.759499 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:11.760038 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:11.759610 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:11.760038 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:11.759692 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:11.760038 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:11.759792 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:11.921393 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:11.921309 2579 generic.go:356] "Generic (PLEG): container finished" podID="05665ae0-dbfa-4fdf-b7f8-223e87d067d2" containerID="e5e44a86100c171870a27f6fbabfcbe4e2641bd1f6cbb577321b4456e24efdfd" exitCode=0 Jul 09 16:20:11.921393 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:11.921359 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9k6g" event={"ID":"05665ae0-dbfa-4fdf-b7f8-223e87d067d2","Type":"ContainerDied","Data":"e5e44a86100c171870a27f6fbabfcbe4e2641bd1f6cbb577321b4456e24efdfd"} Jul 09 16:20:12.759374 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:12.759334 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:12.759519 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:12.759435 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:12.926353 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:12.926322 2579 generic.go:356] "Generic (PLEG): container finished" podID="05665ae0-dbfa-4fdf-b7f8-223e87d067d2" containerID="7cc85363339392b9a31a1713b8ddefe431f2073595a1ce332bf685bf3aee1faa" exitCode=0 Jul 09 16:20:12.926771 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:12.926371 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9k6g" event={"ID":"05665ae0-dbfa-4fdf-b7f8-223e87d067d2","Type":"ContainerDied","Data":"7cc85363339392b9a31a1713b8ddefe431f2073595a1ce332bf685bf3aee1faa"} Jul 09 16:20:13.759574 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:13.759535 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:13.759773 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:13.759541 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:13.759773 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:13.759636 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:13.759773 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:13.759718 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:13.931999 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:13.931964 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9k6g" event={"ID":"05665ae0-dbfa-4fdf-b7f8-223e87d067d2","Type":"ContainerStarted","Data":"f31132be55a15d1cefd107014811596a45f0860c0ecae561fe050651cd48e745"} Jul 09 16:20:14.759618 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:14.759584 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:14.759787 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:14.759685 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:15.760418 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:15.760386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:15.760817 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:15.760491 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:15.760817 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:15.760571 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:15.760817 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:15.760666 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:16.759025 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:16.758981 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:16.759192 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:16.759086 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:17.759251 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:17.759218 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:17.759251 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:17.759244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:17.759738 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:17.759327 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:17.759738 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:17.759480 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:18.758859 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:18.758825 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:18.759061 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:18.758956 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:19.759974 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:19.759802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:19.760524 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:19.759867 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:19.760524 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:19.760116 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:19.760524 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:19.760246 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:19.870863 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:19.870792 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r9k6g" podStartSLOduration=17.278476791 podStartE2EDuration="44.87076962s" totalImagesPullingTime="27.592292829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:19:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:13.973655842 +0000 UTC m=+38.892227173" watchObservedRunningTime="2026-07-09 16:20:19.87076962 +0000 UTC m=+44.789340954" Jul 09 16:20:19.871195 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:19.871178 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x5wpm"] Jul 09 16:20:19.874546 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:19.874509 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sv2vz"] Jul 09 16:20:19.874657 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:19.874637 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:19.874767 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:19.874749 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:19.875083 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:19.875064 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m7dk6"] Jul 09 16:20:19.945448 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:19.945314 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:19.945448 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:19.945314 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:19.945448 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:19.945424 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:19.945701 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:19.945490 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:21.758855 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:21.758822 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:21.759288 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:21.758826 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:21.759288 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:21.758922 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:21.759288 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:21.759027 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:21.759288 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:21.759040 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:21.759288 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:21.759110 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:23.759284 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.759199 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:23.759284 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.759219 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:23.759803 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.759199 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:23.759803 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:23.759312 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5wpm" podUID="91ef3c26-f109-4bf9-9b5d-2a5d18e653cf" Jul 09 16:20:23.759803 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:23.759367 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv2vz" podUID="6f72de83-30e7-44bf-aa2e-f506b2358e31" Jul 09 16:20:23.759803 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:23.759455 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7dk6" podUID="9317c64f-d51f-422c-a451-9e6e408c9a92" Jul 09 16:20:23.852523 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.852495 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-68.ec2.internal" event="NodeReady" Jul 09 16:20:23.852684 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.852639 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 16:20:23.885594 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.885566 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54b8dd799c-drkx7"] Jul 09 16:20:23.911869 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.911846 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54b8dd799c-drkx7"] Jul 09 16:20:23.911999 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.911880 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cc55l"] Jul 09 16:20:23.911999 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.911970 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:23.914583 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.914559 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rfjnp\"" Jul 09 16:20:23.914583 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.914577 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 16:20:23.914765 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.914597 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 16:20:23.914765 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.914738 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 16:20:23.919793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.919776 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 16:20:23.935039 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.935002 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vlwd8"] Jul 09 16:20:23.935161 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.935147 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cc55l" Jul 09 16:20:23.938278 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.938257 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lp92w\"" Jul 09 16:20:23.938386 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.938259 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 16:20:23.938386 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.938306 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 16:20:23.938497 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.938395 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 16:20:23.952654 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.952635 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cc55l"] Jul 09 16:20:23.952746 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.952664 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vlwd8"] Jul 09 16:20:23.952746 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.952724 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:23.955513 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.955488 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 16:20:23.955513 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.955491 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 16:20:23.955742 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.955523 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 16:20:23.955742 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.955707 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 16:20:23.955834 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.955818 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8pd94\"" Jul 09 16:20:23.955989 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.955970 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6aed1829-a31e-42b5-abb0-88e805c7a227-registry-tls\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:23.956052 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.956021 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6aed1829-a31e-42b5-abb0-88e805c7a227-registry-certificates\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:23.956115 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.956068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/678c07ab-a5c6-4759-9f6d-84016f2808b6-cert\") pod \"ingress-canary-cc55l\" (UID: \"678c07ab-a5c6-4759-9f6d-84016f2808b6\") " pod="openshift-ingress-canary/ingress-canary-cc55l" Jul 09 16:20:23.956115 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.956098 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gztgz\" (UniqueName: \"kubernetes.io/projected/678c07ab-a5c6-4759-9f6d-84016f2808b6-kube-api-access-gztgz\") pod \"ingress-canary-cc55l\" (UID: \"678c07ab-a5c6-4759-9f6d-84016f2808b6\") " pod="openshift-ingress-canary/ingress-canary-cc55l" Jul 09 16:20:23.956186 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.956131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp6hs\" (UniqueName: \"kubernetes.io/projected/6aed1829-a31e-42b5-abb0-88e805c7a227-kube-api-access-hp6hs\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:23.956241 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.956219 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6aed1829-a31e-42b5-abb0-88e805c7a227-bound-sa-token\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:23.956292 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.956271 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6aed1829-a31e-42b5-abb0-88e805c7a227-trusted-ca\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:23.956341 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.956328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6aed1829-a31e-42b5-abb0-88e805c7a227-ca-trust-extracted\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:23.956395 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.956361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6aed1829-a31e-42b5-abb0-88e805c7a227-installation-pull-secrets\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:23.956444 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:23.956391 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6aed1829-a31e-42b5-abb0-88e805c7a227-image-registry-private-configuration\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.000634 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.000610 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tqcq5"] Jul 09 16:20:24.027753 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.027735 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tqcq5"] Jul 09 16:20:24.027856 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.027823 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.030521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.030506 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 16:20:24.030688 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.030670 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 16:20:24.030760 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.030732 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-466pn\"" Jul 09 16:20:24.057528 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-crio-socket\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.057624 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6aed1829-a31e-42b5-abb0-88e805c7a227-registry-tls\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.057624 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6aed1829-a31e-42b5-abb0-88e805c7a227-registry-certificates\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.057732 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/678c07ab-a5c6-4759-9f6d-84016f2808b6-cert\") pod \"ingress-canary-cc55l\" (UID: \"678c07ab-a5c6-4759-9f6d-84016f2808b6\") " pod="openshift-ingress-canary/ingress-canary-cc55l" Jul 09 16:20:24.057732 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gztgz\" (UniqueName: \"kubernetes.io/projected/678c07ab-a5c6-4759-9f6d-84016f2808b6-kube-api-access-gztgz\") pod \"ingress-canary-cc55l\" (UID: \"678c07ab-a5c6-4759-9f6d-84016f2808b6\") " pod="openshift-ingress-canary/ingress-canary-cc55l" Jul 09 16:20:24.057732 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.057732 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057721 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp6hs\" (UniqueName: \"kubernetes.io/projected/6aed1829-a31e-42b5-abb0-88e805c7a227-kube-api-access-hp6hs\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.057905 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057746 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-data-volume\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.057905 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057770 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.057905 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6aed1829-a31e-42b5-abb0-88e805c7a227-bound-sa-token\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.058052 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0b21e1c-e140-4f27-8883-6c04c6e7041c-tmp-dir\") pod \"dns-default-tqcq5\" (UID: \"b0b21e1c-e140-4f27-8883-6c04c6e7041c\") " pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.058052 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6aed1829-a31e-42b5-abb0-88e805c7a227-trusted-ca\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.058052 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.057985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6s4g\" (UniqueName: \"kubernetes.io/projected/b0b21e1c-e140-4f27-8883-6c04c6e7041c-kube-api-access-g6s4g\") pod \"dns-default-tqcq5\" (UID: \"b0b21e1c-e140-4f27-8883-6c04c6e7041c\") " pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.058052 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.058025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46bhw\" (UniqueName: \"kubernetes.io/projected/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-kube-api-access-46bhw\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.058213 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.058061 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0b21e1c-e140-4f27-8883-6c04c6e7041c-metrics-tls\") pod \"dns-default-tqcq5\" (UID: \"b0b21e1c-e140-4f27-8883-6c04c6e7041c\") " pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.058213 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.058095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6aed1829-a31e-42b5-abb0-88e805c7a227-ca-trust-extracted\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.062324 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.058485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6aed1829-a31e-42b5-abb0-88e805c7a227-installation-pull-secrets\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.062324 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.058598 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6aed1829-a31e-42b5-abb0-88e805c7a227-image-registry-private-configuration\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.062324 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.058890 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6aed1829-a31e-42b5-abb0-88e805c7a227-ca-trust-extracted\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.062324 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.058963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b0b21e1c-e140-4f27-8883-6c04c6e7041c-config-volume\") pod \"dns-default-tqcq5\" (UID: \"b0b21e1c-e140-4f27-8883-6c04c6e7041c\") " pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.062324 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.059030 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6aed1829-a31e-42b5-abb0-88e805c7a227-registry-certificates\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.062324 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.059926 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6aed1829-a31e-42b5-abb0-88e805c7a227-trusted-ca\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.063261 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.062753 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6aed1829-a31e-42b5-abb0-88e805c7a227-image-registry-private-configuration\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.063261 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.062833 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6aed1829-a31e-42b5-abb0-88e805c7a227-registry-tls\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.064084 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.064066 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6aed1829-a31e-42b5-abb0-88e805c7a227-installation-pull-secrets\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.064157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.064139 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/678c07ab-a5c6-4759-9f6d-84016f2808b6-cert\") pod \"ingress-canary-cc55l\" (UID: \"678c07ab-a5c6-4759-9f6d-84016f2808b6\") " pod="openshift-ingress-canary/ingress-canary-cc55l" Jul 09 16:20:24.070858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.070840 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6aed1829-a31e-42b5-abb0-88e805c7a227-bound-sa-token\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.070989 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.070972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gztgz\" (UniqueName: \"kubernetes.io/projected/678c07ab-a5c6-4759-9f6d-84016f2808b6-kube-api-access-gztgz\") pod \"ingress-canary-cc55l\" (UID: \"678c07ab-a5c6-4759-9f6d-84016f2808b6\") " pod="openshift-ingress-canary/ingress-canary-cc55l" Jul 09 16:20:24.074548 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.074529 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp6hs\" (UniqueName: \"kubernetes.io/projected/6aed1829-a31e-42b5-abb0-88e805c7a227-kube-api-access-hp6hs\") pod \"image-registry-54b8dd799c-drkx7\" (UID: \"6aed1829-a31e-42b5-abb0-88e805c7a227\") " pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.160241 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.160205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0b21e1c-e140-4f27-8883-6c04c6e7041c-tmp-dir\") pod \"dns-default-tqcq5\" (UID: \"b0b21e1c-e140-4f27-8883-6c04c6e7041c\") " pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.160401 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.160253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6s4g\" (UniqueName: \"kubernetes.io/projected/b0b21e1c-e140-4f27-8883-6c04c6e7041c-kube-api-access-g6s4g\") pod \"dns-default-tqcq5\" (UID: \"b0b21e1c-e140-4f27-8883-6c04c6e7041c\") " pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.160401 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.160302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46bhw\" (UniqueName: \"kubernetes.io/projected/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-kube-api-access-46bhw\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.160401 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.160351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0b21e1c-e140-4f27-8883-6c04c6e7041c-metrics-tls\") pod \"dns-default-tqcq5\" (UID: \"b0b21e1c-e140-4f27-8883-6c04c6e7041c\") " pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.160401 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.160380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b0b21e1c-e140-4f27-8883-6c04c6e7041c-config-volume\") pod \"dns-default-tqcq5\" (UID: \"b0b21e1c-e140-4f27-8883-6c04c6e7041c\") " pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.160401 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.160399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-crio-socket\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.160730 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.160441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.160730 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.160636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-data-volume\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.160730 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.160702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.160869 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.160769 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-crio-socket\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.160925 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.160897 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0b21e1c-e140-4f27-8883-6c04c6e7041c-tmp-dir\") pod \"dns-default-tqcq5\" (UID: \"b0b21e1c-e140-4f27-8883-6c04c6e7041c\") " pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.161077 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.161055 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-data-volume\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.161198 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.161092 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b0b21e1c-e140-4f27-8883-6c04c6e7041c-config-volume\") pod \"dns-default-tqcq5\" (UID: \"b0b21e1c-e140-4f27-8883-6c04c6e7041c\") " pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.161198 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.161101 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.162728 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.162707 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0b21e1c-e140-4f27-8883-6c04c6e7041c-metrics-tls\") pod \"dns-default-tqcq5\" (UID: \"b0b21e1c-e140-4f27-8883-6c04c6e7041c\") " pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.162842 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.162826 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.168519 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.168499 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6s4g\" (UniqueName: \"kubernetes.io/projected/b0b21e1c-e140-4f27-8883-6c04c6e7041c-kube-api-access-g6s4g\") pod \"dns-default-tqcq5\" (UID: \"b0b21e1c-e140-4f27-8883-6c04c6e7041c\") " pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.168753 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.168737 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46bhw\" (UniqueName: \"kubernetes.io/projected/f3f16d4e-7999-4f39-980f-e2f0d3559b0a-kube-api-access-46bhw\") pod \"insights-runtime-extractor-vlwd8\" (UID: \"f3f16d4e-7999-4f39-980f-e2f0d3559b0a\") " pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.221737 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.221718 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.242959 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.242938 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cc55l" Jul 09 16:20:24.260808 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.260788 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vlwd8" Jul 09 16:20:24.335995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.335821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:24.421636 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.421537 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cc55l"] Jul 09 16:20:24.427763 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:24.427720 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678c07ab_a5c6_4759_9f6d_84016f2808b6.slice/crio-1bfe26b0ee41de7b5801a655d9155f5c6927038f167b77020ec2e4f3268ba450 WatchSource:0}: Error finding container 1bfe26b0ee41de7b5801a655d9155f5c6927038f167b77020ec2e4f3268ba450: Status 404 returned error can't find the container with id 1bfe26b0ee41de7b5801a655d9155f5c6927038f167b77020ec2e4f3268ba450 Jul 09 16:20:24.434719 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.434695 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54b8dd799c-drkx7"] Jul 09 16:20:24.438423 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:24.438397 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aed1829_a31e_42b5_abb0_88e805c7a227.slice/crio-56a9e517b972db81dab5f4a83e1836cd41827e01610910034c2d8c2cac86830a WatchSource:0}: Error finding container 56a9e517b972db81dab5f4a83e1836cd41827e01610910034c2d8c2cac86830a: Status 404 returned error can't find the container with id 56a9e517b972db81dab5f4a83e1836cd41827e01610910034c2d8c2cac86830a Jul 09 16:20:24.452178 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.452157 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vlwd8"] Jul 09 16:20:24.455906 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:24.455877 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f16d4e_7999_4f39_980f_e2f0d3559b0a.slice/crio-fc0b23adfd08cf41eaa669d0ef9beb030a66fa11ca9915cef123c53992ac1bdd WatchSource:0}: Error finding container fc0b23adfd08cf41eaa669d0ef9beb030a66fa11ca9915cef123c53992ac1bdd: Status 404 returned error can't find the container with id fc0b23adfd08cf41eaa669d0ef9beb030a66fa11ca9915cef123c53992ac1bdd Jul 09 16:20:24.492022 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.491978 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tqcq5"] Jul 09 16:20:24.495942 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:24.495917 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b21e1c_e140_4f27_8883_6c04c6e7041c.slice/crio-5fbcc699f0f97cfe72aa887d12442175eb7e382463f37af98ebc81b10128ece4 WatchSource:0}: Error finding container 5fbcc699f0f97cfe72aa887d12442175eb7e382463f37af98ebc81b10128ece4: Status 404 returned error can't find the container with id 5fbcc699f0f97cfe72aa887d12442175eb7e382463f37af98ebc81b10128ece4 Jul 09 16:20:24.959939 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.959857 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cc55l" event={"ID":"678c07ab-a5c6-4759-9f6d-84016f2808b6","Type":"ContainerStarted","Data":"1bfe26b0ee41de7b5801a655d9155f5c6927038f167b77020ec2e4f3268ba450"} Jul 09 16:20:24.961981 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.961956 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlwd8" event={"ID":"f3f16d4e-7999-4f39-980f-e2f0d3559b0a","Type":"ContainerStarted","Data":"fc0b23adfd08cf41eaa669d0ef9beb030a66fa11ca9915cef123c53992ac1bdd"} Jul 09 16:20:24.964321 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.964291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" event={"ID":"6aed1829-a31e-42b5-abb0-88e805c7a227","Type":"ContainerStarted","Data":"c00636aa437e694cb09652a94364a3682a152df60cc29207b7161607a17b4c09"} Jul 09 16:20:24.964431 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.964407 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" event={"ID":"6aed1829-a31e-42b5-abb0-88e805c7a227","Type":"ContainerStarted","Data":"56a9e517b972db81dab5f4a83e1836cd41827e01610910034c2d8c2cac86830a"} Jul 09 16:20:24.964485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.964455 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:24.966381 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.966355 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqcq5" event={"ID":"b0b21e1c-e140-4f27-8883-6c04c6e7041c","Type":"ContainerStarted","Data":"5fbcc699f0f97cfe72aa887d12442175eb7e382463f37af98ebc81b10128ece4"} Jul 09 16:20:24.989416 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:24.988791 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" podStartSLOduration=6.988769543 podStartE2EDuration="6.988769543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:24.987267604 +0000 UTC m=+49.905838934" watchObservedRunningTime="2026-07-09 16:20:24.988769543 +0000 UTC m=+49.907340878" Jul 09 16:20:25.760516 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:25.760486 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:25.760694 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:25.760563 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:25.760849 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:25.760829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:25.763581 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:25.763550 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 16:20:25.764943 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:25.764901 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 16:20:25.765186 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:25.765170 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cg2dj\"" Jul 09 16:20:25.765422 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:25.765404 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q7g2m\"" Jul 09 16:20:25.765648 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:25.765632 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 16:20:25.765822 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:25.765808 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 16:20:29.980658 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:29.980618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cc55l" event={"ID":"678c07ab-a5c6-4759-9f6d-84016f2808b6","Type":"ContainerStarted","Data":"02f4973e0d3938301f59bdd8f7e5b846413fb51b752e4837af088a00fcc694a6"} Jul 09 16:20:29.997511 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:29.997470 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cc55l" podStartSLOduration=1.6388934370000001 podStartE2EDuration="6.997455975s" totalImagesPullingTime="5.358562538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:29.996748527 +0000 UTC m=+54.915319860" watchObservedRunningTime="2026-07-09 16:20:29.997455975 +0000 UTC m=+54.916027308" Jul 09 16:20:30.986347 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:30.986300 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlwd8" event={"ID":"f3f16d4e-7999-4f39-980f-e2f0d3559b0a","Type":"ContainerStarted","Data":"9b9c2b78d209172ad5561e8148c201d072cff66f5cd1a3eba842ba035b2e5f70"} Jul 09 16:20:31.991297 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:31.991254 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlwd8" event={"ID":"f3f16d4e-7999-4f39-980f-e2f0d3559b0a","Type":"ContainerStarted","Data":"c95dd808a19c8d96d095d566049773b994aab3b56dbd944a54404cce36f0eebd"} Jul 09 16:20:31.993174 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:31.993136 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqcq5" event={"ID":"b0b21e1c-e140-4f27-8883-6c04c6e7041c","Type":"ContainerStarted","Data":"b0ad0d88fd69e4f37bed3a1305b7cf8f4308fdc78f6c90fc93135ad0d6fe8053"} Jul 09 16:20:31.993300 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:31.993201 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqcq5" event={"ID":"b0b21e1c-e140-4f27-8883-6c04c6e7041c","Type":"ContainerStarted","Data":"b7efd02e3c6dad601ebca1d82f0dff3022f37fefb271a94474f53df0290211ea"} Jul 09 16:20:31.993365 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:31.993309 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:34.001721 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:34.001681 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlwd8" event={"ID":"f3f16d4e-7999-4f39-980f-e2f0d3559b0a","Type":"ContainerStarted","Data":"72cd85afb909283204d42d094c80310f0e7d2b5d58863b402c33aea499f7f0fb"} Jul 09 16:20:34.022192 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:34.022136 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vlwd8" podStartSLOduration=1.864967654 podStartE2EDuration="11.022120167s" totalImagesPullingTime="9.157152513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:20:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:34.021815553 +0000 UTC m=+58.940386885" watchObservedRunningTime="2026-07-09 16:20:34.022120167 +0000 UTC m=+58.940691499" Jul 09 16:20:34.022683 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:34.022651 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tqcq5" podStartSLOduration=4.625977403 podStartE2EDuration="11.022640352s" totalImagesPullingTime="6.396662949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:32.017686443 +0000 UTC m=+56.936257793" watchObservedRunningTime="2026-07-09 16:20:34.022640352 +0000 UTC m=+58.941211725" Jul 09 16:20:35.657120 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.657090 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dbb9f59dc-tsgzj"] Jul 09 16:20:35.659363 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.659347 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.662398 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.662373 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 16:20:35.662530 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.662380 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 16:20:35.662934 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.662918 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 16:20:35.663024 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.662942 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 16:20:35.663912 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.663896 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 16:20:35.665080 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.665058 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tpmbb\"" Jul 09 16:20:35.665185 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.665097 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 16:20:35.665895 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.665563 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 16:20:35.669415 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.669394 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 16:20:35.671367 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.671347 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dbb9f59dc-tsgzj"] Jul 09 16:20:35.756158 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.756132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-trusted-ca-bundle\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.756315 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.756190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21c05ef7-9101-497b-ad43-bf85b28159aa-console-oauth-config\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.756315 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.756210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7tcv\" (UniqueName: \"kubernetes.io/projected/21c05ef7-9101-497b-ad43-bf85b28159aa-kube-api-access-h7tcv\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.756315 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.756238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21c05ef7-9101-497b-ad43-bf85b28159aa-console-serving-cert\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.756315 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.756278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-service-ca\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.756315 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.756301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-console-config\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.756474 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.756316 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-oauth-serving-cert\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.857139 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.857106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-service-ca\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.857139 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.857142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-console-config\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.857364 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.857160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-oauth-serving-cert\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.857364 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.857198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-trusted-ca-bundle\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.857364 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.857229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21c05ef7-9101-497b-ad43-bf85b28159aa-console-oauth-config\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.857364 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.857246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7tcv\" (UniqueName: \"kubernetes.io/projected/21c05ef7-9101-497b-ad43-bf85b28159aa-kube-api-access-h7tcv\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.857364 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.857264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21c05ef7-9101-497b-ad43-bf85b28159aa-console-serving-cert\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.857932 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.857905 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-console-config\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.858066 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.857970 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-oauth-serving-cert\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.858066 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.858038 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-service-ca\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.858171 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.858156 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-trusted-ca-bundle\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.860902 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.860875 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21c05ef7-9101-497b-ad43-bf85b28159aa-console-serving-cert\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.860902 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.860892 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21c05ef7-9101-497b-ad43-bf85b28159aa-console-oauth-config\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.866410 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.866387 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7tcv\" (UniqueName: \"kubernetes.io/projected/21c05ef7-9101-497b-ad43-bf85b28159aa-kube-api-access-h7tcv\") pod \"console-7dbb9f59dc-tsgzj\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:35.969088 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:35.968995 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:36.088780 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:36.088759 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dbb9f59dc-tsgzj"] Jul 09 16:20:36.091101 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:36.091061 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c05ef7_9101_497b_ad43_bf85b28159aa.slice/crio-6d223a65d87dd1b5df2d1dae7ff4750a9dfddf4e3722420d05f9b04abb07b320 WatchSource:0}: Error finding container 6d223a65d87dd1b5df2d1dae7ff4750a9dfddf4e3722420d05f9b04abb07b320: Status 404 returned error can't find the container with id 6d223a65d87dd1b5df2d1dae7ff4750a9dfddf4e3722420d05f9b04abb07b320 Jul 09 16:20:37.016610 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:37.016572 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbb9f59dc-tsgzj" event={"ID":"21c05ef7-9101-497b-ad43-bf85b28159aa","Type":"ContainerStarted","Data":"6d223a65d87dd1b5df2d1dae7ff4750a9dfddf4e3722420d05f9b04abb07b320"} Jul 09 16:20:37.917830 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:37.917806 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2gz42" Jul 09 16:20:40.027612 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:40.027581 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbb9f59dc-tsgzj" event={"ID":"21c05ef7-9101-497b-ad43-bf85b28159aa","Type":"ContainerStarted","Data":"3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd"} Jul 09 16:20:40.046673 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:40.046618 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dbb9f59dc-tsgzj" podStartSLOduration=1.81930464 podStartE2EDuration="5.046601966s" totalImagesPullingTime="3.227297326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:40.045782292 +0000 UTC m=+64.964353624" watchObservedRunningTime="2026-07-09 16:20:40.046601966 +0000 UTC m=+64.965173374" Jul 09 16:20:41.108228 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.108197 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-42bpb"] Jul 09 16:20:41.111361 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.111340 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.113672 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.113655 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 16:20:41.114124 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.114106 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 16:20:41.114867 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.114850 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 16:20:41.114957 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.114923 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 16:20:41.114957 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.114932 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 16:20:41.114957 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.114951 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pds72\"" Jul 09 16:20:41.119444 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.115890 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 16:20:41.125103 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.125082 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-42bpb"] Jul 09 16:20:41.127909 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.127891 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pfq4v"] Jul 09 16:20:41.130795 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.130780 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.133250 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.133221 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 16:20:41.133414 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.133389 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 16:20:41.133491 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.133442 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 16:20:41.133540 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.133448 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tv8r2\"" Jul 09 16:20:41.198236 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.198415 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198251 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-tls\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.198415 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtxjs\" (UniqueName: \"kubernetes.io/projected/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-kube-api-access-mtxjs\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.198415 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.198415 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-metrics-client-ca\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.198415 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-textfile\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.198415 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.198607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b42ae1-d084-4f97-bbab-358e8aa27134-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.198607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/70b42ae1-d084-4f97-bbab-358e8aa27134-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.198607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198473 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtss6\" (UniqueName: \"kubernetes.io/projected/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-api-access-jtss6\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.198607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-root\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.198607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198540 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.198607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198580 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.198607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-wtmp\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.198825 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.198618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-sys\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.299545 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.299545 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-wtmp\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.299747 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-sys\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.299747 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-sys\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.299747 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.299747 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-tls\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.299747 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299690 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-wtmp\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.299747 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtxjs\" (UniqueName: \"kubernetes.io/projected/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-kube-api-access-mtxjs\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.299747 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299724 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.300209 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:41.299794 2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 16:20:41.300209 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:41.299852 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-state-metrics-tls podName:70b42ae1-d084-4f97-bbab-358e8aa27134 nodeName:}" failed. No retries permitted until 2026-07-09 16:20:41.799834652 +0000 UTC m=+66.718405963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-42bpb" (UID: "70b42ae1-d084-4f97-bbab-358e8aa27134") : secret "kube-state-metrics-tls" not found Jul 09 16:20:41.300209 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-metrics-client-ca\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.300209 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-textfile\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.300209 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.300209 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b42ae1-d084-4f97-bbab-358e8aa27134-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.300209 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.299996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/70b42ae1-d084-4f97-bbab-358e8aa27134-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.300209 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.300055 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtss6\" (UniqueName: \"kubernetes.io/projected/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-api-access-jtss6\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.300209 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.300094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-root\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.300670 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.300348 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.300670 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.300378 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-root\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.300670 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.300415 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.300670 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.300474 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-textfile\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.300670 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.300477 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-metrics-client-ca\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.300905 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.300808 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/70b42ae1-d084-4f97-bbab-358e8aa27134-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.300905 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.300887 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b42ae1-d084-4f97-bbab-358e8aa27134-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.300975 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.300917 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.302160 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.302138 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.302525 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.302509 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-tls\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.302676 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.302661 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.310487 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.310455 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtss6\" (UniqueName: \"kubernetes.io/projected/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-api-access-jtss6\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.311381 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.311364 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtxjs\" (UniqueName: \"kubernetes.io/projected/70301ea1-d4b9-4b8e-998e-e11fb2f494ce-kube-api-access-mtxjs\") pod \"node-exporter-pfq4v\" (UID: \"70301ea1-d4b9-4b8e-998e-e11fb2f494ce\") " pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.401720 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.401639 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhd9t\" (UniqueName: \"kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t\") pod \"network-check-target-x5wpm\" (UID: \"91ef3c26-f109-4bf9-9b5d-2a5d18e653cf\") " pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:41.401720 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.401692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:41.401720 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.401714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:41.404352 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.404331 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 16:20:41.404447 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.404388 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 16:20:41.404447 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.404410 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 16:20:41.414513 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.414493 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f72de83-30e7-44bf-aa2e-f506b2358e31-original-pull-secret\") pod \"global-pull-secret-syncer-sv2vz\" (UID: \"6f72de83-30e7-44bf-aa2e-f506b2358e31\") " pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:41.414609 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.414495 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9317c64f-d51f-422c-a451-9e6e408c9a92-metrics-certs\") pod \"network-metrics-daemon-m7dk6\" (UID: \"9317c64f-d51f-422c-a451-9e6e408c9a92\") " pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:41.414784 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.414768 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 16:20:41.424794 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.424761 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhd9t\" (UniqueName: \"kubernetes.io/projected/91ef3c26-f109-4bf9-9b5d-2a5d18e653cf-kube-api-access-qhd9t\") pod \"network-check-target-x5wpm\" (UID: \"91ef3c26-f109-4bf9-9b5d-2a5d18e653cf\") " pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:41.439737 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.439721 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfq4v" Jul 09 16:20:41.450315 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:41.450296 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70301ea1_d4b9_4b8e_998e_e11fb2f494ce.slice/crio-daf19dbe6e279f36e476f91f121d92d12fd85b05eaca3393a2a804de22ae59c9 WatchSource:0}: Error finding container daf19dbe6e279f36e476f91f121d92d12fd85b05eaca3393a2a804de22ae59c9: Status 404 returned error can't find the container with id daf19dbe6e279f36e476f91f121d92d12fd85b05eaca3393a2a804de22ae59c9 Jul 09 16:20:41.677983 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.677909 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cg2dj\"" Jul 09 16:20:41.683968 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.683951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv2vz" Jul 09 16:20:41.685549 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.685532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:41.693105 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.693084 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q7g2m\"" Jul 09 16:20:41.701298 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.701272 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7dk6" Jul 09 16:20:41.804711 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.804636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.807236 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.807206 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/70b42ae1-d084-4f97-bbab-358e8aa27134-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-42bpb\" (UID: \"70b42ae1-d084-4f97-bbab-358e8aa27134\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:41.826930 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.826837 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x5wpm"] Jul 09 16:20:41.829286 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:41.829263 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ef3c26_f109_4bf9_9b5d_2a5d18e653cf.slice/crio-6a727bffc9a0c7832822dc301df8a4acb9091dafec72fab2129fb8410a72711b WatchSource:0}: Error finding container 6a727bffc9a0c7832822dc301df8a4acb9091dafec72fab2129fb8410a72711b: Status 404 returned error can't find the container with id 6a727bffc9a0c7832822dc301df8a4acb9091dafec72fab2129fb8410a72711b Jul 09 16:20:41.847660 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.847633 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sv2vz"] Jul 09 16:20:41.851800 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:41.851102 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f72de83_30e7_44bf_aa2e_f506b2358e31.slice/crio-912f8b437b5d06c773af4bc2febf25d2478220ed527f7fb7db28b43d506f5804 WatchSource:0}: Error finding container 912f8b437b5d06c773af4bc2febf25d2478220ed527f7fb7db28b43d506f5804: Status 404 returned error can't find the container with id 912f8b437b5d06c773af4bc2febf25d2478220ed527f7fb7db28b43d506f5804 Jul 09 16:20:41.859932 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.859907 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m7dk6"] Jul 09 16:20:41.862157 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:41.862137 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9317c64f_d51f_422c_a451_9e6e408c9a92.slice/crio-5b5a5b5fce62640cde1421baf8488f63088b1767192281a270bbcbe86537961b WatchSource:0}: Error finding container 5b5a5b5fce62640cde1421baf8488f63088b1767192281a270bbcbe86537961b: Status 404 returned error can't find the container with id 5b5a5b5fce62640cde1421baf8488f63088b1767192281a270bbcbe86537961b Jul 09 16:20:41.999873 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:41.999800 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tqcq5" Jul 09 16:20:42.022101 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.022073 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" Jul 09 16:20:42.035320 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.035289 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m7dk6" event={"ID":"9317c64f-d51f-422c-a451-9e6e408c9a92","Type":"ContainerStarted","Data":"5b5a5b5fce62640cde1421baf8488f63088b1767192281a270bbcbe86537961b"} Jul 09 16:20:42.036461 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.036437 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sv2vz" event={"ID":"6f72de83-30e7-44bf-aa2e-f506b2358e31","Type":"ContainerStarted","Data":"912f8b437b5d06c773af4bc2febf25d2478220ed527f7fb7db28b43d506f5804"} Jul 09 16:20:42.037737 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.037713 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x5wpm" event={"ID":"91ef3c26-f109-4bf9-9b5d-2a5d18e653cf","Type":"ContainerStarted","Data":"6a727bffc9a0c7832822dc301df8a4acb9091dafec72fab2129fb8410a72711b"} Jul 09 16:20:42.038890 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.038867 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfq4v" event={"ID":"70301ea1-d4b9-4b8e-998e-e11fb2f494ce","Type":"ContainerStarted","Data":"daf19dbe6e279f36e476f91f121d92d12fd85b05eaca3393a2a804de22ae59c9"} Jul 09 16:20:42.161424 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.161391 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-42bpb"] Jul 09 16:20:42.164212 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:42.164184 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b42ae1_d084_4f97_bbab_358e8aa27134.slice/crio-c6e084e69d9bd309bee9bc07724416c51983a80de8451a75fdc0ada5b5a28bfd WatchSource:0}: Error finding container c6e084e69d9bd309bee9bc07724416c51983a80de8451a75fdc0ada5b5a28bfd: Status 404 returned error can't find the container with id c6e084e69d9bd309bee9bc07724416c51983a80de8451a75fdc0ada5b5a28bfd Jul 09 16:20:42.183440 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.183415 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:20:42.188032 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.187998 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.190426 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.190397 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 16:20:42.190540 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.190454 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 16:20:42.190540 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.190462 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 16:20:42.190705 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.190462 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 16:20:42.190850 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.190832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gcf45\"" Jul 09 16:20:42.190947 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.190872 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 16:20:42.190947 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.190916 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 16:20:42.191181 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.191163 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 16:20:42.191277 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.191212 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 16:20:42.191487 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.191467 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 16:20:42.205329 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.205305 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:20:42.308812 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.308784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38051319-c18b-4e6f-be81-863c347b68e5-config-out\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.308993 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.308820 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-web-config\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.308993 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.308837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38051319-c18b-4e6f-be81-863c347b68e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.308993 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.308854 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38051319-c18b-4e6f-be81-863c347b68e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.308993 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.308886 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.309213 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.308992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.309213 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.309039 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.309213 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.309058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38051319-c18b-4e6f-be81-863c347b68e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.309213 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.309086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.309213 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.309109 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhwtq\" (UniqueName: \"kubernetes.io/projected/38051319-c18b-4e6f-be81-863c347b68e5-kube-api-access-nhwtq\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.309213 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.309190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.309213 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.309210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.309545 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.309241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38051319-c18b-4e6f-be81-863c347b68e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.409691 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.409655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38051319-c18b-4e6f-be81-863c347b68e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.409869 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.409727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38051319-c18b-4e6f-be81-863c347b68e5-config-out\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.409869 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.409772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-web-config\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.409869 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.409799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38051319-c18b-4e6f-be81-863c347b68e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.410078 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.409934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38051319-c18b-4e6f-be81-863c347b68e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.410078 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.409996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.410078 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.410045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.410078 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.410070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.410281 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.410095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38051319-c18b-4e6f-be81-863c347b68e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.410281 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.410133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.410281 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.410157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhwtq\" (UniqueName: \"kubernetes.io/projected/38051319-c18b-4e6f-be81-863c347b68e5-kube-api-access-nhwtq\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.410281 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.410188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.411318 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.410629 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38051319-c18b-4e6f-be81-863c347b68e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.411318 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.410629 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38051319-c18b-4e6f-be81-863c347b68e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.411318 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:42.410726 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 09 16:20:42.411318 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:20:42.410784 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-main-tls podName:38051319-c18b-4e6f-be81-863c347b68e5 nodeName:}" failed. No retries permitted until 2026-07-09 16:20:42.910763333 +0000 UTC m=+67.829334646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "38051319-c18b-4e6f-be81-863c347b68e5") : secret "alertmanager-main-tls" not found Jul 09 16:20:42.411318 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.411253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.411318 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.411270 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38051319-c18b-4e6f-be81-863c347b68e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.413343 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.413315 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-web-config\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.414806 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.414750 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38051319-c18b-4e6f-be81-863c347b68e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.416513 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.416455 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.416632 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.416608 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.416917 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.416871 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.417085 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.417063 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.417484 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.417441 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38051319-c18b-4e6f-be81-863c347b68e5-config-out\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.417581 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.417485 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.422177 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.422138 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhwtq\" (UniqueName: \"kubernetes.io/projected/38051319-c18b-4e6f-be81-863c347b68e5-kube-api-access-nhwtq\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.917191 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.917109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:42.920146 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:42.920117 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:43.044908 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:43.044835 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" event={"ID":"70b42ae1-d084-4f97-bbab-358e8aa27134","Type":"ContainerStarted","Data":"c6e084e69d9bd309bee9bc07724416c51983a80de8451a75fdc0ada5b5a28bfd"} Jul 09 16:20:43.046886 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:43.046851 2579 generic.go:356] "Generic (PLEG): container finished" podID="70301ea1-d4b9-4b8e-998e-e11fb2f494ce" containerID="710cfef8296983b2ce1b1bbf749baab3b0e2261e0048f2117b2bcaeb5cd8f62c" exitCode=0 Jul 09 16:20:43.047040 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:43.046947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfq4v" event={"ID":"70301ea1-d4b9-4b8e-998e-e11fb2f494ce","Type":"ContainerDied","Data":"710cfef8296983b2ce1b1bbf749baab3b0e2261e0048f2117b2bcaeb5cd8f62c"} Jul 09 16:20:43.098959 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:43.098931 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:20:43.259468 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:43.259337 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:20:43.661937 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:43.661900 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38051319_c18b_4e6f_be81_863c347b68e5.slice/crio-89c3915e209e786b8f233055135d1a80950008c9d583689b85dcb522ba2f35b1 WatchSource:0}: Error finding container 89c3915e209e786b8f233055135d1a80950008c9d583689b85dcb522ba2f35b1: Status 404 returned error can't find the container with id 89c3915e209e786b8f233055135d1a80950008c9d583689b85dcb522ba2f35b1 Jul 09 16:20:44.053029 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:44.052975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerStarted","Data":"89c3915e209e786b8f233055135d1a80950008c9d583689b85dcb522ba2f35b1"} Jul 09 16:20:44.055948 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:44.055921 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfq4v" event={"ID":"70301ea1-d4b9-4b8e-998e-e11fb2f494ce","Type":"ContainerStarted","Data":"d2aa7610eb396fc7ba01683abfd9f6939e1d5e170538b28450b84de9410e2489"} Jul 09 16:20:44.056101 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:44.055976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfq4v" event={"ID":"70301ea1-d4b9-4b8e-998e-e11fb2f494ce","Type":"ContainerStarted","Data":"344263ca570f25e71ddcabf0c402df18db994ccda071060c3111670edfe5545b"} Jul 09 16:20:44.085363 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:44.085317 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pfq4v" podStartSLOduration=1.856415588 podStartE2EDuration="3.085300305s" totalImagesPullingTime="1.144339563s" totalInitContainerRuntime="84.545154ms" isStatefulPod=true podCreationTimestamp="2026-07-09 16:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:44.0841203 +0000 UTC m=+69.002691634" watchObservedRunningTime="2026-07-09 16:20:44.085300305 +0000 UTC m=+69.003871639" Jul 09 16:20:45.061893 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.061808 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" event={"ID":"70b42ae1-d084-4f97-bbab-358e8aa27134","Type":"ContainerStarted","Data":"54a6e6ad2ea04365a74b484c18af34cd3403068af02524dfdd69b40388a87fa2"} Jul 09 16:20:45.411105 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.411062 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-56d45c967f-7kkf9"] Jul 09 16:20:45.414318 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.414293 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.417472 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.417443 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 16:20:45.418425 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.418404 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 16:20:45.418531 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.418435 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 16:20:45.420572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.418729 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8bl9q\"" Jul 09 16:20:45.420572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.418992 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 16:20:45.420572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.419238 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1pmv2meddno59\"" Jul 09 16:20:45.424271 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.424246 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56d45c967f-7kkf9"] Jul 09 16:20:45.543992 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.543958 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8f1d296-10ea-49da-b87f-1d3c86ed2001-client-ca-bundle\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.544202 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.544035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f8f1d296-10ea-49da-b87f-1d3c86ed2001-metrics-server-audit-profiles\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.544202 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.544122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f8f1d296-10ea-49da-b87f-1d3c86ed2001-secret-metrics-server-client-certs\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.544202 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.544155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f8f1d296-10ea-49da-b87f-1d3c86ed2001-secret-metrics-server-tls\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.544202 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.544184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8f1d296-10ea-49da-b87f-1d3c86ed2001-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.544436 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.544242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f8f1d296-10ea-49da-b87f-1d3c86ed2001-audit-log\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.544436 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.544342 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp8jc\" (UniqueName: \"kubernetes.io/projected/f8f1d296-10ea-49da-b87f-1d3c86ed2001-kube-api-access-rp8jc\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.645773 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.645736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f8f1d296-10ea-49da-b87f-1d3c86ed2001-secret-metrics-server-client-certs\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.645912 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.645785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f8f1d296-10ea-49da-b87f-1d3c86ed2001-secret-metrics-server-tls\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.645912 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.645813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8f1d296-10ea-49da-b87f-1d3c86ed2001-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.646753 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.646177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f8f1d296-10ea-49da-b87f-1d3c86ed2001-audit-log\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.646753 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.646238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp8jc\" (UniqueName: \"kubernetes.io/projected/f8f1d296-10ea-49da-b87f-1d3c86ed2001-kube-api-access-rp8jc\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.646753 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.646283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8f1d296-10ea-49da-b87f-1d3c86ed2001-client-ca-bundle\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.646753 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.646344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f8f1d296-10ea-49da-b87f-1d3c86ed2001-metrics-server-audit-profiles\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.646753 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.646640 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8f1d296-10ea-49da-b87f-1d3c86ed2001-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.646753 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.646708 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f8f1d296-10ea-49da-b87f-1d3c86ed2001-audit-log\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.647461 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.647387 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f8f1d296-10ea-49da-b87f-1d3c86ed2001-metrics-server-audit-profiles\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.648887 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.648863 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f8f1d296-10ea-49da-b87f-1d3c86ed2001-secret-metrics-server-tls\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.649335 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.649314 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8f1d296-10ea-49da-b87f-1d3c86ed2001-client-ca-bundle\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.650405 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.650318 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f8f1d296-10ea-49da-b87f-1d3c86ed2001-secret-metrics-server-client-certs\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.655994 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.655973 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp8jc\" (UniqueName: \"kubernetes.io/projected/f8f1d296-10ea-49da-b87f-1d3c86ed2001-kube-api-access-rp8jc\") pod \"metrics-server-56d45c967f-7kkf9\" (UID: \"f8f1d296-10ea-49da-b87f-1d3c86ed2001\") " pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.729561 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.729532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:20:45.970542 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.969753 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:45.970615 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.970599 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:45.981389 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.979772 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:45.983205 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:45.982577 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54b8dd799c-drkx7" Jul 09 16:20:46.045045 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:46.043566 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56d45c967f-7kkf9"] Jul 09 16:20:46.049505 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:46.049369 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f1d296_10ea_49da_b87f_1d3c86ed2001.slice/crio-2bd65d068e52c0e05c9a9dd1cb1782508fdcac55624136c181642e4d4b78eb8c WatchSource:0}: Error finding container 2bd65d068e52c0e05c9a9dd1cb1782508fdcac55624136c181642e4d4b78eb8c: Status 404 returned error can't find the container with id 2bd65d068e52c0e05c9a9dd1cb1782508fdcac55624136c181642e4d4b78eb8c Jul 09 16:20:46.077856 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:46.077806 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerStarted","Data":"d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973"} Jul 09 16:20:46.083422 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:46.083388 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" event={"ID":"70b42ae1-d084-4f97-bbab-358e8aa27134","Type":"ContainerStarted","Data":"019486aa1115da078bdc52e38c2b633cb5d0f17b6ffe0a8bd2efdee0bcb1d9c7"} Jul 09 16:20:46.083505 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:46.083490 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" event={"ID":"70b42ae1-d084-4f97-bbab-358e8aa27134","Type":"ContainerStarted","Data":"d7a496b32b67d2dd75b713ae251eff3a2d696ea24c8d1afd156d416b7916227f"} Jul 09 16:20:46.089434 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:46.088602 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x5wpm" event={"ID":"91ef3c26-f109-4bf9-9b5d-2a5d18e653cf","Type":"ContainerStarted","Data":"89616fc501323d795d3cefcd80802ca70ee083bd7e6db20b5479470f87642821"} Jul 09 16:20:46.089434 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:46.089095 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:20:46.091179 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:46.090988 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" event={"ID":"f8f1d296-10ea-49da-b87f-1d3c86ed2001","Type":"ContainerStarted","Data":"2bd65d068e52c0e05c9a9dd1cb1782508fdcac55624136c181642e4d4b78eb8c"} Jul 09 16:20:46.094521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:46.094324 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m7dk6" event={"ID":"9317c64f-d51f-422c-a451-9e6e408c9a92","Type":"ContainerStarted","Data":"237bc709a087045c9a9ef754872f596fbacc78d9fad6559ce86e2cc3e39ab965"} Jul 09 16:20:46.101992 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:46.101968 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:20:46.133261 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:46.133179 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-42bpb" podStartSLOduration=3.224120295 podStartE2EDuration="5.13316246s" totalImagesPullingTime="1.909042165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:46.131597674 +0000 UTC m=+71.050169007" watchObservedRunningTime="2026-07-09 16:20:46.13316246 +0000 UTC m=+71.051733791" Jul 09 16:20:46.148572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:46.148524 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x5wpm" podStartSLOduration=67.108928203 podStartE2EDuration="1m11.148508769s" totalImagesPullingTime="4.039580566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:46.147991026 +0000 UTC m=+71.066562359" watchObservedRunningTime="2026-07-09 16:20:46.148508769 +0000 UTC m=+71.067080079" Jul 09 16:20:47.099876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.099837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m7dk6" event={"ID":"9317c64f-d51f-422c-a451-9e6e408c9a92","Type":"ContainerStarted","Data":"51f9b37e4eb5724c026757a55bb1b15fc3b7777e45c983c778fc8329cef76a94"} Jul 09 16:20:47.101666 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.101631 2579 generic.go:356] "Generic (PLEG): container finished" podID="38051319-c18b-4e6f-be81-863c347b68e5" containerID="d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973" exitCode=0 Jul 09 16:20:47.101807 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.101699 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerDied","Data":"d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973"} Jul 09 16:20:47.116148 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.116092 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m7dk6" podStartSLOduration=68.108830095 podStartE2EDuration="1m12.116073119s" totalImagesPullingTime="4.007243024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:47.115626499 +0000 UTC m=+72.034197832" watchObservedRunningTime="2026-07-09 16:20:47.116073119 +0000 UTC m=+72.034644452" Jul 09 16:20:47.432115 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.432035 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:20:47.437086 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.437064 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.442466 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.442440 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 16:20:47.442466 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.442461 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 16:20:47.442644 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.442480 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 16:20:47.442644 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.442627 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 16:20:47.443035 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.442966 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 16:20:47.443167 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.443105 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 16:20:47.443275 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.443170 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 16:20:47.443275 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.443254 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 16:20:47.443416 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.443338 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 16:20:47.443495 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.443440 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 16:20:47.443495 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.443479 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hhczj\"" Jul 09 16:20:47.443621 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.443511 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a1ck6o9lsa15l\"" Jul 09 16:20:47.443894 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.443876 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 16:20:47.444372 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.444353 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 16:20:47.446072 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.445881 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 16:20:47.450278 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.450259 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 16:20:47.465794 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.465741 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:20:47.564992 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.564960 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.564992 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.564992 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565303 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565303 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-config-out\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565303 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565303 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565303 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565303 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565303 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-config\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565303 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565295 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565548 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565316 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565548 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565340 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565548 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565548 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565548 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565548 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565548 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-web-config\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565548 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565545 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvns5\" (UniqueName: \"kubernetes.io/projected/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-kube-api-access-tvns5\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.565773 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.565562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666207 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666178 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666305 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666305 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-config\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666404 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666456 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666505 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666505 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666493 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666626 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666626 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666626 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666763 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-web-config\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666763 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvns5\" (UniqueName: \"kubernetes.io/projected/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-kube-api-access-tvns5\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666763 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666763 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666945 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666767 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666945 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666945 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666945 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-config-out\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666945 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666886 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.666945 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.666911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.667267 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.667163 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.667322 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.667283 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.668799 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.667645 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.668799 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.668118 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.668799 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.668551 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.669520 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.669500 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-config\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.671489 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.669690 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.671591 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.669715 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.671681 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.669838 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.671768 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.669982 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.671864 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.670301 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.671963 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.670459 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.671963 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.671305 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-config-out\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.672160 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.671367 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.672160 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.671717 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-web-config\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.672771 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.672746 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.672852 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.672825 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.672892 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.672866 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.672966 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.672945 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.677991 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.677965 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvns5\" (UniqueName: \"kubernetes.io/projected/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-kube-api-access-tvns5\") pod \"prometheus-k8s-0\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.750609 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.750551 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:47.940256 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:47.940201 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:20:47.944999 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:20:47.944956 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69e8fcf_ebd0_44af_98fc_74e3fba4fb43.slice/crio-fa583336877bda758b1ee815903471700d3c5eed52811d3a6dac7f5e46a0d1c2 WatchSource:0}: Error finding container fa583336877bda758b1ee815903471700d3c5eed52811d3a6dac7f5e46a0d1c2: Status 404 returned error can't find the container with id fa583336877bda758b1ee815903471700d3c5eed52811d3a6dac7f5e46a0d1c2 Jul 09 16:20:48.109541 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:48.109472 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sv2vz" event={"ID":"6f72de83-30e7-44bf-aa2e-f506b2358e31","Type":"ContainerStarted","Data":"ffd80d06afe65c453d4848e1441f731160c6d0c3ec8624ad2362e950116d8b92"} Jul 09 16:20:48.111480 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:48.111453 2579 generic.go:356] "Generic (PLEG): container finished" podID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerID="d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038" exitCode=0 Jul 09 16:20:48.111621 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:48.111556 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerDied","Data":"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038"} Jul 09 16:20:48.111680 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:48.111623 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerStarted","Data":"fa583336877bda758b1ee815903471700d3c5eed52811d3a6dac7f5e46a0d1c2"} Jul 09 16:20:48.127466 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:48.127427 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sv2vz" podStartSLOduration=67.363707474 podStartE2EDuration="1m13.127414381s" totalImagesPullingTime="5.763706907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:48.1252922 +0000 UTC m=+73.043863544" watchObservedRunningTime="2026-07-09 16:20:48.127414381 +0000 UTC m=+73.045985691" Jul 09 16:20:49.122762 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:49.122534 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerStarted","Data":"479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747"} Jul 09 16:20:49.125227 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:49.125191 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" event={"ID":"f8f1d296-10ea-49da-b87f-1d3c86ed2001","Type":"ContainerStarted","Data":"c3840784c67a2ac7c64ceefa0c42ddcef8f3681a4fbbb82b4d10c2a367850c3e"} Jul 09 16:20:49.164590 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:49.164505 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" podStartSLOduration=1.222669171 podStartE2EDuration="4.164482652s" totalImagesPullingTime="2.941813481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:49.162826444 +0000 UTC m=+74.081397779" watchObservedRunningTime="2026-07-09 16:20:49.164482652 +0000 UTC m=+74.083053996" Jul 09 16:20:50.135177 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:50.135108 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerStarted","Data":"7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0"} Jul 09 16:20:50.135610 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:50.135189 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerStarted","Data":"1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a"} Jul 09 16:20:50.135610 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:50.135229 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerStarted","Data":"f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a"} Jul 09 16:20:50.135610 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:50.135269 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerStarted","Data":"4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133"} Jul 09 16:20:50.135610 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:50.135313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerStarted","Data":"da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6"} Jul 09 16:20:50.165435 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:50.165368 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.263377085 podStartE2EDuration="8.16534671s" totalImagesPullingTime="5.873813462s" totalInitContainerRuntime="28.156163ms" isStatefulPod=false podCreationTimestamp="2026-07-09 16:20:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:50.16325321 +0000 UTC m=+75.081824575" watchObservedRunningTime="2026-07-09 16:20:50.16534671 +0000 UTC m=+75.083918043" Jul 09 16:20:53.149647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:53.149614 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerStarted","Data":"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768"} Jul 09 16:20:53.150061 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:53.149682 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerStarted","Data":"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a"} Jul 09 16:20:55.160209 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:55.160173 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerStarted","Data":"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207"} Jul 09 16:20:55.160577 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:55.160240 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerStarted","Data":"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577"} Jul 09 16:20:55.160577 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:55.160266 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerStarted","Data":"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f"} Jul 09 16:20:55.160577 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:55.160291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerStarted","Data":"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b"} Jul 09 16:20:55.191966 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:55.191905 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.125828773 podStartE2EDuration="8.191830596s" totalImagesPullingTime="6.038808362s" totalInitContainerRuntime="27.193461ms" isStatefulPod=false podCreationTimestamp="2026-07-09 16:20:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:55.189520758 +0000 UTC m=+80.108092090" watchObservedRunningTime="2026-07-09 16:20:55.191830596 +0000 UTC m=+80.110401930" Jul 09 16:20:57.751233 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:57.751130 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:20:58.185274 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:20:58.185242 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dbb9f59dc-tsgzj"] Jul 09 16:21:05.730680 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:05.730640 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:21:05.731168 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:05.730734 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:21:18.115105 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:18.115076 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x5wpm" Jul 09 16:21:23.212321 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:23.212272 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dbb9f59dc-tsgzj" podUID="21c05ef7-9101-497b-ad43-bf85b28159aa" containerName="console" containerID="cri-o://3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd" gracePeriod=15 Jul 09 16:21:23.995301 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:23.995271 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:21:24.068436 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.068402 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-oauth-serving-cert\") pod \"21c05ef7-9101-497b-ad43-bf85b28159aa\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " Jul 09 16:21:24.068436 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.068437 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-service-ca\") pod \"21c05ef7-9101-497b-ad43-bf85b28159aa\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " Jul 09 16:21:24.068667 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.068461 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-console-config\") pod \"21c05ef7-9101-497b-ad43-bf85b28159aa\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " Jul 09 16:21:24.068667 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.068517 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21c05ef7-9101-497b-ad43-bf85b28159aa-console-oauth-config\") pod \"21c05ef7-9101-497b-ad43-bf85b28159aa\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " Jul 09 16:21:24.068667 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.068541 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7tcv\" (UniqueName: \"kubernetes.io/projected/21c05ef7-9101-497b-ad43-bf85b28159aa-kube-api-access-h7tcv\") pod \"21c05ef7-9101-497b-ad43-bf85b28159aa\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " Jul 09 16:21:24.068667 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.068567 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21c05ef7-9101-497b-ad43-bf85b28159aa-console-serving-cert\") pod \"21c05ef7-9101-497b-ad43-bf85b28159aa\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " Jul 09 16:21:24.068667 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.068604 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-trusted-ca-bundle\") pod \"21c05ef7-9101-497b-ad43-bf85b28159aa\" (UID: \"21c05ef7-9101-497b-ad43-bf85b28159aa\") " Jul 09 16:21:24.069214 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.069181 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-console-config" (OuterVolumeSpecName: "console-config") pod "21c05ef7-9101-497b-ad43-bf85b28159aa" (UID: "21c05ef7-9101-497b-ad43-bf85b28159aa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:21:24.069355 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.069162 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-service-ca" (OuterVolumeSpecName: "service-ca") pod "21c05ef7-9101-497b-ad43-bf85b28159aa" (UID: "21c05ef7-9101-497b-ad43-bf85b28159aa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:21:24.069355 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.069278 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "21c05ef7-9101-497b-ad43-bf85b28159aa" (UID: "21c05ef7-9101-497b-ad43-bf85b28159aa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:21:24.069494 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.069409 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "21c05ef7-9101-497b-ad43-bf85b28159aa" (UID: "21c05ef7-9101-497b-ad43-bf85b28159aa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:21:24.074476 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.072680 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21c05ef7-9101-497b-ad43-bf85b28159aa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "21c05ef7-9101-497b-ad43-bf85b28159aa" (UID: "21c05ef7-9101-497b-ad43-bf85b28159aa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:21:24.074476 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.074068 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c05ef7-9101-497b-ad43-bf85b28159aa-kube-api-access-h7tcv" (OuterVolumeSpecName: "kube-api-access-h7tcv") pod "21c05ef7-9101-497b-ad43-bf85b28159aa" (UID: "21c05ef7-9101-497b-ad43-bf85b28159aa"). InnerVolumeSpecName "kube-api-access-h7tcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:21:24.074476 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.074081 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21c05ef7-9101-497b-ad43-bf85b28159aa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "21c05ef7-9101-497b-ad43-bf85b28159aa" (UID: "21c05ef7-9101-497b-ad43-bf85b28159aa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:21:24.170158 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.170068 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21c05ef7-9101-497b-ad43-bf85b28159aa-console-serving-cert\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:21:24.170158 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.170110 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-trusted-ca-bundle\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:21:24.170158 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.170123 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-oauth-serving-cert\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:21:24.170158 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.170135 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-service-ca\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:21:24.170158 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.170144 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21c05ef7-9101-497b-ad43-bf85b28159aa-console-config\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:21:24.170158 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.170152 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21c05ef7-9101-497b-ad43-bf85b28159aa-console-oauth-config\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:21:24.170158 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.170160 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7tcv\" (UniqueName: \"kubernetes.io/projected/21c05ef7-9101-497b-ad43-bf85b28159aa-kube-api-access-h7tcv\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:21:24.264190 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.264150 2579 generic.go:356] "Generic (PLEG): container finished" podID="21c05ef7-9101-497b-ad43-bf85b28159aa" containerID="3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd" exitCode=0 Jul 09 16:21:24.264589 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.264200 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbb9f59dc-tsgzj" event={"ID":"21c05ef7-9101-497b-ad43-bf85b28159aa","Type":"ContainerDied","Data":"3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd"} Jul 09 16:21:24.264589 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.264226 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbb9f59dc-tsgzj" Jul 09 16:21:24.264589 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.264288 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbb9f59dc-tsgzj" event={"ID":"21c05ef7-9101-497b-ad43-bf85b28159aa","Type":"ContainerDied","Data":"6d223a65d87dd1b5df2d1dae7ff4750a9dfddf4e3722420d05f9b04abb07b320"} Jul 09 16:21:24.264589 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.264310 2579 scope.go:117] "RemoveContainer" containerID="3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd" Jul 09 16:21:24.272486 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.272471 2579 scope.go:117] "RemoveContainer" containerID="3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd" Jul 09 16:21:24.272746 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:21:24.272729 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd\": container with ID starting with 3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd not found: ID does not exist" containerID="3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd" Jul 09 16:21:24.272801 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.272752 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd"} err="failed to get container status \"3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd\": rpc error: code = NotFound desc = could not find container \"3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd\": container with ID starting with 3d596e6b49586a5f5dac6f636f48faa2d1c81c755856697b380321b3588799fd not found: ID does not exist" Jul 09 16:21:24.287849 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.287823 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dbb9f59dc-tsgzj"] Jul 09 16:21:24.291118 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:24.291096 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dbb9f59dc-tsgzj"] Jul 09 16:21:25.735519 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:25.735488 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:21:25.739868 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:25.739841 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-56d45c967f-7kkf9" Jul 09 16:21:25.763491 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:25.763465 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21c05ef7-9101-497b-ad43-bf85b28159aa" path="/var/lib/kubelet/pods/21c05ef7-9101-497b-ad43-bf85b28159aa/volumes" Jul 09 16:21:47.751231 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:47.751195 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:21:47.769446 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:47.769424 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:21:48.368917 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:21:48.368887 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:01.459584 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:01.459546 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:22:01.460110 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:01.459838 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="alertmanager" containerID="cri-o://479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747" gracePeriod=120 Jul 09 16:22:01.460110 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:01.459867 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="kube-rbac-proxy-metric" containerID="cri-o://1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a" gracePeriod=120 Jul 09 16:22:01.460110 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:01.459924 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="prom-label-proxy" containerID="cri-o://7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0" gracePeriod=120 Jul 09 16:22:01.460110 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:01.459954 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="kube-rbac-proxy-web" containerID="cri-o://4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133" gracePeriod=120 Jul 09 16:22:01.460110 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:01.459967 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="config-reloader" containerID="cri-o://da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6" gracePeriod=120 Jul 09 16:22:01.460110 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:01.459953 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="kube-rbac-proxy" containerID="cri-o://f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a" gracePeriod=120 Jul 09 16:22:02.405830 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.405790 2579 generic.go:356] "Generic (PLEG): container finished" podID="38051319-c18b-4e6f-be81-863c347b68e5" containerID="7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0" exitCode=0 Jul 09 16:22:02.405830 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.405817 2579 generic.go:356] "Generic (PLEG): container finished" podID="38051319-c18b-4e6f-be81-863c347b68e5" containerID="f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a" exitCode=0 Jul 09 16:22:02.405830 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.405823 2579 generic.go:356] "Generic (PLEG): container finished" podID="38051319-c18b-4e6f-be81-863c347b68e5" containerID="da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6" exitCode=0 Jul 09 16:22:02.405830 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.405829 2579 generic.go:356] "Generic (PLEG): container finished" podID="38051319-c18b-4e6f-be81-863c347b68e5" containerID="479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747" exitCode=0 Jul 09 16:22:02.406110 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.405857 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerDied","Data":"7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0"} Jul 09 16:22:02.406110 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.405920 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerDied","Data":"f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a"} Jul 09 16:22:02.406110 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.405945 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerDied","Data":"da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6"} Jul 09 16:22:02.406110 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.405968 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerDied","Data":"479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747"} Jul 09 16:22:02.700859 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.700838 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:22:02.879065 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879026 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879226 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879073 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879226 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879096 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhwtq\" (UniqueName: \"kubernetes.io/projected/38051319-c18b-4e6f-be81-863c347b68e5-kube-api-access-nhwtq\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879226 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879112 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38051319-c18b-4e6f-be81-863c347b68e5-alertmanager-trusted-ca-bundle\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879226 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879139 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38051319-c18b-4e6f-be81-863c347b68e5-tls-assets\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879226 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879183 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-web-config\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879226 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879220 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-main-tls\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879525 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879257 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-cluster-tls-config\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879525 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879285 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-config-volume\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879525 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879319 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38051319-c18b-4e6f-be81-863c347b68e5-alertmanager-main-db\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879525 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879346 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879525 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879383 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38051319-c18b-4e6f-be81-863c347b68e5-config-out\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879525 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879422 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38051319-c18b-4e6f-be81-863c347b68e5-metrics-client-ca\") pod \"38051319-c18b-4e6f-be81-863c347b68e5\" (UID: \"38051319-c18b-4e6f-be81-863c347b68e5\") " Jul 09 16:22:02.879821 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879528 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38051319-c18b-4e6f-be81-863c347b68e5-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:22:02.879821 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.879778 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38051319-c18b-4e6f-be81-863c347b68e5-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:02.880211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.880061 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38051319-c18b-4e6f-be81-863c347b68e5-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:22:02.880665 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.880543 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38051319-c18b-4e6f-be81-863c347b68e5-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:22:02.882927 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.882896 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38051319-c18b-4e6f-be81-863c347b68e5-kube-api-access-nhwtq" (OuterVolumeSpecName: "kube-api-access-nhwtq") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "kube-api-access-nhwtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:22:02.883250 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.883182 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:02.883250 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.883220 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38051319-c18b-4e6f-be81-863c347b68e5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:22:02.883466 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.883343 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:02.883466 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.883437 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:02.883609 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.883588 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-config-volume" (OuterVolumeSpecName: "config-volume") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:02.883666 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.883628 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38051319-c18b-4e6f-be81-863c347b68e5-config-out" (OuterVolumeSpecName: "config-out") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:22:02.883709 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.883668 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:02.886857 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.886836 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:02.893829 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.893807 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-web-config" (OuterVolumeSpecName: "web-config") pod "38051319-c18b-4e6f-be81-863c347b68e5" (UID: "38051319-c18b-4e6f-be81-863c347b68e5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:02.980478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.980387 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-main-tls\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:02.980478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.980419 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-cluster-tls-config\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:02.980478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.980430 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-config-volume\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:02.980478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.980440 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38051319-c18b-4e6f-be81-863c347b68e5-alertmanager-main-db\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:02.980478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.980450 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:02.980478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.980458 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38051319-c18b-4e6f-be81-863c347b68e5-config-out\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:02.980478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.980467 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38051319-c18b-4e6f-be81-863c347b68e5-metrics-client-ca\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:02.980478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.980476 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:02.980478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.980484 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:02.980856 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.980494 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhwtq\" (UniqueName: \"kubernetes.io/projected/38051319-c18b-4e6f-be81-863c347b68e5-kube-api-access-nhwtq\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:02.980856 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.980501 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38051319-c18b-4e6f-be81-863c347b68e5-tls-assets\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:02.980856 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:02.980510 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38051319-c18b-4e6f-be81-863c347b68e5-web-config\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:03.412403 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.412364 2579 generic.go:356] "Generic (PLEG): container finished" podID="38051319-c18b-4e6f-be81-863c347b68e5" containerID="1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a" exitCode=0 Jul 09 16:22:03.412403 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.412388 2579 generic.go:356] "Generic (PLEG): container finished" podID="38051319-c18b-4e6f-be81-863c347b68e5" containerID="4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133" exitCode=0 Jul 09 16:22:03.412601 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.412422 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerDied","Data":"1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a"} Jul 09 16:22:03.412601 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.412450 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:22:03.412601 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.412496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerDied","Data":"4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133"} Jul 09 16:22:03.412601 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.412522 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38051319-c18b-4e6f-be81-863c347b68e5","Type":"ContainerDied","Data":"89c3915e209e786b8f233055135d1a80950008c9d583689b85dcb522ba2f35b1"} Jul 09 16:22:03.412601 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.412553 2579 scope.go:117] "RemoveContainer" containerID="7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0" Jul 09 16:22:03.420175 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.420156 2579 scope.go:117] "RemoveContainer" containerID="1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a" Jul 09 16:22:03.427163 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.427147 2579 scope.go:117] "RemoveContainer" containerID="f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a" Jul 09 16:22:03.433957 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.433938 2579 scope.go:117] "RemoveContainer" containerID="4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133" Jul 09 16:22:03.438385 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.438357 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:22:03.441605 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.441586 2579 scope.go:117] "RemoveContainer" containerID="da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6" Jul 09 16:22:03.443565 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.443546 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:22:03.448860 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.448841 2579 scope.go:117] "RemoveContainer" containerID="479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747" Jul 09 16:22:03.455566 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.455548 2579 scope.go:117] "RemoveContainer" containerID="d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973" Jul 09 16:22:03.462214 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.462197 2579 scope.go:117] "RemoveContainer" containerID="7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0" Jul 09 16:22:03.462479 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:03.462460 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0\": container with ID starting with 7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0 not found: ID does not exist" containerID="7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0" Jul 09 16:22:03.462547 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.462489 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0"} err="failed to get container status \"7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0\": rpc error: code = NotFound desc = could not find container \"7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0\": container with ID starting with 7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0 not found: ID does not exist" Jul 09 16:22:03.462547 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.462508 2579 scope.go:117] "RemoveContainer" containerID="1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a" Jul 09 16:22:03.462738 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:03.462722 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a\": container with ID starting with 1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a not found: ID does not exist" containerID="1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a" Jul 09 16:22:03.462775 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.462744 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a"} err="failed to get container status \"1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a\": rpc error: code = NotFound desc = could not find container \"1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a\": container with ID starting with 1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a not found: ID does not exist" Jul 09 16:22:03.462775 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.462761 2579 scope.go:117] "RemoveContainer" containerID="f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a" Jul 09 16:22:03.462995 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:03.462976 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a\": container with ID starting with f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a not found: ID does not exist" containerID="f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a" Jul 09 16:22:03.463085 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.463024 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a"} err="failed to get container status \"f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a\": rpc error: code = NotFound desc = could not find container \"f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a\": container with ID starting with f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a not found: ID does not exist" Jul 09 16:22:03.463085 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.463048 2579 scope.go:117] "RemoveContainer" containerID="4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133" Jul 09 16:22:03.463467 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:03.463394 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133\": container with ID starting with 4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133 not found: ID does not exist" containerID="4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133" Jul 09 16:22:03.463566 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.463498 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133"} err="failed to get container status \"4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133\": rpc error: code = NotFound desc = could not find container \"4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133\": container with ID starting with 4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133 not found: ID does not exist" Jul 09 16:22:03.463640 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.463550 2579 scope.go:117] "RemoveContainer" containerID="da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6" Jul 09 16:22:03.463948 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:03.463927 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6\": container with ID starting with da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6 not found: ID does not exist" containerID="da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6" Jul 09 16:22:03.463948 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.463953 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6"} err="failed to get container status \"da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6\": rpc error: code = NotFound desc = could not find container \"da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6\": container with ID starting with da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6 not found: ID does not exist" Jul 09 16:22:03.464127 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.463969 2579 scope.go:117] "RemoveContainer" containerID="479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747" Jul 09 16:22:03.464238 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:03.464223 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747\": container with ID starting with 479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747 not found: ID does not exist" containerID="479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747" Jul 09 16:22:03.464279 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.464242 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747"} err="failed to get container status \"479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747\": rpc error: code = NotFound desc = could not find container \"479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747\": container with ID starting with 479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747 not found: ID does not exist" Jul 09 16:22:03.464279 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.464256 2579 scope.go:117] "RemoveContainer" containerID="d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973" Jul 09 16:22:03.464468 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:03.464451 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973\": container with ID starting with d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973 not found: ID does not exist" containerID="d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973" Jul 09 16:22:03.464514 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.464472 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973"} err="failed to get container status \"d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973\": rpc error: code = NotFound desc = could not find container \"d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973\": container with ID starting with d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973 not found: ID does not exist" Jul 09 16:22:03.464514 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.464486 2579 scope.go:117] "RemoveContainer" containerID="7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0" Jul 09 16:22:03.464770 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.464750 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0"} err="failed to get container status \"7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0\": rpc error: code = NotFound desc = could not find container \"7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0\": container with ID starting with 7efd766ef3331b20980ac2b574defae737c0045f412adcf14b0a73d3f46d29c0 not found: ID does not exist" Jul 09 16:22:03.464855 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.464771 2579 scope.go:117] "RemoveContainer" containerID="1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a" Jul 09 16:22:03.465024 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.464991 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a"} err="failed to get container status \"1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a\": rpc error: code = NotFound desc = could not find container \"1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a\": container with ID starting with 1ea1058cbaed825452e6a79ad7a9ef344e0119eb9abeece3cacc9b99fe5f9b4a not found: ID does not exist" Jul 09 16:22:03.465074 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.465027 2579 scope.go:117] "RemoveContainer" containerID="f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a" Jul 09 16:22:03.465241 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.465224 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a"} err="failed to get container status \"f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a\": rpc error: code = NotFound desc = could not find container \"f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a\": container with ID starting with f38c7e282e3081128969ed90e1f8f7c4ff1d18036e26448dd66b8b5213cbcb0a not found: ID does not exist" Jul 09 16:22:03.465285 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.465242 2579 scope.go:117] "RemoveContainer" containerID="4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133" Jul 09 16:22:03.465457 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.465441 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133"} err="failed to get container status \"4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133\": rpc error: code = NotFound desc = could not find container \"4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133\": container with ID starting with 4397f094d95a824ffc05a17a33ebbcee6db345ce372c845de7ceb4fe3c165133 not found: ID does not exist" Jul 09 16:22:03.465515 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.465457 2579 scope.go:117] "RemoveContainer" containerID="da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6" Jul 09 16:22:03.465677 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.465659 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6"} err="failed to get container status \"da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6\": rpc error: code = NotFound desc = could not find container \"da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6\": container with ID starting with da601772c017c895156e788ad30a9bf2146ad9c97ccb948c54ea4d65581cf0c6 not found: ID does not exist" Jul 09 16:22:03.465742 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.465680 2579 scope.go:117] "RemoveContainer" containerID="479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747" Jul 09 16:22:03.465892 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.465872 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747"} err="failed to get container status \"479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747\": rpc error: code = NotFound desc = could not find container \"479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747\": container with ID starting with 479b6a7328c13d21abb526c72fbaba0312e8abc8f675b64b70f2429a89151747 not found: ID does not exist" Jul 09 16:22:03.465936 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.465893 2579 scope.go:117] "RemoveContainer" containerID="d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973" Jul 09 16:22:03.466141 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.466123 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973"} err="failed to get container status \"d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973\": rpc error: code = NotFound desc = could not find container \"d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973\": container with ID starting with d43918c56775fed174221887fbc032e3040d8d57e338fc6d54e223bd5dec0973 not found: ID does not exist" Jul 09 16:22:03.763795 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:03.763767 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38051319-c18b-4e6f-be81-863c347b68e5" path="/var/lib/kubelet/pods/38051319-c18b-4e6f-be81-863c347b68e5/volumes" Jul 09 16:22:05.515534 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515495 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86bfc65db9-l9jxk"] Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515839 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="alertmanager" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515855 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="alertmanager" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515869 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="kube-rbac-proxy-web" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515877 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="kube-rbac-proxy-web" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515901 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="init-config-reloader" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515909 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="init-config-reloader" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515918 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="prom-label-proxy" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515926 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="prom-label-proxy" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515935 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="kube-rbac-proxy" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515942 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="kube-rbac-proxy" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515950 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="kube-rbac-proxy-metric" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515957 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="kube-rbac-proxy-metric" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515965 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c05ef7-9101-497b-ad43-bf85b28159aa" containerName="console" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515972 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c05ef7-9101-497b-ad43-bf85b28159aa" containerName="console" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515982 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="config-reloader" Jul 09 16:22:05.515995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.515989 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="config-reloader" Jul 09 16:22:05.516718 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.516072 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="kube-rbac-proxy-web" Jul 09 16:22:05.516718 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.516083 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="kube-rbac-proxy-metric" Jul 09 16:22:05.516718 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.516095 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="alertmanager" Jul 09 16:22:05.516718 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.516104 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="kube-rbac-proxy" Jul 09 16:22:05.516718 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.516113 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="21c05ef7-9101-497b-ad43-bf85b28159aa" containerName="console" Jul 09 16:22:05.516718 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.516122 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="config-reloader" Jul 09 16:22:05.516718 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.516132 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="38051319-c18b-4e6f-be81-863c347b68e5" containerName="prom-label-proxy" Jul 09 16:22:05.521315 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.521292 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.524038 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.524000 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hbm62\"" Jul 09 16:22:05.524167 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.524135 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 16:22:05.524321 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.524303 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 16:22:05.524366 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.524343 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 16:22:05.524715 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.524702 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 16:22:05.524848 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.524836 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 16:22:05.530407 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.530388 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 16:22:05.539226 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.539198 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86bfc65db9-l9jxk"] Jul 09 16:22:05.700410 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.700364 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-metrics-client-ca\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.700410 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.700414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.700614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.700447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.700614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.700471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-serving-certs-ca-bundle\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.700614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.700486 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-secret-telemeter-client\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.700614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.700520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8ss9\" (UniqueName: \"kubernetes.io/projected/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-kube-api-access-l8ss9\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.700614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.700559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-federate-client-tls\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.700614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.700604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-telemeter-client-tls\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.802064 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.801960 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8ss9\" (UniqueName: \"kubernetes.io/projected/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-kube-api-access-l8ss9\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.802064 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.802028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-federate-client-tls\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.802280 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.802203 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-telemeter-client-tls\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.802280 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.802256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-metrics-client-ca\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.802388 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.802300 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.802388 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.802340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.802388 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.802379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-serving-certs-ca-bundle\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.802525 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.802403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-secret-telemeter-client\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.803112 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.803068 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-metrics-client-ca\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.803232 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.803114 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-serving-certs-ca-bundle\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.803359 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.803339 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.804755 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.804734 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.804864 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.804847 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-secret-telemeter-client\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.804917 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.804902 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-telemeter-client-tls\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.805080 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.805061 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-federate-client-tls\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.809541 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.809515 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:22:05.809876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.809847 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="prometheus" containerID="cri-o://7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a" gracePeriod=600 Jul 09 16:22:05.810064 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.810041 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="kube-rbac-proxy-web" containerID="cri-o://1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f" gracePeriod=600 Jul 09 16:22:05.810145 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.810060 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="kube-rbac-proxy" containerID="cri-o://bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577" gracePeriod=600 Jul 09 16:22:05.810208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.810140 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="thanos-sidecar" containerID="cri-o://182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b" gracePeriod=600 Jul 09 16:22:05.810208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.810176 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="config-reloader" containerID="cri-o://0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768" gracePeriod=600 Jul 09 16:22:05.810305 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.810202 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="kube-rbac-proxy-thanos" containerID="cri-o://14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207" gracePeriod=600 Jul 09 16:22:05.812125 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.812102 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8ss9\" (UniqueName: \"kubernetes.io/projected/0490a9e6-caa4-4146-8f17-86d7be9c4e6c-kube-api-access-l8ss9\") pod \"telemeter-client-86bfc65db9-l9jxk\" (UID: \"0490a9e6-caa4-4146-8f17-86d7be9c4e6c\") " pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.830429 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.830405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" Jul 09 16:22:05.972772 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:05.972746 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86bfc65db9-l9jxk"] Jul 09 16:22:05.974812 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:22:05.974775 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0490a9e6_caa4_4146_8f17_86d7be9c4e6c.slice/crio-1ba04f16b81a83e83f23d2b636c988a3fb4cfabe728476e220af92b1c2180fcb WatchSource:0}: Error finding container 1ba04f16b81a83e83f23d2b636c988a3fb4cfabe728476e220af92b1c2180fcb: Status 404 returned error can't find the container with id 1ba04f16b81a83e83f23d2b636c988a3fb4cfabe728476e220af92b1c2180fcb Jul 09 16:22:06.056533 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.056471 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.104962 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.104926 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-metrics-client-ca\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105127 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105059 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-config-out\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105127 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105089 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-tls\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105127 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105110 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvns5\" (UniqueName: \"kubernetes.io/projected/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-kube-api-access-tvns5\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105303 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105131 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-serving-certs-ca-bundle\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105303 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105171 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105402 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105352 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:22:06.105450 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105412 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-metrics-client-certs\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105505 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105451 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-web-config\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105505 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105483 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-1\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105526 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-grpc-tls\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105527 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:22:06.105607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105552 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-config\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105575 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-2\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105597 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-trusted-ca-bundle\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105847 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105635 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-kube-rbac-proxy\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.105899 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105857 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:22:06.105899 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105867 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-metrics-client-ca\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.105899 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.105886 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.106184 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.106160 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:22:06.106253 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.106197 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:22:06.107785 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.107755 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:06.107897 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.107844 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:06.108442 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.108407 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-config-out" (OuterVolumeSpecName: "config-out") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:22:06.108558 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.108531 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:06.108812 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.108788 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:06.108890 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.108855 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-config" (OuterVolumeSpecName: "config") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:06.109028 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.108992 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:06.109729 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.109695 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-kube-api-access-tvns5" (OuterVolumeSpecName: "kube-api-access-tvns5") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "kube-api-access-tvns5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:22:06.118329 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.118299 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-web-config" (OuterVolumeSpecName: "web-config") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:06.206605 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206575 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-db\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.206605 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206609 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-thanos-prometheus-http-client-file\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.206829 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206630 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-0\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.206829 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206648 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-kubelet-serving-ca-bundle\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.206829 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206665 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.206829 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206681 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-tls-assets\") pod \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\" (UID: \"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43\") " Jul 09 16:22:06.207024 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206894 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.207024 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206912 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-grpc-tls\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.207024 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206925 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-config\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.207024 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206938 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.207024 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206951 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.207024 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206964 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-kube-rbac-proxy\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.207024 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206978 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-config-out\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.207024 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.206992 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.207024 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.207028 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvns5\" (UniqueName: \"kubernetes.io/projected/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-kube-api-access-tvns5\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.207547 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.207042 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.207547 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.207056 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-metrics-client-certs\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.207547 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.207070 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-web-config\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.207547 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.207115 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:22:06.207751 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.207695 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:22:06.208161 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.208125 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:22:06.208906 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.208875 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:06.208996 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.208921 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:22:06.209072 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.209026 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" (UID: "d69e8fcf-ebd0-44af-98fc-74e3fba4fb43"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:22:06.307443 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.307347 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-db\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.307443 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.307392 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.307443 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.307407 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.307443 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.307418 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.307443 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.307432 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.307443 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.307446 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43-tls-assets\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:22:06.425769 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.425736 2579 generic.go:356] "Generic (PLEG): container finished" podID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerID="14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207" exitCode=0 Jul 09 16:22:06.425769 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.425761 2579 generic.go:356] "Generic (PLEG): container finished" podID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerID="bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577" exitCode=0 Jul 09 16:22:06.425769 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.425769 2579 generic.go:356] "Generic (PLEG): container finished" podID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerID="1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f" exitCode=0 Jul 09 16:22:06.425769 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.425775 2579 generic.go:356] "Generic (PLEG): container finished" podID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerID="182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b" exitCode=0 Jul 09 16:22:06.425769 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.425780 2579 generic.go:356] "Generic (PLEG): container finished" podID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerID="0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768" exitCode=0 Jul 09 16:22:06.426103 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.425785 2579 generic.go:356] "Generic (PLEG): container finished" podID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerID="7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a" exitCode=0 Jul 09 16:22:06.426103 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.425819 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.426103 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.425819 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerDied","Data":"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207"} Jul 09 16:22:06.426103 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.425901 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerDied","Data":"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577"} Jul 09 16:22:06.426103 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.425945 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerDied","Data":"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f"} Jul 09 16:22:06.426103 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.425969 2579 scope.go:117] "RemoveContainer" containerID="14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207" Jul 09 16:22:06.426103 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.425986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerDied","Data":"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b"} Jul 09 16:22:06.426103 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.426046 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerDied","Data":"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768"} Jul 09 16:22:06.426103 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.426090 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerDied","Data":"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a"} Jul 09 16:22:06.426500 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.426130 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d69e8fcf-ebd0-44af-98fc-74e3fba4fb43","Type":"ContainerDied","Data":"fa583336877bda758b1ee815903471700d3c5eed52811d3a6dac7f5e46a0d1c2"} Jul 09 16:22:06.427068 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.427048 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" event={"ID":"0490a9e6-caa4-4146-8f17-86d7be9c4e6c","Type":"ContainerStarted","Data":"1ba04f16b81a83e83f23d2b636c988a3fb4cfabe728476e220af92b1c2180fcb"} Jul 09 16:22:06.433687 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.433562 2579 scope.go:117] "RemoveContainer" containerID="bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577" Jul 09 16:22:06.440413 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.440396 2579 scope.go:117] "RemoveContainer" containerID="1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f" Jul 09 16:22:06.448223 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.448206 2579 scope.go:117] "RemoveContainer" containerID="182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b" Jul 09 16:22:06.450712 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.450687 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:22:06.455231 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.455199 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:22:06.455733 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.455717 2579 scope.go:117] "RemoveContainer" containerID="0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768" Jul 09 16:22:06.461995 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.461981 2579 scope.go:117] "RemoveContainer" containerID="7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a" Jul 09 16:22:06.468752 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.468737 2579 scope.go:117] "RemoveContainer" containerID="d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038" Jul 09 16:22:06.475115 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.475100 2579 scope.go:117] "RemoveContainer" containerID="14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207" Jul 09 16:22:06.475373 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:06.475354 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": container with ID starting with 14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207 not found: ID does not exist" containerID="14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207" Jul 09 16:22:06.475414 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.475381 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207"} err="failed to get container status \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": rpc error: code = NotFound desc = could not find container \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": container with ID starting with 14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207 not found: ID does not exist" Jul 09 16:22:06.475414 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.475399 2579 scope.go:117] "RemoveContainer" containerID="bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577" Jul 09 16:22:06.475603 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:06.475585 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": container with ID starting with bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577 not found: ID does not exist" containerID="bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577" Jul 09 16:22:06.475647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.475609 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577"} err="failed to get container status \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": rpc error: code = NotFound desc = could not find container \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": container with ID starting with bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577 not found: ID does not exist" Jul 09 16:22:06.475647 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.475623 2579 scope.go:117] "RemoveContainer" containerID="1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f" Jul 09 16:22:06.475847 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:06.475832 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": container with ID starting with 1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f not found: ID does not exist" containerID="1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f" Jul 09 16:22:06.475888 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.475851 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f"} err="failed to get container status \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": rpc error: code = NotFound desc = could not find container \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": container with ID starting with 1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f not found: ID does not exist" Jul 09 16:22:06.475888 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.475863 2579 scope.go:117] "RemoveContainer" containerID="182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b" Jul 09 16:22:06.476077 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:06.476063 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": container with ID starting with 182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b not found: ID does not exist" containerID="182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b" Jul 09 16:22:06.476127 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.476078 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b"} err="failed to get container status \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": rpc error: code = NotFound desc = could not find container \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": container with ID starting with 182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b not found: ID does not exist" Jul 09 16:22:06.476127 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.476088 2579 scope.go:117] "RemoveContainer" containerID="0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768" Jul 09 16:22:06.476318 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:06.476302 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": container with ID starting with 0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768 not found: ID does not exist" containerID="0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768" Jul 09 16:22:06.476354 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.476326 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768"} err="failed to get container status \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": rpc error: code = NotFound desc = could not find container \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": container with ID starting with 0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768 not found: ID does not exist" Jul 09 16:22:06.476354 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.476342 2579 scope.go:117] "RemoveContainer" containerID="7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a" Jul 09 16:22:06.476546 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:06.476531 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": container with ID starting with 7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a not found: ID does not exist" containerID="7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a" Jul 09 16:22:06.476583 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.476550 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a"} err="failed to get container status \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": rpc error: code = NotFound desc = could not find container \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": container with ID starting with 7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a not found: ID does not exist" Jul 09 16:22:06.476583 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.476562 2579 scope.go:117] "RemoveContainer" containerID="d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038" Jul 09 16:22:06.476740 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:22:06.476726 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": container with ID starting with d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038 not found: ID does not exist" containerID="d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038" Jul 09 16:22:06.476785 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.476742 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038"} err="failed to get container status \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": rpc error: code = NotFound desc = could not find container \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": container with ID starting with d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038 not found: ID does not exist" Jul 09 16:22:06.476785 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.476753 2579 scope.go:117] "RemoveContainer" containerID="14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207" Jul 09 16:22:06.476912 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.476897 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207"} err="failed to get container status \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": rpc error: code = NotFound desc = could not find container \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": container with ID starting with 14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207 not found: ID does not exist" Jul 09 16:22:06.476955 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.476912 2579 scope.go:117] "RemoveContainer" containerID="bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577" Jul 09 16:22:06.477120 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.477101 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577"} err="failed to get container status \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": rpc error: code = NotFound desc = could not find container \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": container with ID starting with bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577 not found: ID does not exist" Jul 09 16:22:06.477158 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.477121 2579 scope.go:117] "RemoveContainer" containerID="1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f" Jul 09 16:22:06.477347 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.477331 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f"} err="failed to get container status \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": rpc error: code = NotFound desc = could not find container \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": container with ID starting with 1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f not found: ID does not exist" Jul 09 16:22:06.477347 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.477346 2579 scope.go:117] "RemoveContainer" containerID="182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b" Jul 09 16:22:06.477549 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.477519 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b"} err="failed to get container status \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": rpc error: code = NotFound desc = could not find container \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": container with ID starting with 182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b not found: ID does not exist" Jul 09 16:22:06.477614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.477551 2579 scope.go:117] "RemoveContainer" containerID="0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768" Jul 09 16:22:06.477765 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.477748 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768"} err="failed to get container status \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": rpc error: code = NotFound desc = could not find container \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": container with ID starting with 0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768 not found: ID does not exist" Jul 09 16:22:06.477818 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.477767 2579 scope.go:117] "RemoveContainer" containerID="7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a" Jul 09 16:22:06.477960 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.477942 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a"} err="failed to get container status \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": rpc error: code = NotFound desc = could not find container \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": container with ID starting with 7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a not found: ID does not exist" Jul 09 16:22:06.478045 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.477960 2579 scope.go:117] "RemoveContainer" containerID="d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038" Jul 09 16:22:06.478195 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.478178 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038"} err="failed to get container status \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": rpc error: code = NotFound desc = could not find container \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": container with ID starting with d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038 not found: ID does not exist" Jul 09 16:22:06.478254 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.478196 2579 scope.go:117] "RemoveContainer" containerID="14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207" Jul 09 16:22:06.478382 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.478365 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207"} err="failed to get container status \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": rpc error: code = NotFound desc = could not find container \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": container with ID starting with 14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207 not found: ID does not exist" Jul 09 16:22:06.478420 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.478382 2579 scope.go:117] "RemoveContainer" containerID="bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577" Jul 09 16:22:06.478554 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.478535 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577"} err="failed to get container status \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": rpc error: code = NotFound desc = could not find container \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": container with ID starting with bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577 not found: ID does not exist" Jul 09 16:22:06.478597 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.478555 2579 scope.go:117] "RemoveContainer" containerID="1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f" Jul 09 16:22:06.478826 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.478810 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f"} err="failed to get container status \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": rpc error: code = NotFound desc = could not find container \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": container with ID starting with 1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f not found: ID does not exist" Jul 09 16:22:06.478894 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.478828 2579 scope.go:117] "RemoveContainer" containerID="182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b" Jul 09 16:22:06.479058 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.479041 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b"} err="failed to get container status \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": rpc error: code = NotFound desc = could not find container \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": container with ID starting with 182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b not found: ID does not exist" Jul 09 16:22:06.479127 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.479060 2579 scope.go:117] "RemoveContainer" containerID="0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768" Jul 09 16:22:06.479260 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.479242 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768"} err="failed to get container status \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": rpc error: code = NotFound desc = could not find container \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": container with ID starting with 0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768 not found: ID does not exist" Jul 09 16:22:06.479301 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.479261 2579 scope.go:117] "RemoveContainer" containerID="7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a" Jul 09 16:22:06.479512 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.479495 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a"} err="failed to get container status \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": rpc error: code = NotFound desc = could not find container \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": container with ID starting with 7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a not found: ID does not exist" Jul 09 16:22:06.479569 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.479513 2579 scope.go:117] "RemoveContainer" containerID="d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038" Jul 09 16:22:06.479725 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.479707 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038"} err="failed to get container status \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": rpc error: code = NotFound desc = could not find container \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": container with ID starting with d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038 not found: ID does not exist" Jul 09 16:22:06.479769 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.479726 2579 scope.go:117] "RemoveContainer" containerID="14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207" Jul 09 16:22:06.479909 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.479893 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207"} err="failed to get container status \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": rpc error: code = NotFound desc = could not find container \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": container with ID starting with 14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207 not found: ID does not exist" Jul 09 16:22:06.479974 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.479911 2579 scope.go:117] "RemoveContainer" containerID="bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577" Jul 09 16:22:06.480123 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.480108 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577"} err="failed to get container status \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": rpc error: code = NotFound desc = could not find container \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": container with ID starting with bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577 not found: ID does not exist" Jul 09 16:22:06.480181 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.480123 2579 scope.go:117] "RemoveContainer" containerID="1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f" Jul 09 16:22:06.480322 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.480307 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f"} err="failed to get container status \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": rpc error: code = NotFound desc = could not find container \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": container with ID starting with 1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f not found: ID does not exist" Jul 09 16:22:06.480365 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.480321 2579 scope.go:117] "RemoveContainer" containerID="182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b" Jul 09 16:22:06.480512 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.480493 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b"} err="failed to get container status \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": rpc error: code = NotFound desc = could not find container \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": container with ID starting with 182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b not found: ID does not exist" Jul 09 16:22:06.480512 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.480510 2579 scope.go:117] "RemoveContainer" containerID="0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768" Jul 09 16:22:06.480798 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.480766 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768"} err="failed to get container status \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": rpc error: code = NotFound desc = could not find container \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": container with ID starting with 0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768 not found: ID does not exist" Jul 09 16:22:06.480798 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.480794 2579 scope.go:117] "RemoveContainer" containerID="7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a" Jul 09 16:22:06.481122 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.481099 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a"} err="failed to get container status \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": rpc error: code = NotFound desc = could not find container \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": container with ID starting with 7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a not found: ID does not exist" Jul 09 16:22:06.481276 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.481123 2579 scope.go:117] "RemoveContainer" containerID="d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038" Jul 09 16:22:06.481438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.481382 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038"} err="failed to get container status \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": rpc error: code = NotFound desc = could not find container \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": container with ID starting with d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038 not found: ID does not exist" Jul 09 16:22:06.481438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.481415 2579 scope.go:117] "RemoveContainer" containerID="14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207" Jul 09 16:22:06.481721 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.481690 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207"} err="failed to get container status \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": rpc error: code = NotFound desc = could not find container \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": container with ID starting with 14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207 not found: ID does not exist" Jul 09 16:22:06.481829 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.481722 2579 scope.go:117] "RemoveContainer" containerID="bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577" Jul 09 16:22:06.482001 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.481979 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577"} err="failed to get container status \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": rpc error: code = NotFound desc = could not find container \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": container with ID starting with bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577 not found: ID does not exist" Jul 09 16:22:06.482114 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.482019 2579 scope.go:117] "RemoveContainer" containerID="1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f" Jul 09 16:22:06.482268 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.482249 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f"} err="failed to get container status \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": rpc error: code = NotFound desc = could not find container \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": container with ID starting with 1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f not found: ID does not exist" Jul 09 16:22:06.482352 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.482280 2579 scope.go:117] "RemoveContainer" containerID="182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.482871 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b"} err="failed to get container status \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": rpc error: code = NotFound desc = could not find container \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": container with ID starting with 182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b not found: ID does not exist" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.482902 2579 scope.go:117] "RemoveContainer" containerID="0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.482993 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483691 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="thanos-sidecar" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483711 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="thanos-sidecar" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483724 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="kube-rbac-proxy-thanos" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483733 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="kube-rbac-proxy-thanos" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483746 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="kube-rbac-proxy" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483754 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="kube-rbac-proxy" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483796 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="prometheus" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483804 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="prometheus" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483815 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="kube-rbac-proxy-web" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483824 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="kube-rbac-proxy-web" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483843 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="config-reloader" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483851 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="config-reloader" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483871 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="init-config-reloader" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483880 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="init-config-reloader" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483980 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="kube-rbac-proxy-web" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.483996 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="config-reloader" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.484026 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="kube-rbac-proxy" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.484042 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="thanos-sidecar" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.484051 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="kube-rbac-proxy-thanos" Jul 09 16:22:06.486614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.484060 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" containerName="prometheus" Jul 09 16:22:06.487499 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.486661 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768"} err="failed to get container status \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": rpc error: code = NotFound desc = could not find container \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": container with ID starting with 0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768 not found: ID does not exist" Jul 09 16:22:06.487499 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.486687 2579 scope.go:117] "RemoveContainer" containerID="7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a" Jul 09 16:22:06.487613 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.487587 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a"} err="failed to get container status \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": rpc error: code = NotFound desc = could not find container \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": container with ID starting with 7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a not found: ID does not exist" Jul 09 16:22:06.487674 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.487618 2579 scope.go:117] "RemoveContainer" containerID="d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038" Jul 09 16:22:06.487860 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.487835 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038"} err="failed to get container status \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": rpc error: code = NotFound desc = could not find container \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": container with ID starting with d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038 not found: ID does not exist" Jul 09 16:22:06.487957 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.487863 2579 scope.go:117] "RemoveContainer" containerID="14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207" Jul 09 16:22:06.488109 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.488091 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207"} err="failed to get container status \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": rpc error: code = NotFound desc = could not find container \"14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207\": container with ID starting with 14f80cec99b6f73ae1122addf4b36ba2a1c47293685030790efc3aef68130207 not found: ID does not exist" Jul 09 16:22:06.488165 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.488110 2579 scope.go:117] "RemoveContainer" containerID="bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577" Jul 09 16:22:06.488339 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.488310 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577"} err="failed to get container status \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": rpc error: code = NotFound desc = could not find container \"bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577\": container with ID starting with bcf090c1de869706e371b5a6156038861b9f572f2bfad5a6dded05821ced9577 not found: ID does not exist" Jul 09 16:22:06.488339 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.488329 2579 scope.go:117] "RemoveContainer" containerID="1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f" Jul 09 16:22:06.488562 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.488542 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f"} err="failed to get container status \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": rpc error: code = NotFound desc = could not find container \"1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f\": container with ID starting with 1f5aa478896b6a5e00172ae3f368ab255092eaebd1b643e2104a1270f144e89f not found: ID does not exist" Jul 09 16:22:06.488617 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.488561 2579 scope.go:117] "RemoveContainer" containerID="182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b" Jul 09 16:22:06.488912 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.488870 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b"} err="failed to get container status \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": rpc error: code = NotFound desc = could not find container \"182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b\": container with ID starting with 182e6f8ad69fe3de8a7d8b97d95db6bfc6cbfaf3b7a87dd0b7c65a6dcddc9a4b not found: ID does not exist" Jul 09 16:22:06.488988 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.488925 2579 scope.go:117] "RemoveContainer" containerID="0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768" Jul 09 16:22:06.489211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.489196 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.489263 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.489232 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768"} err="failed to get container status \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": rpc error: code = NotFound desc = could not find container \"0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768\": container with ID starting with 0f0506c0b8b4897e354af8381cbbef4f5b3116ccc7bf2bc9b67cad014c8cf768 not found: ID does not exist" Jul 09 16:22:06.489263 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.489255 2579 scope.go:117] "RemoveContainer" containerID="7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a" Jul 09 16:22:06.489614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.489563 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a"} err="failed to get container status \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": rpc error: code = NotFound desc = could not find container \"7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a\": container with ID starting with 7b980844a33b43c16d9a42365471f42a5125573e35ad8eb515156f47c3c6655a not found: ID does not exist" Jul 09 16:22:06.489751 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.489730 2579 scope.go:117] "RemoveContainer" containerID="d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038" Jul 09 16:22:06.490051 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.490028 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038"} err="failed to get container status \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": rpc error: code = NotFound desc = could not find container \"d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038\": container with ID starting with d6db3298ae9e3b0c0ab29aa46a795bc1db84f94821c927074221c5c3820b2038 not found: ID does not exist" Jul 09 16:22:06.498936 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.498918 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 16:22:06.499070 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.499055 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 16:22:06.499516 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.499504 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a1ck6o9lsa15l\"" Jul 09 16:22:06.499700 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.499684 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 16:22:06.499773 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.499705 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 16:22:06.499773 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.499686 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 16:22:06.499880 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.499689 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 16:22:06.499880 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.499691 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 16:22:06.500084 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.500069 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 16:22:06.500249 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.500231 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 16:22:06.500361 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.500345 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hhczj\"" Jul 09 16:22:06.501033 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.501017 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 16:22:06.501103 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.501088 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 16:22:06.501155 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.501119 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 16:22:06.503534 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.503517 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 16:22:06.504122 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.504104 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 16:22:06.508804 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.508782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-config\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.508992 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.508964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509114 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509114 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509079 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2569c2ad-e968-4487-9bf7-33ffe562ff84-config-out\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509275 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509275 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509275 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2569c2ad-e968-4487-9bf7-33ffe562ff84-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509275 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509275 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-web-config\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509275 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509546 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509546 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509325 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509546 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509546 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509546 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509815 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509815 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509815 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509815 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.509815 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.509707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrxx6\" (UniqueName: \"kubernetes.io/projected/2569c2ad-e968-4487-9bf7-33ffe562ff84-kube-api-access-mrxx6\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.511040 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.511002 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:22:06.610336 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-config\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610336 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610288 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610336 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610336 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2569c2ad-e968-4487-9bf7-33ffe562ff84-config-out\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2569c2ad-e968-4487-9bf7-33ffe562ff84-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610557 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-web-config\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610761 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.610921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.611618 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.611618 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.610924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrxx6\" (UniqueName: \"kubernetes.io/projected/2569c2ad-e968-4487-9bf7-33ffe562ff84-kube-api-access-mrxx6\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.611618 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.611091 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.611618 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.611322 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.611855 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.611831 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.612083 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.612057 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.613170 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.612749 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.613433 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.613408 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.613882 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.613858 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.615102 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.614312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-config\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.615102 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.614684 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2569c2ad-e968-4487-9bf7-33ffe562ff84-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.615102 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.614703 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.615102 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.614932 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2569c2ad-e968-4487-9bf7-33ffe562ff84-config-out\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.615397 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.615236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.615397 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.615272 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.615504 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.615416 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2569c2ad-e968-4487-9bf7-33ffe562ff84-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.615564 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.615500 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-web-config\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.615604 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.615576 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.615680 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.615665 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.616043 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.615999 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.616452 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.616429 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2569c2ad-e968-4487-9bf7-33ffe562ff84-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.619934 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.619913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrxx6\" (UniqueName: \"kubernetes.io/projected/2569c2ad-e968-4487-9bf7-33ffe562ff84-kube-api-access-mrxx6\") pod \"prometheus-k8s-0\" (UID: \"2569c2ad-e968-4487-9bf7-33ffe562ff84\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.798336 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.798291 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:22:06.944697 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:06.944666 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 16:22:06.947808 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:22:06.947768 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2569c2ad_e968_4487_9bf7_33ffe562ff84.slice/crio-79b478f0438148237e319fe8d05b36f8557e5ade99791fb7e5cd9a458cb34560 WatchSource:0}: Error finding container 79b478f0438148237e319fe8d05b36f8557e5ade99791fb7e5cd9a458cb34560: Status 404 returned error can't find the container with id 79b478f0438148237e319fe8d05b36f8557e5ade99791fb7e5cd9a458cb34560 Jul 09 16:22:07.433473 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:07.433440 2579 generic.go:356] "Generic (PLEG): container finished" podID="2569c2ad-e968-4487-9bf7-33ffe562ff84" containerID="1f560e42f902bdd9feb5f612c90f856a1c320e1a83e25479fd29791bc724c6de" exitCode=0 Jul 09 16:22:07.433635 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:07.433488 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2569c2ad-e968-4487-9bf7-33ffe562ff84","Type":"ContainerDied","Data":"1f560e42f902bdd9feb5f612c90f856a1c320e1a83e25479fd29791bc724c6de"} Jul 09 16:22:07.433635 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:07.433537 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2569c2ad-e968-4487-9bf7-33ffe562ff84","Type":"ContainerStarted","Data":"79b478f0438148237e319fe8d05b36f8557e5ade99791fb7e5cd9a458cb34560"} Jul 09 16:22:07.768963 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:07.768931 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d69e8fcf-ebd0-44af-98fc-74e3fba4fb43" path="/var/lib/kubelet/pods/d69e8fcf-ebd0-44af-98fc-74e3fba4fb43/volumes" Jul 09 16:22:08.442226 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:08.442187 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2569c2ad-e968-4487-9bf7-33ffe562ff84","Type":"ContainerStarted","Data":"096c5a5ce6f34d85d7d3d72b38047988b440df289f2d10e79dd8ad85f9770ea8"} Jul 09 16:22:08.442398 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:08.442266 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2569c2ad-e968-4487-9bf7-33ffe562ff84","Type":"ContainerStarted","Data":"8dd913be3f71d8cc740fe0b87f18f9ba846e9030fe086fbe57a6d5e2b6dad324"} Jul 09 16:22:08.442398 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:08.442301 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2569c2ad-e968-4487-9bf7-33ffe562ff84","Type":"ContainerStarted","Data":"ae7b5bb15b7ad721527e80935ba93bdc4a47b88a4343d2138531514711780fe6"} Jul 09 16:22:08.442398 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:08.442341 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2569c2ad-e968-4487-9bf7-33ffe562ff84","Type":"ContainerStarted","Data":"4e77a35d39ab84dae4a3e7c04740b625ad0d06c45e40243ded9783dc2b9ee9c5"} Jul 09 16:22:08.442398 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:08.442378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2569c2ad-e968-4487-9bf7-33ffe562ff84","Type":"ContainerStarted","Data":"9a6c12f61d098da1c59f986ba366438680fc9854ae22f655f7f39c4377b22b2e"} Jul 09 16:22:08.442604 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:08.442409 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2569c2ad-e968-4487-9bf7-33ffe562ff84","Type":"ContainerStarted","Data":"875a974e50b47bd04d94e49fff5949ac181f7de071de22bcc100f27a5978baae"} Jul 09 16:22:08.480547 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:08.480484 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.460155682 podStartE2EDuration="2.480462583s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.306901ms" isStatefulPod=false podCreationTimestamp="2026-07-09 16:22:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:22:08.478047468 +0000 UTC m=+153.396618801" watchObservedRunningTime="2026-07-09 16:22:08.480462583 +0000 UTC m=+153.399033917" Jul 09 16:22:09.448101 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:09.448064 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" event={"ID":"0490a9e6-caa4-4146-8f17-86d7be9c4e6c","Type":"ContainerStarted","Data":"b8125d54b3e5084e23dd940c78715646575aa611ceab2422c4804603d1a599b2"} Jul 09 16:22:09.448566 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:09.448129 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" event={"ID":"0490a9e6-caa4-4146-8f17-86d7be9c4e6c","Type":"ContainerStarted","Data":"da7112cfe9c193639013fd3376076f3aff71c58eeeef539c9deb8a9ef6be896d"} Jul 09 16:22:09.448566 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:09.448171 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" event={"ID":"0490a9e6-caa4-4146-8f17-86d7be9c4e6c","Type":"ContainerStarted","Data":"85344de8784a126418ca4e86f9cc44554bcf68dcd65dd8af5cd865c76eb85efb"} Jul 09 16:22:09.474631 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:09.474581 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86bfc65db9-l9jxk" podStartSLOduration=1.9103839009999999 podStartE2EDuration="4.474564407s" totalImagesPullingTime="2.564180506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:22:09.472198108 +0000 UTC m=+154.390769466" watchObservedRunningTime="2026-07-09 16:22:09.474564407 +0000 UTC m=+154.393135739" Jul 09 16:22:11.798612 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:22:11.798568 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:23:06.799021 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:23:06.798967 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:23:06.813793 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:23:06.813769 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:23:07.664412 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:23:07.664383 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 16:24:35.502226 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:24:35.502198 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:24:35.505514 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:24:35.505492 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 16:24:35.505640 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:24:35.505527 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:25:36.337326 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.337231 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xqf77"] Jul 09 16:25:36.340282 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.340266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xqf77" Jul 09 16:25:36.342841 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.342820 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 16:25:36.343845 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.343830 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9l8bw\"" Jul 09 16:25:36.343954 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.343850 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 16:25:36.351733 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.351707 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xqf77"] Jul 09 16:25:36.428517 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.428483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgm89\" (UniqueName: \"kubernetes.io/projected/ba0dec12-3a98-4537-a7a3-ab336d5e2c50-kube-api-access-pgm89\") pod \"cert-manager-55b4d954d5-xqf77\" (UID: \"ba0dec12-3a98-4537-a7a3-ab336d5e2c50\") " pod="cert-manager/cert-manager-55b4d954d5-xqf77" Jul 09 16:25:36.428654 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.428528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba0dec12-3a98-4537-a7a3-ab336d5e2c50-bound-sa-token\") pod \"cert-manager-55b4d954d5-xqf77\" (UID: \"ba0dec12-3a98-4537-a7a3-ab336d5e2c50\") " pod="cert-manager/cert-manager-55b4d954d5-xqf77" Jul 09 16:25:36.529031 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.528962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgm89\" (UniqueName: \"kubernetes.io/projected/ba0dec12-3a98-4537-a7a3-ab336d5e2c50-kube-api-access-pgm89\") pod \"cert-manager-55b4d954d5-xqf77\" (UID: \"ba0dec12-3a98-4537-a7a3-ab336d5e2c50\") " pod="cert-manager/cert-manager-55b4d954d5-xqf77" Jul 09 16:25:36.529186 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.529054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba0dec12-3a98-4537-a7a3-ab336d5e2c50-bound-sa-token\") pod \"cert-manager-55b4d954d5-xqf77\" (UID: \"ba0dec12-3a98-4537-a7a3-ab336d5e2c50\") " pod="cert-manager/cert-manager-55b4d954d5-xqf77" Jul 09 16:25:36.537443 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.537412 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba0dec12-3a98-4537-a7a3-ab336d5e2c50-bound-sa-token\") pod \"cert-manager-55b4d954d5-xqf77\" (UID: \"ba0dec12-3a98-4537-a7a3-ab336d5e2c50\") " pod="cert-manager/cert-manager-55b4d954d5-xqf77" Jul 09 16:25:36.537559 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.537545 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgm89\" (UniqueName: \"kubernetes.io/projected/ba0dec12-3a98-4537-a7a3-ab336d5e2c50-kube-api-access-pgm89\") pod \"cert-manager-55b4d954d5-xqf77\" (UID: \"ba0dec12-3a98-4537-a7a3-ab336d5e2c50\") " pod="cert-manager/cert-manager-55b4d954d5-xqf77" Jul 09 16:25:36.661501 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.661414 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xqf77" Jul 09 16:25:36.788291 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.788127 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xqf77"] Jul 09 16:25:36.791019 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:25:36.790982 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba0dec12_3a98_4537_a7a3_ab336d5e2c50.slice/crio-dac3c0c814e917646bba3d2a344c52e7d0418c64866330288ef7badfced8f10c WatchSource:0}: Error finding container dac3c0c814e917646bba3d2a344c52e7d0418c64866330288ef7badfced8f10c: Status 404 returned error can't find the container with id dac3c0c814e917646bba3d2a344c52e7d0418c64866330288ef7badfced8f10c Jul 09 16:25:36.793348 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:36.793333 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:25:37.150525 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:37.150491 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xqf77" event={"ID":"ba0dec12-3a98-4537-a7a3-ab336d5e2c50","Type":"ContainerStarted","Data":"dac3c0c814e917646bba3d2a344c52e7d0418c64866330288ef7badfced8f10c"} Jul 09 16:25:41.166927 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:41.166894 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xqf77" event={"ID":"ba0dec12-3a98-4537-a7a3-ab336d5e2c50","Type":"ContainerStarted","Data":"b2afefee45a7c9829162a2fe99bfdaf894e846ae888798d1e5f86c1340eacf99"} Jul 09 16:25:41.184900 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:25:41.184848 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-xqf77" podStartSLOduration=0.997337495 podStartE2EDuration="5.184834154s" totalImagesPullingTime="4.187496659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:25:41.184192762 +0000 UTC m=+366.102764123" watchObservedRunningTime="2026-07-09 16:25:41.184834154 +0000 UTC m=+366.103405485" Jul 09 16:26:00.206946 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.206910 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh"] Jul 09 16:26:00.209973 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.209952 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.214452 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.214433 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 16:26:00.214606 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.214589 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kb6qk\"" Jul 09 16:26:00.214859 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.214839 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 16:26:00.214969 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.214882 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 16:26:00.214969 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.214921 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 16:26:00.238327 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.238298 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh"] Jul 09 16:26:00.339111 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.339078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/faf80e67-0559-4352-aaaa-fa547df6e787-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.339291 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.339123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/faf80e67-0559-4352-aaaa-fa547df6e787-tmp\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.339291 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.339208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/faf80e67-0559-4352-aaaa-fa547df6e787-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.339291 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.339233 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7ws8\" (UniqueName: \"kubernetes.io/projected/faf80e67-0559-4352-aaaa-fa547df6e787-kube-api-access-b7ws8\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.339291 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.339264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/faf80e67-0559-4352-aaaa-fa547df6e787-manifests\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.440651 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.440617 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/faf80e67-0559-4352-aaaa-fa547df6e787-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.440651 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.440652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7ws8\" (UniqueName: \"kubernetes.io/projected/faf80e67-0559-4352-aaaa-fa547df6e787-kube-api-access-b7ws8\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.440853 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.440673 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/faf80e67-0559-4352-aaaa-fa547df6e787-manifests\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.440853 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.440796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/faf80e67-0559-4352-aaaa-fa547df6e787-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.440853 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.440840 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/faf80e67-0559-4352-aaaa-fa547df6e787-tmp\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.441142 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.441116 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/faf80e67-0559-4352-aaaa-fa547df6e787-manifests\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.443114 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.443092 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/faf80e67-0559-4352-aaaa-fa547df6e787-tmp\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.443192 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.443138 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/faf80e67-0559-4352-aaaa-fa547df6e787-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.443192 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.443157 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/faf80e67-0559-4352-aaaa-fa547df6e787-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.450040 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.450018 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7ws8\" (UniqueName: \"kubernetes.io/projected/faf80e67-0559-4352-aaaa-fa547df6e787-kube-api-access-b7ws8\") pod \"opendatahub-operator-controller-manager-5bd696597f-k54zh\" (UID: \"faf80e67-0559-4352-aaaa-fa547df6e787\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.520541 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.520521 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:00.664088 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:00.664058 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh"] Jul 09 16:26:00.667001 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:26:00.666971 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf80e67_0559_4352_aaaa_fa547df6e787.slice/crio-6aeb02c65d43e8a35d342d47c0cdd33551793cf2683d77810a6e38d4ff3ad77e WatchSource:0}: Error finding container 6aeb02c65d43e8a35d342d47c0cdd33551793cf2683d77810a6e38d4ff3ad77e: Status 404 returned error can't find the container with id 6aeb02c65d43e8a35d342d47c0cdd33551793cf2683d77810a6e38d4ff3ad77e Jul 09 16:26:01.237744 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:01.237709 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" event={"ID":"faf80e67-0559-4352-aaaa-fa547df6e787","Type":"ContainerStarted","Data":"6aeb02c65d43e8a35d342d47c0cdd33551793cf2683d77810a6e38d4ff3ad77e"} Jul 09 16:26:04.254098 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:04.253997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" event={"ID":"faf80e67-0559-4352-aaaa-fa547df6e787","Type":"ContainerStarted","Data":"4d154c2c3c1e780e938472a57a399c5b5a597669b26ae6986c639bc63927a03e"} Jul 09 16:26:05.260788 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:05.260749 2579 generic.go:356] "Generic (PLEG): container finished" podID="faf80e67-0559-4352-aaaa-fa547df6e787" containerID="4d154c2c3c1e780e938472a57a399c5b5a597669b26ae6986c639bc63927a03e" exitCode=0 Jul 09 16:26:05.261263 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:05.260804 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" event={"ID":"faf80e67-0559-4352-aaaa-fa547df6e787","Type":"ContainerDied","Data":"4d154c2c3c1e780e938472a57a399c5b5a597669b26ae6986c639bc63927a03e"} Jul 09 16:26:06.266303 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:06.266264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" event={"ID":"faf80e67-0559-4352-aaaa-fa547df6e787","Type":"ContainerStarted","Data":"5f2c3620b3a2f846c235fdaf89f7c7e183ac0501803848dd5db5646d822e58b4"} Jul 09 16:26:06.266660 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:06.266395 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:06.313482 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:06.313428 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" podStartSLOduration=1.498247728 podStartE2EDuration="6.313410196s" totalImagesPullingTime="3.765549866s" totalInitContainerRuntime="1.049612602s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:26:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:26:06.309077518 +0000 UTC m=+391.227648847" watchObservedRunningTime="2026-07-09 16:26:06.313410196 +0000 UTC m=+391.231981527" Jul 09 16:26:17.271789 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:17.271757 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bd696597f-k54zh" Jul 09 16:26:28.189634 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.189604 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-868f9f885b-6xghb"] Jul 09 16:26:28.192826 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.192807 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" Jul 09 16:26:28.196240 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.196220 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 16:26:28.196665 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.196649 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9pdjd\"" Jul 09 16:26:28.197213 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.197197 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 16:26:28.197616 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.197603 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 16:26:28.197752 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.197737 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 16:26:28.214514 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.214484 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-868f9f885b-6xghb"] Jul 09 16:26:28.254727 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.254697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab106f1e-fa20-4f55-8eea-0a85c23723aa-tls-certs\") pod \"kube-auth-proxy-868f9f885b-6xghb\" (UID: \"ab106f1e-fa20-4f55-8eea-0a85c23723aa\") " pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" Jul 09 16:26:28.254846 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.254737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp6vx\" (UniqueName: \"kubernetes.io/projected/ab106f1e-fa20-4f55-8eea-0a85c23723aa-kube-api-access-rp6vx\") pod \"kube-auth-proxy-868f9f885b-6xghb\" (UID: \"ab106f1e-fa20-4f55-8eea-0a85c23723aa\") " pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" Jul 09 16:26:28.254846 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.254818 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab106f1e-fa20-4f55-8eea-0a85c23723aa-tmp\") pod \"kube-auth-proxy-868f9f885b-6xghb\" (UID: \"ab106f1e-fa20-4f55-8eea-0a85c23723aa\") " pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" Jul 09 16:26:28.355567 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.355535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab106f1e-fa20-4f55-8eea-0a85c23723aa-tmp\") pod \"kube-auth-proxy-868f9f885b-6xghb\" (UID: \"ab106f1e-fa20-4f55-8eea-0a85c23723aa\") " pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" Jul 09 16:26:28.355719 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.355583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab106f1e-fa20-4f55-8eea-0a85c23723aa-tls-certs\") pod \"kube-auth-proxy-868f9f885b-6xghb\" (UID: \"ab106f1e-fa20-4f55-8eea-0a85c23723aa\") " pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" Jul 09 16:26:28.355719 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.355606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp6vx\" (UniqueName: \"kubernetes.io/projected/ab106f1e-fa20-4f55-8eea-0a85c23723aa-kube-api-access-rp6vx\") pod \"kube-auth-proxy-868f9f885b-6xghb\" (UID: \"ab106f1e-fa20-4f55-8eea-0a85c23723aa\") " pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" Jul 09 16:26:28.357789 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.357751 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab106f1e-fa20-4f55-8eea-0a85c23723aa-tmp\") pod \"kube-auth-proxy-868f9f885b-6xghb\" (UID: \"ab106f1e-fa20-4f55-8eea-0a85c23723aa\") " pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" Jul 09 16:26:28.357960 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.357939 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab106f1e-fa20-4f55-8eea-0a85c23723aa-tls-certs\") pod \"kube-auth-proxy-868f9f885b-6xghb\" (UID: \"ab106f1e-fa20-4f55-8eea-0a85c23723aa\") " pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" Jul 09 16:26:28.363547 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.363525 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp6vx\" (UniqueName: \"kubernetes.io/projected/ab106f1e-fa20-4f55-8eea-0a85c23723aa-kube-api-access-rp6vx\") pod \"kube-auth-proxy-868f9f885b-6xghb\" (UID: \"ab106f1e-fa20-4f55-8eea-0a85c23723aa\") " pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" Jul 09 16:26:28.502437 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.502362 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" Jul 09 16:26:28.632993 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:28.632921 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-868f9f885b-6xghb"] Jul 09 16:26:28.635046 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:26:28.635019 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab106f1e_fa20_4f55_8eea_0a85c23723aa.slice/crio-19e2fa58b11812bf4bc275037a392359af65d84f33c0a621417ddebc2873e200 WatchSource:0}: Error finding container 19e2fa58b11812bf4bc275037a392359af65d84f33c0a621417ddebc2873e200: Status 404 returned error can't find the container with id 19e2fa58b11812bf4bc275037a392359af65d84f33c0a621417ddebc2873e200 Jul 09 16:26:29.349408 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.349367 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" event={"ID":"ab106f1e-fa20-4f55-8eea-0a85c23723aa","Type":"ContainerStarted","Data":"19e2fa58b11812bf4bc275037a392359af65d84f33c0a621417ddebc2873e200"} Jul 09 16:26:29.696065 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.695985 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx"] Jul 09 16:26:29.700242 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.700225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.703329 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.703310 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 16:26:29.703943 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.703927 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 16:26:29.704149 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.704134 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 16:26:29.708817 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.708799 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w2h2w\"" Jul 09 16:26:29.710675 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.710660 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 16:26:29.715604 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.715584 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx"] Jul 09 16:26:29.769246 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.769215 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.769400 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.769266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th8dk\" (UniqueName: \"kubernetes.io/projected/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-kube-api-access-th8dk\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.769400 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.769346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.769400 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.769380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.769562 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.769431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.769562 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.769445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.769562 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.769469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.870329 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.870291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.870483 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.870346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.870483 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.870368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8dk\" (UniqueName: \"kubernetes.io/projected/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-kube-api-access-th8dk\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.870483 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.870398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.870483 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.870426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.870676 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.870483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.870676 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.870520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.871125 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.871098 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.872859 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.872834 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.873062 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.873041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.873129 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.873112 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.873129 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.873122 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.878676 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.878653 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:29.878929 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:29.878913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th8dk\" (UniqueName: \"kubernetes.io/projected/6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6-kube-api-access-th8dk\") pod \"istiod-openshift-gateway-94bb8fbfd-mrdzx\" (UID: \"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:30.008861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:30.008784 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:30.143787 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:30.143753 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx"] Jul 09 16:26:30.146365 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:26:30.146336 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed2cff4_c9d7_4dde_ab4e_bfc4c7f497f6.slice/crio-cff03acd1584d4f7bf83f95579bd0c4afd9d43b3d4fe71f1739a825f77244d71 WatchSource:0}: Error finding container cff03acd1584d4f7bf83f95579bd0c4afd9d43b3d4fe71f1739a825f77244d71: Status 404 returned error can't find the container with id cff03acd1584d4f7bf83f95579bd0c4afd9d43b3d4fe71f1739a825f77244d71 Jul 09 16:26:30.356147 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:30.356099 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" event={"ID":"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6","Type":"ContainerStarted","Data":"cff03acd1584d4f7bf83f95579bd0c4afd9d43b3d4fe71f1739a825f77244d71"} Jul 09 16:26:32.368490 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:32.368408 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" event={"ID":"ab106f1e-fa20-4f55-8eea-0a85c23723aa","Type":"ContainerStarted","Data":"3fcbdcbe8094eabce0bf7c19f4de941a87935bcfc2adca315f2a82bb9ce4ebdc"} Jul 09 16:26:32.421546 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:32.421491 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-868f9f885b-6xghb" podStartSLOduration=1.260302244 podStartE2EDuration="4.421471732s" totalImagesPullingTime="3.161169488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:26:32.419887428 +0000 UTC m=+417.338458759" watchObservedRunningTime="2026-07-09 16:26:32.421471732 +0000 UTC m=+417.340043070" Jul 09 16:26:33.224373 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.224337 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b"] Jul 09 16:26:33.231410 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.231382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" Jul 09 16:26:33.235338 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.235306 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pz2rt\"" Jul 09 16:26:33.235489 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.235453 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 16:26:33.253386 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.253319 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b"] Jul 09 16:26:33.254943 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.254914 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw"] Jul 09 16:26:33.258530 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.258498 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" Jul 09 16:26:33.264023 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.263921 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 09 16:26:33.273061 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.272999 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-p74vf\"" Jul 09 16:26:33.282862 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.282833 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw"] Jul 09 16:26:33.304211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.304179 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04024ae3-234a-4cda-9e8c-8ba7ab2b2c34-cert\") pod \"kserve-controller-manager-d6f4b65b8-p7n7b\" (UID: \"04024ae3-234a-4cda-9e8c-8ba7ab2b2c34\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" Jul 09 16:26:33.304412 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.304243 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4s9s\" (UniqueName: \"kubernetes.io/projected/7015bcc1-1c04-48cd-8c7a-5620d59be538-kube-api-access-r4s9s\") pod \"llmisvc-controller-manager-777c6bd7d5-bwvhw\" (UID: \"7015bcc1-1c04-48cd-8c7a-5620d59be538\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" Jul 09 16:26:33.304412 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.304295 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg5tn\" (UniqueName: \"kubernetes.io/projected/04024ae3-234a-4cda-9e8c-8ba7ab2b2c34-kube-api-access-mg5tn\") pod \"kserve-controller-manager-d6f4b65b8-p7n7b\" (UID: \"04024ae3-234a-4cda-9e8c-8ba7ab2b2c34\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" Jul 09 16:26:33.304412 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.304318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7015bcc1-1c04-48cd-8c7a-5620d59be538-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bwvhw\" (UID: \"7015bcc1-1c04-48cd-8c7a-5620d59be538\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" Jul 09 16:26:33.404904 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.404874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04024ae3-234a-4cda-9e8c-8ba7ab2b2c34-cert\") pod \"kserve-controller-manager-d6f4b65b8-p7n7b\" (UID: \"04024ae3-234a-4cda-9e8c-8ba7ab2b2c34\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" Jul 09 16:26:33.405369 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.404941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4s9s\" (UniqueName: \"kubernetes.io/projected/7015bcc1-1c04-48cd-8c7a-5620d59be538-kube-api-access-r4s9s\") pod \"llmisvc-controller-manager-777c6bd7d5-bwvhw\" (UID: \"7015bcc1-1c04-48cd-8c7a-5620d59be538\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" Jul 09 16:26:33.405369 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.405017 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg5tn\" (UniqueName: \"kubernetes.io/projected/04024ae3-234a-4cda-9e8c-8ba7ab2b2c34-kube-api-access-mg5tn\") pod \"kserve-controller-manager-d6f4b65b8-p7n7b\" (UID: \"04024ae3-234a-4cda-9e8c-8ba7ab2b2c34\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" Jul 09 16:26:33.405369 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.405042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7015bcc1-1c04-48cd-8c7a-5620d59be538-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bwvhw\" (UID: \"7015bcc1-1c04-48cd-8c7a-5620d59be538\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" Jul 09 16:26:33.405528 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:26:33.405507 2579 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 09 16:26:33.405602 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:26:33.405580 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04024ae3-234a-4cda-9e8c-8ba7ab2b2c34-cert podName:04024ae3-234a-4cda-9e8c-8ba7ab2b2c34 nodeName:}" failed. No retries permitted until 2026-07-09 16:26:33.905557816 +0000 UTC m=+418.824129147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/04024ae3-234a-4cda-9e8c-8ba7ab2b2c34-cert") pod "kserve-controller-manager-d6f4b65b8-p7n7b" (UID: "04024ae3-234a-4cda-9e8c-8ba7ab2b2c34") : secret "kserve-webhook-server-cert" not found Jul 09 16:26:33.412983 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.412945 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7015bcc1-1c04-48cd-8c7a-5620d59be538-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bwvhw\" (UID: \"7015bcc1-1c04-48cd-8c7a-5620d59be538\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" Jul 09 16:26:33.418369 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.418338 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4s9s\" (UniqueName: \"kubernetes.io/projected/7015bcc1-1c04-48cd-8c7a-5620d59be538-kube-api-access-r4s9s\") pod \"llmisvc-controller-manager-777c6bd7d5-bwvhw\" (UID: \"7015bcc1-1c04-48cd-8c7a-5620d59be538\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" Jul 09 16:26:33.425524 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.425496 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg5tn\" (UniqueName: \"kubernetes.io/projected/04024ae3-234a-4cda-9e8c-8ba7ab2b2c34-kube-api-access-mg5tn\") pod \"kserve-controller-manager-d6f4b65b8-p7n7b\" (UID: \"04024ae3-234a-4cda-9e8c-8ba7ab2b2c34\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" Jul 09 16:26:33.569905 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.569869 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" Jul 09 16:26:33.694773 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.694570 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:26:33.694773 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.694666 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:26:33.798465 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.798441 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw"] Jul 09 16:26:33.800190 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:26:33.800161 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7015bcc1_1c04_48cd_8c7a_5620d59be538.slice/crio-f70f144636037d2fea39528ba97ada60c468164445736a1f153d15c9516421f8 WatchSource:0}: Error finding container f70f144636037d2fea39528ba97ada60c468164445736a1f153d15c9516421f8: Status 404 returned error can't find the container with id f70f144636037d2fea39528ba97ada60c468164445736a1f153d15c9516421f8 Jul 09 16:26:33.910240 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.910142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04024ae3-234a-4cda-9e8c-8ba7ab2b2c34-cert\") pod \"kserve-controller-manager-d6f4b65b8-p7n7b\" (UID: \"04024ae3-234a-4cda-9e8c-8ba7ab2b2c34\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" Jul 09 16:26:33.912607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:33.912578 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04024ae3-234a-4cda-9e8c-8ba7ab2b2c34-cert\") pod \"kserve-controller-manager-d6f4b65b8-p7n7b\" (UID: \"04024ae3-234a-4cda-9e8c-8ba7ab2b2c34\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" Jul 09 16:26:34.144660 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:34.144616 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" Jul 09 16:26:34.293703 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:34.293665 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b"] Jul 09 16:26:34.296595 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:26:34.296572 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04024ae3_234a_4cda_9e8c_8ba7ab2b2c34.slice/crio-594a0ee1f96953e805c13e95f351a9084649f467c745be42a22fc1f9e872899e WatchSource:0}: Error finding container 594a0ee1f96953e805c13e95f351a9084649f467c745be42a22fc1f9e872899e: Status 404 returned error can't find the container with id 594a0ee1f96953e805c13e95f351a9084649f467c745be42a22fc1f9e872899e Jul 09 16:26:34.377598 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:34.377558 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" event={"ID":"04024ae3-234a-4cda-9e8c-8ba7ab2b2c34","Type":"ContainerStarted","Data":"594a0ee1f96953e805c13e95f351a9084649f467c745be42a22fc1f9e872899e"} Jul 09 16:26:34.379718 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:34.379213 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" event={"ID":"6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6","Type":"ContainerStarted","Data":"15aa9792181cace5d37a8dade61dbb4f8165499f752ee6e4a6bdbc9de95dce2c"} Jul 09 16:26:34.379718 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:34.379269 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:34.380743 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:34.380714 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" event={"ID":"7015bcc1-1c04-48cd-8c7a-5620d59be538","Type":"ContainerStarted","Data":"f70f144636037d2fea39528ba97ada60c468164445736a1f153d15c9516421f8"} Jul 09 16:26:34.381140 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:34.381115 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-mrdzx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 16:26:34.381208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:34.381167 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" podUID="6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 16:26:34.406162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:34.406113 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" podStartSLOduration=1.860261561 podStartE2EDuration="5.406096977s" totalImagesPullingTime="3.545835416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:26:34.405937928 +0000 UTC m=+419.324509257" watchObservedRunningTime="2026-07-09 16:26:34.406096977 +0000 UTC m=+419.324668308" Jul 09 16:26:35.399422 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:35.398955 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-mrdzx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 16:26:35.399422 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:35.399050 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" podUID="6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 16:26:36.683756 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.682457 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz"] Jul 09 16:26:36.685108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.685086 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.690445 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.690411 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kxrf2\"" Jul 09 16:26:36.736402 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.736347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.736402 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.736399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.736731 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.736504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.736731 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.736575 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f638b40f-3d4f-43c1-b946-d708b18df685-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.736731 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.736614 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.736731 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.736670 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f638b40f-3d4f-43c1-b946-d708b18df685-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.736993 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.736746 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt27c\" (UniqueName: \"kubernetes.io/projected/f638b40f-3d4f-43c1-b946-d708b18df685-kube-api-access-qt27c\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.736993 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.736883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.736993 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.736945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f638b40f-3d4f-43c1-b946-d708b18df685-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.809532 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.808920 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz"] Jul 09 16:26:36.837616 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.837575 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f638b40f-3d4f-43c1-b946-d708b18df685-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.837774 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.837636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt27c\" (UniqueName: \"kubernetes.io/projected/f638b40f-3d4f-43c1-b946-d708b18df685-kube-api-access-qt27c\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.837774 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.837665 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.837774 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.837683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f638b40f-3d4f-43c1-b946-d708b18df685-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.837774 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.837713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.837774 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.837737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.838059 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.837801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.838059 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.837857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f638b40f-3d4f-43c1-b946-d708b18df685-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.838059 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.837897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.838211 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.838136 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.838393 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.838369 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.838478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.838447 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.838478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.838470 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.838769 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.838744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f638b40f-3d4f-43c1-b946-d708b18df685-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.840660 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.840607 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f638b40f-3d4f-43c1-b946-d708b18df685-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.840660 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.840609 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f638b40f-3d4f-43c1-b946-d708b18df685-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.856419 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.856387 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f638b40f-3d4f-43c1-b946-d708b18df685-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.856572 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.856489 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt27c\" (UniqueName: \"kubernetes.io/projected/f638b40f-3d4f-43c1-b946-d708b18df685-kube-api-access-qt27c\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42bqxz\" (UID: \"f638b40f-3d4f-43c1-b946-d708b18df685\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:36.999467 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:36.999373 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:37.582060 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:37.582033 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz"] Jul 09 16:26:37.582185 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:26:37.582159 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf638b40f_3d4f_43c1_b946_d708b18df685.slice/crio-a7d4d57dca7f5326dd5101def5fad151b43a7531caa0d52362826d87ab70c04d WatchSource:0}: Error finding container a7d4d57dca7f5326dd5101def5fad151b43a7531caa0d52362826d87ab70c04d: Status 404 returned error can't find the container with id a7d4d57dca7f5326dd5101def5fad151b43a7531caa0d52362826d87ab70c04d Jul 09 16:26:38.389142 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:38.389107 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrdzx" Jul 09 16:26:38.404810 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:38.404775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" event={"ID":"7015bcc1-1c04-48cd-8c7a-5620d59be538","Type":"ContainerStarted","Data":"e2d8a41c60966e9bb6299cb443794645ce42eea9ce3b845336a5cfc94b43cc31"} Jul 09 16:26:38.404939 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:38.404835 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" Jul 09 16:26:38.406157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:38.406132 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" event={"ID":"04024ae3-234a-4cda-9e8c-8ba7ab2b2c34","Type":"ContainerStarted","Data":"39e112696483d5daad7b223d4e547f880b9a2705133091ccb59a20b0cf4de01e"} Jul 09 16:26:38.406228 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:38.406182 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" Jul 09 16:26:38.407161 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:38.407142 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" event={"ID":"f638b40f-3d4f-43c1-b946-d708b18df685","Type":"ContainerStarted","Data":"a7d4d57dca7f5326dd5101def5fad151b43a7531caa0d52362826d87ab70c04d"} Jul 09 16:26:38.435765 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:38.435709 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" podStartSLOduration=1.854845071 podStartE2EDuration="5.435690307s" totalImagesPullingTime="3.580845236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:26:38.432798247 +0000 UTC m=+423.351369579" watchObservedRunningTime="2026-07-09 16:26:38.435690307 +0000 UTC m=+423.354261639" Jul 09 16:26:38.456347 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:38.456293 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" podStartSLOduration=2.377511341 podStartE2EDuration="5.456273407s" totalImagesPullingTime="3.078762066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:26:38.453898582 +0000 UTC m=+423.372469923" watchObservedRunningTime="2026-07-09 16:26:38.456273407 +0000 UTC m=+423.374844740" Jul 09 16:26:41.241333 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:41.241297 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:26:41.241693 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:41.241380 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:26:41.241693 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:41.241422 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:26:41.424725 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:41.424682 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" event={"ID":"f638b40f-3d4f-43c1-b946-d708b18df685","Type":"ContainerStarted","Data":"4d432324644103f858a448b39aab05953941269d4733983bc453dea63f535fb9"} Jul 09 16:26:41.451628 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:41.451580 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" podStartSLOduration=1.794699741 podStartE2EDuration="5.45156323s" totalImagesPullingTime="3.656863489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:26:41.450387531 +0000 UTC m=+426.368958864" watchObservedRunningTime="2026-07-09 16:26:41.45156323 +0000 UTC m=+426.370134562" Jul 09 16:26:42.000503 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:42.000462 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:42.001893 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:42.001870 2579 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6576859cf42bqxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body= Jul 09 16:26:42.001972 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:42.001951 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" podUID="f638b40f-3d4f-43c1-b946-d708b18df685" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" Jul 09 16:26:43.003571 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:43.003536 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:43.432385 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:43.432355 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:26:43.433452 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:26:43.433433 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42bqxz" Jul 09 16:27:09.415108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:09.415032 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bwvhw" Jul 09 16:27:09.417868 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:09.417845 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p7n7b" Jul 09 16:27:16.210423 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.210383 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc48bccdd-ncz62"] Jul 09 16:27:16.226596 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.226568 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc48bccdd-ncz62"] Jul 09 16:27:16.226751 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.226677 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.229442 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.229413 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 16:27:16.230485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.230463 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 16:27:16.230639 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.230514 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 16:27:16.230744 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.230677 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 16:27:16.230744 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.230519 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 16:27:16.230744 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.230619 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tpmbb\"" Jul 09 16:27:16.230894 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.230681 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 16:27:16.230894 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.230603 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 16:27:16.235691 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.235668 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 16:27:16.269079 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.269051 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59fa6de1-0010-4f99-9203-8198f35e0035-service-ca\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.269206 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.269082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59fa6de1-0010-4f99-9203-8198f35e0035-console-oauth-config\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.269206 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.269099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59fa6de1-0010-4f99-9203-8198f35e0035-console-config\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.269206 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.269116 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59fa6de1-0010-4f99-9203-8198f35e0035-trusted-ca-bundle\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.269206 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.269138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rxgk\" (UniqueName: \"kubernetes.io/projected/59fa6de1-0010-4f99-9203-8198f35e0035-kube-api-access-6rxgk\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.269393 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.269239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59fa6de1-0010-4f99-9203-8198f35e0035-oauth-serving-cert\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.269393 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.269281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59fa6de1-0010-4f99-9203-8198f35e0035-console-serving-cert\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.370125 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.370099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59fa6de1-0010-4f99-9203-8198f35e0035-service-ca\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.370283 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.370136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59fa6de1-0010-4f99-9203-8198f35e0035-console-oauth-config\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.370283 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.370166 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59fa6de1-0010-4f99-9203-8198f35e0035-console-config\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.370283 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.370188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59fa6de1-0010-4f99-9203-8198f35e0035-trusted-ca-bundle\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.370283 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.370212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rxgk\" (UniqueName: \"kubernetes.io/projected/59fa6de1-0010-4f99-9203-8198f35e0035-kube-api-access-6rxgk\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.370283 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.370265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59fa6de1-0010-4f99-9203-8198f35e0035-oauth-serving-cert\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.370513 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.370299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59fa6de1-0010-4f99-9203-8198f35e0035-console-serving-cert\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.370917 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.370890 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59fa6de1-0010-4f99-9203-8198f35e0035-service-ca\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.371041 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.370920 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59fa6de1-0010-4f99-9203-8198f35e0035-oauth-serving-cert\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.371041 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.370948 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59fa6de1-0010-4f99-9203-8198f35e0035-console-config\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.371164 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.371148 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59fa6de1-0010-4f99-9203-8198f35e0035-trusted-ca-bundle\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.372650 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.372618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59fa6de1-0010-4f99-9203-8198f35e0035-console-oauth-config\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.372855 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.372834 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59fa6de1-0010-4f99-9203-8198f35e0035-console-serving-cert\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.379297 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.379272 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rxgk\" (UniqueName: \"kubernetes.io/projected/59fa6de1-0010-4f99-9203-8198f35e0035-kube-api-access-6rxgk\") pod \"console-7dc48bccdd-ncz62\" (UID: \"59fa6de1-0010-4f99-9203-8198f35e0035\") " pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.537226 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.537191 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:16.673183 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:16.673149 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc48bccdd-ncz62"] Jul 09 16:27:16.676717 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:27:16.676688 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59fa6de1_0010_4f99_9203_8198f35e0035.slice/crio-45c814bacacf2368ed9d282d4903399f11af205ac76a4d503992ae61010f61d3 WatchSource:0}: Error finding container 45c814bacacf2368ed9d282d4903399f11af205ac76a4d503992ae61010f61d3: Status 404 returned error can't find the container with id 45c814bacacf2368ed9d282d4903399f11af205ac76a4d503992ae61010f61d3 Jul 09 16:27:17.572683 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:17.572647 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc48bccdd-ncz62" event={"ID":"59fa6de1-0010-4f99-9203-8198f35e0035","Type":"ContainerStarted","Data":"f28db6f5ee7b2d6e1f07ae33d60cb58d7fb9b9f1b91917956fad1f129c0f454b"} Jul 09 16:27:17.573092 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:17.572695 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc48bccdd-ncz62" event={"ID":"59fa6de1-0010-4f99-9203-8198f35e0035","Type":"ContainerStarted","Data":"45c814bacacf2368ed9d282d4903399f11af205ac76a4d503992ae61010f61d3"} Jul 09 16:27:17.592046 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:17.591974 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dc48bccdd-ncz62" podStartSLOduration=1.5919571110000001 podStartE2EDuration="1.591957111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:27:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:27:17.591603235 +0000 UTC m=+462.510174567" watchObservedRunningTime="2026-07-09 16:27:17.591957111 +0000 UTC m=+462.510528441" Jul 09 16:27:26.537999 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:26.537953 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:26.538392 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:26.538047 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:26.542567 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:26.542546 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:26.614952 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:26.614920 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dc48bccdd-ncz62" Jul 09 16:27:54.246628 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.246592 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb"] Jul 09 16:27:54.251022 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.250993 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:27:54.254956 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.254935 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 16:27:54.255650 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.255622 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g67bn\"" Jul 09 16:27:54.255757 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.255668 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 16:27:54.262895 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.262871 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb"] Jul 09 16:27:54.395875 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.395847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a98bf15-f52b-47bd-8f2d-0a033ea60d90-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqzcb\" (UID: \"2a98bf15-f52b-47bd-8f2d-0a033ea60d90\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:27:54.396071 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.395881 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bnlc\" (UniqueName: \"kubernetes.io/projected/2a98bf15-f52b-47bd-8f2d-0a033ea60d90-kube-api-access-9bnlc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqzcb\" (UID: \"2a98bf15-f52b-47bd-8f2d-0a033ea60d90\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:27:54.496296 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.496264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a98bf15-f52b-47bd-8f2d-0a033ea60d90-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqzcb\" (UID: \"2a98bf15-f52b-47bd-8f2d-0a033ea60d90\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:27:54.496445 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.496307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bnlc\" (UniqueName: \"kubernetes.io/projected/2a98bf15-f52b-47bd-8f2d-0a033ea60d90-kube-api-access-9bnlc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqzcb\" (UID: \"2a98bf15-f52b-47bd-8f2d-0a033ea60d90\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:27:54.496626 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.496603 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a98bf15-f52b-47bd-8f2d-0a033ea60d90-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqzcb\" (UID: \"2a98bf15-f52b-47bd-8f2d-0a033ea60d90\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:27:54.505204 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.505146 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bnlc\" (UniqueName: \"kubernetes.io/projected/2a98bf15-f52b-47bd-8f2d-0a033ea60d90-kube-api-access-9bnlc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pqzcb\" (UID: \"2a98bf15-f52b-47bd-8f2d-0a033ea60d90\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:27:54.561160 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.561139 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:27:54.690098 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.690072 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb"] Jul 09 16:27:54.691945 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:27:54.691918 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a98bf15_f52b_47bd_8f2d_0a033ea60d90.slice/crio-9db0f1e520066d4b3cb79b2ba7a4630f02895ac6dbc84104c99ce37afe3e4a06 WatchSource:0}: Error finding container 9db0f1e520066d4b3cb79b2ba7a4630f02895ac6dbc84104c99ce37afe3e4a06: Status 404 returned error can't find the container with id 9db0f1e520066d4b3cb79b2ba7a4630f02895ac6dbc84104c99ce37afe3e4a06 Jul 09 16:27:54.731018 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:27:54.730988 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" event={"ID":"2a98bf15-f52b-47bd-8f2d-0a033ea60d90","Type":"ContainerStarted","Data":"9db0f1e520066d4b3cb79b2ba7a4630f02895ac6dbc84104c99ce37afe3e4a06"} Jul 09 16:28:00.759319 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:00.759231 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" event={"ID":"2a98bf15-f52b-47bd-8f2d-0a033ea60d90","Type":"ContainerStarted","Data":"2f86dfcd25905b5f58586c33462ad5f0bedf95e79240a291df6daa870ec72457"} Jul 09 16:28:00.759663 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:00.759365 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:28:00.785485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:00.785437 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" podStartSLOduration=1.177402393 podStartE2EDuration="6.785422231s" totalImagesPullingTime="5.608019838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:28:00.784139612 +0000 UTC m=+505.702710934" watchObservedRunningTime="2026-07-09 16:28:00.785422231 +0000 UTC m=+505.703993562" Jul 09 16:28:11.765136 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:11.765103 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:28:13.587300 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.587266 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb"] Jul 09 16:28:13.587669 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.587425 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" podUID="2a98bf15-f52b-47bd-8f2d-0a033ea60d90" containerName="manager" containerID="cri-o://2f86dfcd25905b5f58586c33462ad5f0bedf95e79240a291df6daa870ec72457" gracePeriod=2 Jul 09 16:28:13.596468 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.596406 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb"] Jul 09 16:28:13.607074 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:28:13.607042 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"2a98bf15-f52b-47bd-8f2d-0a033ea60d90\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-pqzcb\": pods \"kuadrant-operator-controller-manager-8684c9ff49-pqzcb\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:28:13.625854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.625830 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml"] Jul 09 16:28:13.626171 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.626158 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a98bf15-f52b-47bd-8f2d-0a033ea60d90" containerName="manager" Jul 09 16:28:13.626218 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.626173 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a98bf15-f52b-47bd-8f2d-0a033ea60d90" containerName="manager" Jul 09 16:28:13.626264 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.626225 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a98bf15-f52b-47bd-8f2d-0a033ea60d90" containerName="manager" Jul 09 16:28:13.629134 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.629118 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" Jul 09 16:28:13.646552 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.646532 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml"] Jul 09 16:28:13.656823 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.656801 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn"] Jul 09 16:28:13.661267 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.661245 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn" Jul 09 16:28:13.664103 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.664081 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gsbl2\"" Jul 09 16:28:13.670115 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:28:13.669932 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pqzcb\" is forbidden: User \"system:node:ip-10-0-136-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-68.ec2.internal' and this object" podUID="2a98bf15-f52b-47bd-8f2d-0a033ea60d90" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:28:13.673094 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:28:13.673060 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pqzcb\" is forbidden: User \"system:node:ip-10-0-136-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-68.ec2.internal' and this object" podUID="2a98bf15-f52b-47bd-8f2d-0a033ea60d90" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:28:13.674410 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.674388 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn"] Jul 09 16:28:13.677819 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.677796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18e98f49-2540-4b33-afa5-aeb4a80b7049-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9zrml\" (UID: \"18e98f49-2540-4b33-afa5-aeb4a80b7049\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" Jul 09 16:28:13.677975 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.677949 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz2gx\" (UniqueName: \"kubernetes.io/projected/18e98f49-2540-4b33-afa5-aeb4a80b7049-kube-api-access-cz2gx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9zrml\" (UID: \"18e98f49-2540-4b33-afa5-aeb4a80b7049\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" Jul 09 16:28:13.778547 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.778520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-992pv\" (UniqueName: \"kubernetes.io/projected/43a03971-7a20-4e7a-ac3f-f35e60ce25ce-kube-api-access-992pv\") pod \"limitador-operator-controller-manager-859d7b78bd-284kn\" (UID: \"43a03971-7a20-4e7a-ac3f-f35e60ce25ce\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn" Jul 09 16:28:13.778671 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.778557 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18e98f49-2540-4b33-afa5-aeb4a80b7049-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9zrml\" (UID: \"18e98f49-2540-4b33-afa5-aeb4a80b7049\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" Jul 09 16:28:13.778727 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.778666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz2gx\" (UniqueName: \"kubernetes.io/projected/18e98f49-2540-4b33-afa5-aeb4a80b7049-kube-api-access-cz2gx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9zrml\" (UID: \"18e98f49-2540-4b33-afa5-aeb4a80b7049\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" Jul 09 16:28:13.778869 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.778854 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18e98f49-2540-4b33-afa5-aeb4a80b7049-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9zrml\" (UID: \"18e98f49-2540-4b33-afa5-aeb4a80b7049\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" Jul 09 16:28:13.792601 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.792571 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz2gx\" (UniqueName: \"kubernetes.io/projected/18e98f49-2540-4b33-afa5-aeb4a80b7049-kube-api-access-cz2gx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9zrml\" (UID: \"18e98f49-2540-4b33-afa5-aeb4a80b7049\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" Jul 09 16:28:13.821489 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.821462 2579 generic.go:356] "Generic (PLEG): container finished" podID="2a98bf15-f52b-47bd-8f2d-0a033ea60d90" containerID="2f86dfcd25905b5f58586c33462ad5f0bedf95e79240a291df6daa870ec72457" exitCode=0 Jul 09 16:28:13.836754 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.836733 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:28:13.879741 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.879676 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a98bf15-f52b-47bd-8f2d-0a033ea60d90-extensions-socket-volume\") pod \"2a98bf15-f52b-47bd-8f2d-0a033ea60d90\" (UID: \"2a98bf15-f52b-47bd-8f2d-0a033ea60d90\") " Jul 09 16:28:13.879741 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.879714 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bnlc\" (UniqueName: \"kubernetes.io/projected/2a98bf15-f52b-47bd-8f2d-0a033ea60d90-kube-api-access-9bnlc\") pod \"2a98bf15-f52b-47bd-8f2d-0a033ea60d90\" (UID: \"2a98bf15-f52b-47bd-8f2d-0a033ea60d90\") " Jul 09 16:28:13.879900 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.879885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-992pv\" (UniqueName: \"kubernetes.io/projected/43a03971-7a20-4e7a-ac3f-f35e60ce25ce-kube-api-access-992pv\") pod \"limitador-operator-controller-manager-859d7b78bd-284kn\" (UID: \"43a03971-7a20-4e7a-ac3f-f35e60ce25ce\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn" Jul 09 16:28:13.880169 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.880148 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a98bf15-f52b-47bd-8f2d-0a033ea60d90-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2a98bf15-f52b-47bd-8f2d-0a033ea60d90" (UID: "2a98bf15-f52b-47bd-8f2d-0a033ea60d90"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:28:13.882022 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.881991 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a98bf15-f52b-47bd-8f2d-0a033ea60d90-kube-api-access-9bnlc" (OuterVolumeSpecName: "kube-api-access-9bnlc") pod "2a98bf15-f52b-47bd-8f2d-0a033ea60d90" (UID: "2a98bf15-f52b-47bd-8f2d-0a033ea60d90"). InnerVolumeSpecName "kube-api-access-9bnlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:28:13.896021 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.895986 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh"] Jul 09 16:28:13.899268 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.899251 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" Jul 09 16:28:13.904944 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.904921 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-992pv\" (UniqueName: \"kubernetes.io/projected/43a03971-7a20-4e7a-ac3f-f35e60ce25ce-kube-api-access-992pv\") pod \"limitador-operator-controller-manager-859d7b78bd-284kn\" (UID: \"43a03971-7a20-4e7a-ac3f-f35e60ce25ce\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn" Jul 09 16:28:13.925593 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.925570 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh"] Jul 09 16:28:13.963259 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.963237 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" Jul 09 16:28:13.974434 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.974410 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn" Jul 09 16:28:13.980751 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.980724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xgrdh\" (UID: \"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" Jul 09 16:28:13.980835 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.980779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzg6k\" (UniqueName: \"kubernetes.io/projected/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd-kube-api-access-rzg6k\") pod \"kuadrant-operator-controller-manager-86878c769f-xgrdh\" (UID: \"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" Jul 09 16:28:13.980889 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.980858 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a98bf15-f52b-47bd-8f2d-0a033ea60d90-extensions-socket-volume\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:28:13.980889 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:13.980870 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bnlc\" (UniqueName: \"kubernetes.io/projected/2a98bf15-f52b-47bd-8f2d-0a033ea60d90-kube-api-access-9bnlc\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:28:14.081726 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.081687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xgrdh\" (UID: \"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" Jul 09 16:28:14.081857 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.081780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzg6k\" (UniqueName: \"kubernetes.io/projected/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd-kube-api-access-rzg6k\") pod \"kuadrant-operator-controller-manager-86878c769f-xgrdh\" (UID: \"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" Jul 09 16:28:14.082187 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.082161 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xgrdh\" (UID: \"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" Jul 09 16:28:14.104774 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.104744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzg6k\" (UniqueName: \"kubernetes.io/projected/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd-kube-api-access-rzg6k\") pod \"kuadrant-operator-controller-manager-86878c769f-xgrdh\" (UID: \"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" Jul 09 16:28:14.116176 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.116146 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml"] Jul 09 16:28:14.117153 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:28:14.117127 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e98f49_2540_4b33_afa5_aeb4a80b7049.slice/crio-060a324b8c74308683fda0e94c9bacc6401441e8f52c1910931105dc49f16150 WatchSource:0}: Error finding container 060a324b8c74308683fda0e94c9bacc6401441e8f52c1910931105dc49f16150: Status 404 returned error can't find the container with id 060a324b8c74308683fda0e94c9bacc6401441e8f52c1910931105dc49f16150 Jul 09 16:28:14.133785 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.133765 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn"] Jul 09 16:28:14.135186 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:28:14.135163 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a03971_7a20_4e7a_ac3f_f35e60ce25ce.slice/crio-2d2d058ed0f1869848008bf0a37ba22643f3f2a6b90307a4970f8a30dd804cec WatchSource:0}: Error finding container 2d2d058ed0f1869848008bf0a37ba22643f3f2a6b90307a4970f8a30dd804cec: Status 404 returned error can't find the container with id 2d2d058ed0f1869848008bf0a37ba22643f3f2a6b90307a4970f8a30dd804cec Jul 09 16:28:14.208108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.208080 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" Jul 09 16:28:14.342522 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.342495 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh"] Jul 09 16:28:14.344075 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:28:14.344052 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b45fc4_dd2d_4e0d_ab8d_7f61f02de6dd.slice/crio-0eb23618610288bb04ad04f5f51118575261aee293a9d30d74357dc8589efd2e WatchSource:0}: Error finding container 0eb23618610288bb04ad04f5f51118575261aee293a9d30d74357dc8589efd2e: Status 404 returned error can't find the container with id 0eb23618610288bb04ad04f5f51118575261aee293a9d30d74357dc8589efd2e Jul 09 16:28:14.828588 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.828565 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pqzcb" Jul 09 16:28:14.829000 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.828599 2579 scope.go:117] "RemoveContainer" containerID="2f86dfcd25905b5f58586c33462ad5f0bedf95e79240a291df6daa870ec72457" Jul 09 16:28:14.830424 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.830392 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" event={"ID":"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd","Type":"ContainerStarted","Data":"1b76f9996aa2deefb606a6a63f587fbaa9db7a44dfdeaf4e2ea2c93d57f2da18"} Jul 09 16:28:14.830534 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.830452 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" event={"ID":"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd","Type":"ContainerStarted","Data":"0eb23618610288bb04ad04f5f51118575261aee293a9d30d74357dc8589efd2e"} Jul 09 16:28:14.830607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.830528 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" Jul 09 16:28:14.831919 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.831896 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" event={"ID":"18e98f49-2540-4b33-afa5-aeb4a80b7049","Type":"ContainerStarted","Data":"bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e"} Jul 09 16:28:14.832067 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.831940 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" Jul 09 16:28:14.832067 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.831964 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" event={"ID":"18e98f49-2540-4b33-afa5-aeb4a80b7049","Type":"ContainerStarted","Data":"060a324b8c74308683fda0e94c9bacc6401441e8f52c1910931105dc49f16150"} Jul 09 16:28:14.833436 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.833385 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn" event={"ID":"43a03971-7a20-4e7a-ac3f-f35e60ce25ce","Type":"ContainerStarted","Data":"2d2d058ed0f1869848008bf0a37ba22643f3f2a6b90307a4970f8a30dd804cec"} Jul 09 16:28:14.898070 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.897991 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" podStartSLOduration=1.897970565 podStartE2EDuration="1.897970565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:28:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:28:14.895538808 +0000 UTC m=+519.814110140" watchObservedRunningTime="2026-07-09 16:28:14.897970565 +0000 UTC m=+519.816541897" Jul 09 16:28:14.898245 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:14.898128 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" podStartSLOduration=1.898118295 podStartE2EDuration="1.898118295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:28:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:28:14.874358331 +0000 UTC m=+519.792929686" watchObservedRunningTime="2026-07-09 16:28:14.898118295 +0000 UTC m=+519.816689628" Jul 09 16:28:15.764212 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:15.764182 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a98bf15-f52b-47bd-8f2d-0a033ea60d90" path="/var/lib/kubelet/pods/2a98bf15-f52b-47bd-8f2d-0a033ea60d90/volumes" Jul 09 16:28:15.839248 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:15.839164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn" event={"ID":"43a03971-7a20-4e7a-ac3f-f35e60ce25ce","Type":"ContainerStarted","Data":"bb2acadbcb5818456a5e370d802cdd07c129a778df7385d69eef38e1f93fe877"} Jul 09 16:28:15.839630 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:15.839255 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn" Jul 09 16:28:15.859832 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:15.859781 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn" podStartSLOduration=1.449546697 podStartE2EDuration="2.859767778s" totalImagesPullingTime="1.410221081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:28:15.859405507 +0000 UTC m=+520.777976838" watchObservedRunningTime="2026-07-09 16:28:15.859767778 +0000 UTC m=+520.778339108" Jul 09 16:28:25.842817 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:25.842770 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" Jul 09 16:28:25.843349 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:25.842849 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" Jul 09 16:28:25.930031 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:25.929984 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml"] Jul 09 16:28:25.930227 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:25.930194 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" podUID="18e98f49-2540-4b33-afa5-aeb4a80b7049" containerName="manager" containerID="cri-o://bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e" gracePeriod=10 Jul 09 16:28:26.174020 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.173982 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" Jul 09 16:28:26.292616 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.292582 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18e98f49-2540-4b33-afa5-aeb4a80b7049-extensions-socket-volume\") pod \"18e98f49-2540-4b33-afa5-aeb4a80b7049\" (UID: \"18e98f49-2540-4b33-afa5-aeb4a80b7049\") " Jul 09 16:28:26.292797 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.292651 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz2gx\" (UniqueName: \"kubernetes.io/projected/18e98f49-2540-4b33-afa5-aeb4a80b7049-kube-api-access-cz2gx\") pod \"18e98f49-2540-4b33-afa5-aeb4a80b7049\" (UID: \"18e98f49-2540-4b33-afa5-aeb4a80b7049\") " Jul 09 16:28:26.292979 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.292956 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e98f49-2540-4b33-afa5-aeb4a80b7049-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "18e98f49-2540-4b33-afa5-aeb4a80b7049" (UID: "18e98f49-2540-4b33-afa5-aeb4a80b7049"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:28:26.294533 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.294512 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e98f49-2540-4b33-afa5-aeb4a80b7049-kube-api-access-cz2gx" (OuterVolumeSpecName: "kube-api-access-cz2gx") pod "18e98f49-2540-4b33-afa5-aeb4a80b7049" (UID: "18e98f49-2540-4b33-afa5-aeb4a80b7049"). InnerVolumeSpecName "kube-api-access-cz2gx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:28:26.393679 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.393602 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18e98f49-2540-4b33-afa5-aeb4a80b7049-extensions-socket-volume\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:28:26.393679 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.393629 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz2gx\" (UniqueName: \"kubernetes.io/projected/18e98f49-2540-4b33-afa5-aeb4a80b7049-kube-api-access-cz2gx\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:28:26.852996 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.852966 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-284kn" Jul 09 16:28:26.897106 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.897072 2579 generic.go:356] "Generic (PLEG): container finished" podID="18e98f49-2540-4b33-afa5-aeb4a80b7049" containerID="bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e" exitCode=0 Jul 09 16:28:26.897273 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.897128 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" Jul 09 16:28:26.897273 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.897153 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" event={"ID":"18e98f49-2540-4b33-afa5-aeb4a80b7049","Type":"ContainerDied","Data":"bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e"} Jul 09 16:28:26.897273 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.897200 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml" event={"ID":"18e98f49-2540-4b33-afa5-aeb4a80b7049","Type":"ContainerDied","Data":"060a324b8c74308683fda0e94c9bacc6401441e8f52c1910931105dc49f16150"} Jul 09 16:28:26.897881 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.897221 2579 scope.go:117] "RemoveContainer" containerID="bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e" Jul 09 16:28:26.906641 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.906622 2579 scope.go:117] "RemoveContainer" containerID="bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e" Jul 09 16:28:26.906926 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:28:26.906906 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e\": container with ID starting with bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e not found: ID does not exist" containerID="bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e" Jul 09 16:28:26.906978 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.906934 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e"} err="failed to get container status \"bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e\": rpc error: code = NotFound desc = could not find container \"bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e\": container with ID starting with bfadd6c8972d5cf60fe23fe2a6e919d78d8340374b6661771f21bb61e4ecb25e not found: ID does not exist" Jul 09 16:28:26.940245 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.940220 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml"] Jul 09 16:28:26.945839 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:26.945815 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9zrml"] Jul 09 16:28:27.764668 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:27.764596 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18e98f49-2540-4b33-afa5-aeb4a80b7049" path="/var/lib/kubelet/pods/18e98f49-2540-4b33-afa5-aeb4a80b7049/volumes" Jul 09 16:28:42.524449 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.524413 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt"] Jul 09 16:28:42.524898 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.524803 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e98f49-2540-4b33-afa5-aeb4a80b7049" containerName="manager" Jul 09 16:28:42.524898 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.524817 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e98f49-2540-4b33-afa5-aeb4a80b7049" containerName="manager" Jul 09 16:28:42.524898 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.524874 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="18e98f49-2540-4b33-afa5-aeb4a80b7049" containerName="manager" Jul 09 16:28:42.527649 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.527629 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.530364 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.530340 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9pl6c\"" Jul 09 16:28:42.536389 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.536369 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84fk7\" (UniqueName: \"kubernetes.io/projected/6882e1ea-646c-468e-8666-e9bd84cce36a-kube-api-access-84fk7\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.536474 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.536420 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.536474 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.536460 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6882e1ea-646c-468e-8666-e9bd84cce36a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.536555 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.536485 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.536555 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.536519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.536555 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.536540 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.536663 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.536564 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6882e1ea-646c-468e-8666-e9bd84cce36a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.536663 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.536580 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6882e1ea-646c-468e-8666-e9bd84cce36a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.536663 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.536603 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.541257 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.541233 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt"] Jul 09 16:28:42.637675 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.637640 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.637675 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.637681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6882e1ea-646c-468e-8666-e9bd84cce36a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.637903 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.637707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.637903 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.637728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.637903 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.637834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.637903 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.637883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6882e1ea-646c-468e-8666-e9bd84cce36a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.638142 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.637911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6882e1ea-646c-468e-8666-e9bd84cce36a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.638142 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.637956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.638142 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.638001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84fk7\" (UniqueName: \"kubernetes.io/projected/6882e1ea-646c-468e-8666-e9bd84cce36a-kube-api-access-84fk7\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.638142 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.638103 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.638142 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.638128 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.638392 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.638258 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.638392 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.638347 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.638567 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.638549 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6882e1ea-646c-468e-8666-e9bd84cce36a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.640107 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.640073 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6882e1ea-646c-468e-8666-e9bd84cce36a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.640492 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.640474 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6882e1ea-646c-468e-8666-e9bd84cce36a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.645694 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.645672 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84fk7\" (UniqueName: \"kubernetes.io/projected/6882e1ea-646c-468e-8666-e9bd84cce36a-kube-api-access-84fk7\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.645797 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.645766 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6882e1ea-646c-468e-8666-e9bd84cce36a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wlzjt\" (UID: \"6882e1ea-646c-468e-8666-e9bd84cce36a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.838607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.838525 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:42.979022 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.978983 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt"] Jul 09 16:28:42.980780 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:28:42.980746 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6882e1ea_646c_468e_8666_e9bd84cce36a.slice/crio-33aafd3ffcf756774caf6f300e4a09a0ace1e12a62fceade3e2c811588fa9188 WatchSource:0}: Error finding container 33aafd3ffcf756774caf6f300e4a09a0ace1e12a62fceade3e2c811588fa9188: Status 404 returned error can't find the container with id 33aafd3ffcf756774caf6f300e4a09a0ace1e12a62fceade3e2c811588fa9188 Jul 09 16:28:42.982894 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.982863 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:28:42.982985 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.982935 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:28:42.983074 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:42.983021 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:28:43.971417 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:43.971380 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" event={"ID":"6882e1ea-646c-468e-8666-e9bd84cce36a","Type":"ContainerStarted","Data":"e924ab930d758f10febf83032eb7024cc9d0a12a7acb6635b1388109da8ed787"} Jul 09 16:28:43.971892 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:43.971446 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" event={"ID":"6882e1ea-646c-468e-8666-e9bd84cce36a","Type":"ContainerStarted","Data":"33aafd3ffcf756774caf6f300e4a09a0ace1e12a62fceade3e2c811588fa9188"} Jul 09 16:28:43.992547 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:43.992479 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" podStartSLOduration=1.992460801 podStartE2EDuration="1.992460801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:28:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:28:43.992178964 +0000 UTC m=+548.910750321" watchObservedRunningTime="2026-07-09 16:28:43.992460801 +0000 UTC m=+548.911032134" Jul 09 16:28:44.839236 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:44.839204 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:44.843948 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:44.843923 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:44.976795 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:44.976765 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:28:44.977554 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:28:44.977539 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:29:35.533708 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:29:35.533680 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:29:35.539547 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:29:35.539527 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:30:02.866953 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:02.866875 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nkzvf"] Jul 09 16:30:02.870177 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:02.870160 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" Jul 09 16:30:02.872855 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:02.872832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6fjj6\"" Jul 09 16:30:02.872980 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:02.872962 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 09 16:30:02.889747 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:02.889720 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nkzvf"] Jul 09 16:30:02.954909 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:02.954870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h29kg\" (UniqueName: \"kubernetes.io/projected/d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59-kube-api-access-h29kg\") pod \"payload-pre-processing-7964457696-nkzvf\" (UID: \"d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59\") " pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" Jul 09 16:30:02.955137 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:02.954974 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nkzvf\" (UID: \"d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59\") " pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" Jul 09 16:30:03.055892 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:03.055855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h29kg\" (UniqueName: \"kubernetes.io/projected/d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59-kube-api-access-h29kg\") pod \"payload-pre-processing-7964457696-nkzvf\" (UID: \"d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59\") " pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" Jul 09 16:30:03.056086 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:03.055997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nkzvf\" (UID: \"d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59\") " pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" Jul 09 16:30:03.056777 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:03.056755 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nkzvf\" (UID: \"d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59\") " pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" Jul 09 16:30:03.064549 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:03.064529 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h29kg\" (UniqueName: \"kubernetes.io/projected/d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59-kube-api-access-h29kg\") pod \"payload-pre-processing-7964457696-nkzvf\" (UID: \"d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59\") " pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" Jul 09 16:30:03.180745 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:03.180618 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" Jul 09 16:30:03.320747 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:03.320723 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nkzvf"] Jul 09 16:30:03.323430 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:30:03.323407 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b5d5cf_4d4c_467c_a542_0db2aaf1eb59.slice/crio-93dc08b1e9a5e34016b850f62bee862c136cab6ddf1ae328e8f07ccf73ff4a9a WatchSource:0}: Error finding container 93dc08b1e9a5e34016b850f62bee862c136cab6ddf1ae328e8f07ccf73ff4a9a: Status 404 returned error can't find the container with id 93dc08b1e9a5e34016b850f62bee862c136cab6ddf1ae328e8f07ccf73ff4a9a Jul 09 16:30:04.319736 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:04.319705 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" event={"ID":"d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59","Type":"ContainerStarted","Data":"93dc08b1e9a5e34016b850f62bee862c136cab6ddf1ae328e8f07ccf73ff4a9a"} Jul 09 16:30:06.329734 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:06.329695 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" event={"ID":"d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59","Type":"ContainerStarted","Data":"29e9170337e6b6fc4dc1937a87aec4df305bcd0241a5fc3f68ade87bce5f1779"} Jul 09 16:30:06.330227 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:06.329816 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" Jul 09 16:30:06.348984 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:06.348931 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" podStartSLOduration=2.28074549 podStartE2EDuration="4.348915549s" totalImagesPullingTime="2.068170059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:30:06.347681909 +0000 UTC m=+631.266253242" watchObservedRunningTime="2026-07-09 16:30:06.348915549 +0000 UTC m=+631.267486880" Jul 09 16:30:11.352909 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:11.352874 2579 generic.go:356] "Generic (PLEG): container finished" podID="6882e1ea-646c-468e-8666-e9bd84cce36a" containerID="e924ab930d758f10febf83032eb7024cc9d0a12a7acb6635b1388109da8ed787" exitCode=0 Jul 09 16:30:11.353340 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:11.352921 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" event={"ID":"6882e1ea-646c-468e-8666-e9bd84cce36a","Type":"ContainerDied","Data":"e924ab930d758f10febf83032eb7024cc9d0a12a7acb6635b1388109da8ed787"} Jul 09 16:30:11.353340 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:11.353270 2579 scope.go:117] "RemoveContainer" containerID="e924ab930d758f10febf83032eb7024cc9d0a12a7acb6635b1388109da8ed787" Jul 09 16:30:11.354184 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:11.354158 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:30:11.354238 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:11.354225 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:30:11.354276 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:11.354254 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:30:12.358845 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:12.358806 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" event={"ID":"6882e1ea-646c-468e-8666-e9bd84cce36a","Type":"ContainerStarted","Data":"e105c7515b9b6e50ba126f86488aaf7d2dd0ffbf0af4d65eaedd856fe7717a4c"} Jul 09 16:30:12.838860 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:12.838822 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:30:12.839957 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:12.839932 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wlzjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 09 16:30:12.840086 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:12.839981 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" podUID="6882e1ea-646c-468e-8666-e9bd84cce36a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 09 16:30:13.839939 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:13.839901 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wlzjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 09 16:30:13.840383 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:13.839960 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" podUID="6882e1ea-646c-468e-8666-e9bd84cce36a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 09 16:30:14.839263 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:14.839227 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wlzjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 09 16:30:14.839420 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:14.839299 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" podUID="6882e1ea-646c-468e-8666-e9bd84cce36a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 09 16:30:14.977743 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:14.977705 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:30:15.839476 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:15.839435 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wlzjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 09 16:30:15.839653 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:15.839498 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" podUID="6882e1ea-646c-468e-8666-e9bd84cce36a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 09 16:30:16.839545 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:16.839508 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wlzjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 09 16:30:16.839928 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:16.839563 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" podUID="6882e1ea-646c-468e-8666-e9bd84cce36a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 09 16:30:17.336982 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:17.336951 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-nkzvf" Jul 09 16:30:17.843961 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:17.843929 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:30:17.844851 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:17.844833 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wlzjt" Jul 09 16:30:39.029778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.029742 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp"] Jul 09 16:30:39.034022 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.033987 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.036927 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.036902 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 16:30:39.037057 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.036903 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 16:30:39.038148 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.038132 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2dlbw\"" Jul 09 16:30:39.038244 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.038169 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 09 16:30:39.044285 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.044260 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp"] Jul 09 16:30:39.220512 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.220453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.220688 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.220527 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.220688 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.220596 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.220688 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.220660 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhjtd\" (UniqueName: \"kubernetes.io/projected/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-kube-api-access-vhjtd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.220790 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.220746 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.220790 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.220779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.321927 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.321844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.321927 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.321916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhjtd\" (UniqueName: \"kubernetes.io/projected/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-kube-api-access-vhjtd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.322177 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.321974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.322177 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.322028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.322177 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.322066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.322177 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.322108 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.322425 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.322403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.322468 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.322407 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.322468 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.322444 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.324205 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.324181 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.324471 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.324455 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.330310 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.330285 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhjtd\" (UniqueName: \"kubernetes.io/projected/f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d-kube-api-access-vhjtd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xsfdp\" (UID: \"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.345144 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.345126 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:39.478145 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.478122 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp"] Jul 09 16:30:39.480471 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:30:39.480433 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63fd7fa_cd15_43f3_b3b1_fc37ea4d0f9d.slice/crio-caa9c10a0afe629103231972e784e04cbb573f1090c3304087028d423c83e4f9 WatchSource:0}: Error finding container caa9c10a0afe629103231972e784e04cbb573f1090c3304087028d423c83e4f9: Status 404 returned error can't find the container with id caa9c10a0afe629103231972e784e04cbb573f1090c3304087028d423c83e4f9 Jul 09 16:30:39.482084 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.482061 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:30:39.492567 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:39.492541 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" event={"ID":"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d","Type":"ContainerStarted","Data":"caa9c10a0afe629103231972e784e04cbb573f1090c3304087028d423c83e4f9"} Jul 09 16:30:41.508786 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:41.508745 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" event={"ID":"f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d","Type":"ContainerStarted","Data":"7cec1c67714cf5daa639a9210c0710399e247368cfd25a5251f2866a11acf77e"} Jul 09 16:30:41.530740 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:41.530681 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" podStartSLOduration=1.477413213 podStartE2EDuration="2.530661004s" totalImagesPullingTime="1.053247791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:30:41.528286698 +0000 UTC m=+666.446858029" watchObservedRunningTime="2026-07-09 16:30:41.530661004 +0000 UTC m=+666.449232336" Jul 09 16:30:49.345664 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:49.345625 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:49.346148 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:49.345725 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:49.358640 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:49.358610 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:30:49.555079 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:30:49.555051 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xsfdp" Jul 09 16:31:20.465633 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.465595 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6"] Jul 09 16:31:20.471962 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.471933 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.478166 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.478141 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 09 16:31:20.480722 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.480697 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6"] Jul 09 16:31:20.604456 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.604416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.604656 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.604530 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.604656 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.604568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.604656 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.604591 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.604656 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.604617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.604656 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.604649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh6qx\" (UniqueName: \"kubernetes.io/projected/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-kube-api-access-qh6qx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.705311 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.705272 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.705493 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.705356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.705493 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.705376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.705493 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.705391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.705493 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.705408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.705493 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.705438 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh6qx\" (UniqueName: \"kubernetes.io/projected/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-kube-api-access-qh6qx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.705836 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.705814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.705919 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.705885 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.705976 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.705935 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.707705 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.707678 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.707895 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.707880 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.714157 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.714132 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh6qx\" (UniqueName: \"kubernetes.io/projected/f0f01cb0-d90c-45b8-90cc-762b3ec6b398-kube-api-access-qh6qx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6\" (UID: \"f0f01cb0-d90c-45b8-90cc-762b3ec6b398\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.785322 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.785287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:20.917155 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:20.917127 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6"] Jul 09 16:31:20.919610 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:31:20.919580 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f01cb0_d90c_45b8_90cc_762b3ec6b398.slice/crio-989d144f19d2c9424632006f61d634dd7c50dfd36f459542e0f6a596f4d29f34 WatchSource:0}: Error finding container 989d144f19d2c9424632006f61d634dd7c50dfd36f459542e0f6a596f4d29f34: Status 404 returned error can't find the container with id 989d144f19d2c9424632006f61d634dd7c50dfd36f459542e0f6a596f4d29f34 Jul 09 16:31:21.691481 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:21.691446 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" event={"ID":"f0f01cb0-d90c-45b8-90cc-762b3ec6b398","Type":"ContainerStarted","Data":"26e1ad46850619cc20f9cd08c504bc8c600957a1e28f8ac10183e7b628f18691"} Jul 09 16:31:21.691895 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:21.691532 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" event={"ID":"f0f01cb0-d90c-45b8-90cc-762b3ec6b398","Type":"ContainerStarted","Data":"989d144f19d2c9424632006f61d634dd7c50dfd36f459542e0f6a596f4d29f34"} Jul 09 16:31:21.709234 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:21.709177 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" podStartSLOduration=1.478780591 podStartE2EDuration="1.709157383s" totalImagesPullingTime="230.376792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:31:21.708900056 +0000 UTC m=+706.627471385" watchObservedRunningTime="2026-07-09 16:31:21.709157383 +0000 UTC m=+706.627728716" Jul 09 16:31:26.846851 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.846819 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4"] Jul 09 16:31:26.850241 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.850225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.853150 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.853129 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 16:31:26.858355 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.858331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwbv9\" (UniqueName: \"kubernetes.io/projected/c6951061-dcbb-46ef-88e5-b8511a12878a-kube-api-access-rwbv9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.858460 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.858436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6951061-dcbb-46ef-88e5-b8511a12878a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.858515 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.858501 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6951061-dcbb-46ef-88e5-b8511a12878a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.858568 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.858534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6951061-dcbb-46ef-88e5-b8511a12878a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.858635 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.858610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6951061-dcbb-46ef-88e5-b8511a12878a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.858673 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.858657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6951061-dcbb-46ef-88e5-b8511a12878a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.861031 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.860114 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4"] Jul 09 16:31:26.959505 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.959466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6951061-dcbb-46ef-88e5-b8511a12878a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.959692 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.959522 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6951061-dcbb-46ef-88e5-b8511a12878a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.959692 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.959548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6951061-dcbb-46ef-88e5-b8511a12878a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.959692 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.959569 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6951061-dcbb-46ef-88e5-b8511a12878a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.959692 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.959592 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6951061-dcbb-46ef-88e5-b8511a12878a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.959692 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.959653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwbv9\" (UniqueName: \"kubernetes.io/projected/c6951061-dcbb-46ef-88e5-b8511a12878a-kube-api-access-rwbv9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.959994 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.959920 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6951061-dcbb-46ef-88e5-b8511a12878a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.959994 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.959950 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6951061-dcbb-46ef-88e5-b8511a12878a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.960149 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.960127 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6951061-dcbb-46ef-88e5-b8511a12878a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.961800 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.961775 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6951061-dcbb-46ef-88e5-b8511a12878a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.962204 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.962182 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6951061-dcbb-46ef-88e5-b8511a12878a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:26.967857 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:26.967827 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwbv9\" (UniqueName: \"kubernetes.io/projected/c6951061-dcbb-46ef-88e5-b8511a12878a-kube-api-access-rwbv9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-m6sx4\" (UID: \"c6951061-dcbb-46ef-88e5-b8511a12878a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:27.165418 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:27.165331 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:27.295636 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:27.295613 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4"] Jul 09 16:31:27.298047 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:31:27.298020 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6951061_dcbb_46ef_88e5_b8511a12878a.slice/crio-b386ea0cf1fe9e45b935f5a31c96287483adac9c642ddfe4f8ce752c6de21702 WatchSource:0}: Error finding container b386ea0cf1fe9e45b935f5a31c96287483adac9c642ddfe4f8ce752c6de21702: Status 404 returned error can't find the container with id b386ea0cf1fe9e45b935f5a31c96287483adac9c642ddfe4f8ce752c6de21702 Jul 09 16:31:27.723039 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:27.722983 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" event={"ID":"c6951061-dcbb-46ef-88e5-b8511a12878a","Type":"ContainerStarted","Data":"3d13f5893f0ec1543e9eeef6b77a090abde8326de2e83d2fa18a2a5f5756afc3"} Jul 09 16:31:27.723199 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:27.723065 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" event={"ID":"c6951061-dcbb-46ef-88e5-b8511a12878a","Type":"ContainerStarted","Data":"b386ea0cf1fe9e45b935f5a31c96287483adac9c642ddfe4f8ce752c6de21702"} Jul 09 16:31:27.742029 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:27.741926 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" podStartSLOduration=1.5574838130000002 podStartE2EDuration="1.741910165s" totalImagesPullingTime="184.426352ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:31:27.740199329 +0000 UTC m=+712.658770661" watchObservedRunningTime="2026-07-09 16:31:27.741910165 +0000 UTC m=+712.660481533" Jul 09 16:31:30.786235 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:30.786199 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:30.786691 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:30.786270 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:30.798710 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:30.798683 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:31.752991 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:31.752958 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6" Jul 09 16:31:37.165660 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:37.165619 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:37.166055 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:37.165686 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:37.178138 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:37.178111 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:31:37.779044 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:31:37.779001 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-m6sx4" Jul 09 16:34:35.564768 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:34:35.564696 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:34:35.566632 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:34:35.566611 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:38:16.253597 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:16.253554 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh"] Jul 09 16:38:16.256292 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:16.253797 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" podUID="94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd" containerName="manager" containerID="cri-o://1b76f9996aa2deefb606a6a63f587fbaa9db7a44dfdeaf4e2ea2c93d57f2da18" gracePeriod=10 Jul 09 16:38:19.625666 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:19.625623 2579 generic.go:356] "Generic (PLEG): container finished" podID="94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd" containerID="1b76f9996aa2deefb606a6a63f587fbaa9db7a44dfdeaf4e2ea2c93d57f2da18" exitCode=0 Jul 09 16:38:19.626062 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:19.625694 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" event={"ID":"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd","Type":"ContainerDied","Data":"1b76f9996aa2deefb606a6a63f587fbaa9db7a44dfdeaf4e2ea2c93d57f2da18"} Jul 09 16:38:19.811827 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:19.811798 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" Jul 09 16:38:19.948358 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:19.948260 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd-extensions-socket-volume\") pod \"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd\" (UID: \"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd\") " Jul 09 16:38:19.948529 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:19.948379 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzg6k\" (UniqueName: \"kubernetes.io/projected/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd-kube-api-access-rzg6k\") pod \"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd\" (UID: \"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd\") " Jul 09 16:38:19.948714 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:19.948685 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd" (UID: "94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:38:19.948839 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:19.948763 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd-extensions-socket-volume\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:38:19.950400 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:19.950374 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd-kube-api-access-rzg6k" (OuterVolumeSpecName: "kube-api-access-rzg6k") pod "94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd" (UID: "94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd"). InnerVolumeSpecName "kube-api-access-rzg6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:38:20.049967 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:20.049927 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzg6k\" (UniqueName: \"kubernetes.io/projected/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd-kube-api-access-rzg6k\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:38:20.631404 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:20.631376 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" Jul 09 16:38:20.631808 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:20.631376 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh" event={"ID":"94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd","Type":"ContainerDied","Data":"0eb23618610288bb04ad04f5f51118575261aee293a9d30d74357dc8589efd2e"} Jul 09 16:38:20.631808 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:20.631510 2579 scope.go:117] "RemoveContainer" containerID="1b76f9996aa2deefb606a6a63f587fbaa9db7a44dfdeaf4e2ea2c93d57f2da18" Jul 09 16:38:20.653675 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:20.653650 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh"] Jul 09 16:38:20.656871 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:20.656849 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xgrdh"] Jul 09 16:38:21.765063 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:38:21.765031 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd" path="/var/lib/kubelet/pods/94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd/volumes" Jul 09 16:39:17.436991 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.436902 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5"] Jul 09 16:39:17.437560 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.437311 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd" containerName="manager" Jul 09 16:39:17.437560 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.437323 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd" containerName="manager" Jul 09 16:39:17.437560 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.437403 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="94b45fc4-dd2d-4e0d-ab8d-7f61f02de6dd" containerName="manager" Jul 09 16:39:17.440422 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.440400 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" Jul 09 16:39:17.444305 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.444282 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g67bn\"" Jul 09 16:39:17.452577 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.452548 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5"] Jul 09 16:39:17.467338 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.467307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zp8s\" (UniqueName: \"kubernetes.io/projected/9bba78b7-9508-4213-a15a-f7fa2e519d40-kube-api-access-2zp8s\") pod \"kuadrant-operator-controller-manager-86878c769f-fbhd5\" (UID: \"9bba78b7-9508-4213-a15a-f7fa2e519d40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" Jul 09 16:39:17.467499 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.467378 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bba78b7-9508-4213-a15a-f7fa2e519d40-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fbhd5\" (UID: \"9bba78b7-9508-4213-a15a-f7fa2e519d40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" Jul 09 16:39:17.568854 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.568819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zp8s\" (UniqueName: \"kubernetes.io/projected/9bba78b7-9508-4213-a15a-f7fa2e519d40-kube-api-access-2zp8s\") pod \"kuadrant-operator-controller-manager-86878c769f-fbhd5\" (UID: \"9bba78b7-9508-4213-a15a-f7fa2e519d40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" Jul 09 16:39:17.569088 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.568867 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bba78b7-9508-4213-a15a-f7fa2e519d40-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fbhd5\" (UID: \"9bba78b7-9508-4213-a15a-f7fa2e519d40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" Jul 09 16:39:17.569247 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.569228 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bba78b7-9508-4213-a15a-f7fa2e519d40-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fbhd5\" (UID: \"9bba78b7-9508-4213-a15a-f7fa2e519d40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" Jul 09 16:39:17.579520 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.579495 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zp8s\" (UniqueName: \"kubernetes.io/projected/9bba78b7-9508-4213-a15a-f7fa2e519d40-kube-api-access-2zp8s\") pod \"kuadrant-operator-controller-manager-86878c769f-fbhd5\" (UID: \"9bba78b7-9508-4213-a15a-f7fa2e519d40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" Jul 09 16:39:17.753131 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.753055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" Jul 09 16:39:17.907621 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:17.907585 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5"] Jul 09 16:39:17.911867 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:39:17.911842 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bba78b7_9508_4213_a15a_f7fa2e519d40.slice/crio-0bd86031af4696a4d9c6b5ad6926b2bf3e56512c4c2b319d15073f4e6e5f770a WatchSource:0}: Error finding container 0bd86031af4696a4d9c6b5ad6926b2bf3e56512c4c2b319d15073f4e6e5f770a: Status 404 returned error can't find the container with id 0bd86031af4696a4d9c6b5ad6926b2bf3e56512c4c2b319d15073f4e6e5f770a Jul 09 16:39:18.891369 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:18.891331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" event={"ID":"9bba78b7-9508-4213-a15a-f7fa2e519d40","Type":"ContainerStarted","Data":"8a5007a1a1e9a5de5cab4728e2917e8f995098353b20cb0f3f4040317a5e91ee"} Jul 09 16:39:18.891842 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:18.891391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" event={"ID":"9bba78b7-9508-4213-a15a-f7fa2e519d40","Type":"ContainerStarted","Data":"0bd86031af4696a4d9c6b5ad6926b2bf3e56512c4c2b319d15073f4e6e5f770a"} Jul 09 16:39:18.891842 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:18.891448 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" Jul 09 16:39:18.911345 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:18.911300 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" podStartSLOduration=1.911287766 podStartE2EDuration="1.911287766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:39:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:39:18.909339176 +0000 UTC m=+1183.827910507" watchObservedRunningTime="2026-07-09 16:39:18.911287766 +0000 UTC m=+1183.829859098" Jul 09 16:39:29.899414 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:29.899383 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fbhd5" Jul 09 16:39:35.603931 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:35.603904 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:39:35.604473 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:39:35.603902 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:44:35.631208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:44:35.631180 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:44:35.632313 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:44:35.632290 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:45:45.136214 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.136175 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6"] Jul 09 16:45:45.140401 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.140378 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.143863 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.143840 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a5f599bc-openshift-default-dockercfg-hzdzg\"" Jul 09 16:45:45.153551 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.153529 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6"] Jul 09 16:45:45.250723 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.250678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqmnp\" (UniqueName: \"kubernetes.io/projected/e4bb439d-2f6e-41cd-a763-593e8b0c137b-kube-api-access-cqmnp\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.250917 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.250805 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-token\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.250917 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.250842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-envoy\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.250917 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.250876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-data\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.250917 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.250902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istiod-ca-cert\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.251178 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.250974 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-podinfo\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.251178 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.251049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-workload-certs\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.251178 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.251099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-credential-socket\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.251178 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.251137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-workload-socket\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.352623 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.352590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-data\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.352623 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.352627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istiod-ca-cert\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.352844 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.352649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-podinfo\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.352844 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.352687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-workload-certs\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.352844 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.352733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-credential-socket\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.352844 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.352769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-workload-socket\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.352844 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.352800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqmnp\" (UniqueName: \"kubernetes.io/projected/e4bb439d-2f6e-41cd-a763-593e8b0c137b-kube-api-access-cqmnp\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.353116 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.352855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-token\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.353116 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.352879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-envoy\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.353116 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.353062 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-data\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.353352 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.353311 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-workload-certs\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.353482 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.353379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-workload-socket\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.353482 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.353393 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-credential-socket\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.353607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.353584 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istiod-ca-cert\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.355093 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.355073 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-envoy\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.355213 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.355199 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-podinfo\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.361441 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.361422 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqmnp\" (UniqueName: \"kubernetes.io/projected/e4bb439d-2f6e-41cd-a763-593e8b0c137b-kube-api-access-cqmnp\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.361915 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.361897 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-token\") pod \"e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.450915 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.450843 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:45.586730 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.586704 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6"] Jul 09 16:45:45.589082 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:45:45.589049 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4bb439d_2f6e_41cd_a763_593e8b0c137b.slice/crio-eb47ceb77333488024c28dbafe06b35250e0a03dcef0f68232cab0ccad45f7aa WatchSource:0}: Error finding container eb47ceb77333488024c28dbafe06b35250e0a03dcef0f68232cab0ccad45f7aa: Status 404 returned error can't find the container with id eb47ceb77333488024c28dbafe06b35250e0a03dcef0f68232cab0ccad45f7aa Jul 09 16:45:45.591716 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.591677 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:45:45.591804 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.591767 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:45:45.591850 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.591813 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:45:45.688362 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.688327 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" event={"ID":"e4bb439d-2f6e-41cd-a763-593e8b0c137b","Type":"ContainerStarted","Data":"2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe"} Jul 09 16:45:45.688511 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.688390 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" event={"ID":"e4bb439d-2f6e-41cd-a763-593e8b0c137b","Type":"ContainerStarted","Data":"eb47ceb77333488024c28dbafe06b35250e0a03dcef0f68232cab0ccad45f7aa"} Jul 09 16:45:45.712569 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:45.712467 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" podStartSLOduration=0.712445558 podStartE2EDuration="712.445558ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:45:45.709612953 +0000 UTC m=+1570.628184311" watchObservedRunningTime="2026-07-09 16:45:45.712445558 +0000 UTC m=+1570.631016891" Jul 09 16:45:46.450997 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:46.450962 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:46.455982 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:46.455958 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:46.692847 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:46.692818 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:46.693700 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:46.693684 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:54.535642 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:54.535591 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6"] Jul 09 16:45:54.536049 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:54.535834 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" podUID="e4bb439d-2f6e-41cd-a763-593e8b0c137b" containerName="istio-proxy" containerID="cri-o://2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe" gracePeriod=30 Jul 09 16:45:58.676254 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.676230 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:58.754271 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.754192 2579 generic.go:356] "Generic (PLEG): container finished" podID="e4bb439d-2f6e-41cd-a763-593e8b0c137b" containerID="2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe" exitCode=0 Jul 09 16:45:58.754271 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.754237 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" Jul 09 16:45:58.754271 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.754250 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" event={"ID":"e4bb439d-2f6e-41cd-a763-593e8b0c137b","Type":"ContainerDied","Data":"2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe"} Jul 09 16:45:58.754522 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.754314 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6" event={"ID":"e4bb439d-2f6e-41cd-a763-593e8b0c137b","Type":"ContainerDied","Data":"eb47ceb77333488024c28dbafe06b35250e0a03dcef0f68232cab0ccad45f7aa"} Jul 09 16:45:58.754522 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.754342 2579 scope.go:117] "RemoveContainer" containerID="2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe" Jul 09 16:45:58.762306 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.762290 2579 scope.go:117] "RemoveContainer" containerID="2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe" Jul 09 16:45:58.762571 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:45:58.762545 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe\": container with ID starting with 2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe not found: ID does not exist" containerID="2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe" Jul 09 16:45:58.762618 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.762579 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe"} err="failed to get container status \"2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe\": rpc error: code = NotFound desc = could not find container \"2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe\": container with ID starting with 2fec057e08b74b58dc0a7f75fc6166834d89a4fc0f56b69f58b3fd98fcc1c0fe not found: ID does not exist" Jul 09 16:45:58.793332 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793276 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-envoy\") pod \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " Jul 09 16:45:58.793332 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793309 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-data\") pod \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " Jul 09 16:45:58.793466 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793356 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-workload-socket\") pod \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " Jul 09 16:45:58.793466 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793387 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-podinfo\") pod \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " Jul 09 16:45:58.793466 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793412 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqmnp\" (UniqueName: \"kubernetes.io/projected/e4bb439d-2f6e-41cd-a763-593e8b0c137b-kube-api-access-cqmnp\") pod \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " Jul 09 16:45:58.793466 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793432 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-credential-socket\") pod \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " Jul 09 16:45:58.793466 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793448 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-workload-certs\") pod \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " Jul 09 16:45:58.793707 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793509 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-token\") pod \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " Jul 09 16:45:58.793707 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793544 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istiod-ca-cert\") pod \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\" (UID: \"e4bb439d-2f6e-41cd-a763-593e8b0c137b\") " Jul 09 16:45:58.793707 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793649 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e4bb439d-2f6e-41cd-a763-593e8b0c137b" (UID: "e4bb439d-2f6e-41cd-a763-593e8b0c137b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:45:58.793858 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793790 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e4bb439d-2f6e-41cd-a763-593e8b0c137b" (UID: "e4bb439d-2f6e-41cd-a763-593e8b0c137b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:45:58.793924 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793883 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e4bb439d-2f6e-41cd-a763-593e8b0c137b" (UID: "e4bb439d-2f6e-41cd-a763-593e8b0c137b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:45:58.793974 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793930 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-workload-socket\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:45:58.793974 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793951 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-workload-certs\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:45:58.793974 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.793934 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e4bb439d-2f6e-41cd-a763-593e8b0c137b" (UID: "e4bb439d-2f6e-41cd-a763-593e8b0c137b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:45:58.794341 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.794315 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-data" (OuterVolumeSpecName: "istio-data") pod "e4bb439d-2f6e-41cd-a763-593e8b0c137b" (UID: "e4bb439d-2f6e-41cd-a763-593e8b0c137b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:45:58.795599 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.795577 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e4bb439d-2f6e-41cd-a763-593e8b0c137b" (UID: "e4bb439d-2f6e-41cd-a763-593e8b0c137b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:45:58.795682 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.795590 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4bb439d-2f6e-41cd-a763-593e8b0c137b-kube-api-access-cqmnp" (OuterVolumeSpecName: "kube-api-access-cqmnp") pod "e4bb439d-2f6e-41cd-a763-593e8b0c137b" (UID: "e4bb439d-2f6e-41cd-a763-593e8b0c137b"). InnerVolumeSpecName "kube-api-access-cqmnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:45:58.795682 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.795649 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-token" (OuterVolumeSpecName: "istio-token") pod "e4bb439d-2f6e-41cd-a763-593e8b0c137b" (UID: "e4bb439d-2f6e-41cd-a763-593e8b0c137b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:45:58.795754 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.795679 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e4bb439d-2f6e-41cd-a763-593e8b0c137b" (UID: "e4bb439d-2f6e-41cd-a763-593e8b0c137b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 16:45:58.894433 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.894400 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqmnp\" (UniqueName: \"kubernetes.io/projected/e4bb439d-2f6e-41cd-a763-593e8b0c137b-kube-api-access-cqmnp\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:45:58.894433 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.894427 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-credential-socket\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:45:58.894433 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.894437 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-token\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:45:58.894642 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.894447 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istiod-ca-cert\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:45:58.894642 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.894454 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-envoy\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:45:58.894642 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.894461 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-data\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:45:58.894642 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:58.894468 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4bb439d-2f6e-41cd-a763-593e8b0c137b-istio-podinfo\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:45:59.077158 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:59.077128 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6"] Jul 09 16:45:59.081366 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:59.081340 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a5f599bc-openshift-default-856dfd9f95-s4dh6"] Jul 09 16:45:59.765304 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:45:59.765271 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4bb439d-2f6e-41cd-a763-593e8b0c137b" path="/var/lib/kubelet/pods/e4bb439d-2f6e-41cd-a763-593e8b0c137b/volumes" Jul 09 16:46:00.605965 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.605923 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q"] Jul 09 16:46:00.606554 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.606526 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bb439d-2f6e-41cd-a763-593e8b0c137b" containerName="istio-proxy" Jul 09 16:46:00.606554 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.606552 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bb439d-2f6e-41cd-a763-593e8b0c137b" containerName="istio-proxy" Jul 09 16:46:00.606726 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.606676 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4bb439d-2f6e-41cd-a763-593e8b0c137b" containerName="istio-proxy" Jul 09 16:46:00.610074 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.610052 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.612714 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.612693 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5aa593b6-openshift-default-dockercfg-pjfhr\"" Jul 09 16:46:00.621414 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.621390 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q"] Jul 09 16:46:00.711710 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.711678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-podinfo\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.711900 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.711714 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-envoy\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.711900 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.711733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-workload-socket\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.711900 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.711752 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-credential-socket\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.711900 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.711803 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-data\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.711900 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.711887 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fkwr\" (UniqueName: \"kubernetes.io/projected/b3abf520-39e8-49f0-81e6-46c8ddf09daf-kube-api-access-9fkwr\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.712208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.711952 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-token\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.712208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.712056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istiod-ca-cert\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.712208 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.712140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-workload-certs\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.813607 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.813577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-workload-certs\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814086 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.813620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-podinfo\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814086 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.813641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-envoy\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814086 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.813666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-workload-socket\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814086 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.813693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-credential-socket\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814086 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.813735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-data\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814086 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.813774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fkwr\" (UniqueName: \"kubernetes.io/projected/b3abf520-39e8-49f0-81e6-46c8ddf09daf-kube-api-access-9fkwr\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814086 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.813825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-token\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814086 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.813886 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istiod-ca-cert\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814086 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.814058 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-workload-certs\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814661 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.814232 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-data\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814661 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.814286 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-workload-socket\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814661 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.814324 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-credential-socket\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.814661 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.814651 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istiod-ca-cert\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.816066 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.816046 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-envoy\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.816158 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.816117 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-podinfo\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.822293 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.822269 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-token\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.822582 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.822554 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fkwr\" (UniqueName: \"kubernetes.io/projected/b3abf520-39e8-49f0-81e6-46c8ddf09daf-kube-api-access-9fkwr\") pod \"e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:00.920093 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:00.919994 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:01.052000 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:01.051976 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q"] Jul 09 16:46:01.054052 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:46:01.054024 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3abf520_39e8_49f0_81e6_46c8ddf09daf.slice/crio-5e6fc26c1a955e8d27e8934cad852bd48392305dd245395ecd34f14030db7cb7 WatchSource:0}: Error finding container 5e6fc26c1a955e8d27e8934cad852bd48392305dd245395ecd34f14030db7cb7: Status 404 returned error can't find the container with id 5e6fc26c1a955e8d27e8934cad852bd48392305dd245395ecd34f14030db7cb7 Jul 09 16:46:01.056170 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:01.056135 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:46:01.056252 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:01.056215 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:46:01.056310 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:01.056292 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:46:01.772716 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:01.772675 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" event={"ID":"b3abf520-39e8-49f0-81e6-46c8ddf09daf","Type":"ContainerStarted","Data":"5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8"} Jul 09 16:46:01.772861 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:01.772745 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" event={"ID":"b3abf520-39e8-49f0-81e6-46c8ddf09daf","Type":"ContainerStarted","Data":"5e6fc26c1a955e8d27e8934cad852bd48392305dd245395ecd34f14030db7cb7"} Jul 09 16:46:01.804397 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:01.804342 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" podStartSLOduration=1.8043194040000001 podStartE2EDuration="1.804319404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:46:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:46:01.801381276 +0000 UTC m=+1586.719952598" watchObservedRunningTime="2026-07-09 16:46:01.804319404 +0000 UTC m=+1586.722890735" Jul 09 16:46:01.920579 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:01.920547 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:02.925694 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:02.925662 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:03.781474 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:03.781436 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:03.782397 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:03.782375 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:10.734111 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:10.734074 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q"] Jul 09 16:46:10.734533 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:10.734275 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" podUID="b3abf520-39e8-49f0-81e6-46c8ddf09daf" containerName="istio-proxy" containerID="cri-o://5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8" gracePeriod=30 Jul 09 16:46:12.376644 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.376619 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:12.433770 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.433688 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istiod-ca-cert\") pod \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " Jul 09 16:46:12.433770 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.433724 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-workload-certs\") pod \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " Jul 09 16:46:12.433770 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.433750 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-credential-socket\") pod \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " Jul 09 16:46:12.433956 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.433858 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-envoy\") pod \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " Jul 09 16:46:12.433956 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.433894 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-workload-socket\") pod \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " Jul 09 16:46:12.433956 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.433951 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-token\") pod \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " Jul 09 16:46:12.434077 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.433984 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3abf520-39e8-49f0-81e6-46c8ddf09daf" (UID: "b3abf520-39e8-49f0-81e6-46c8ddf09daf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:46:12.434077 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.434057 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fkwr\" (UniqueName: \"kubernetes.io/projected/b3abf520-39e8-49f0-81e6-46c8ddf09daf-kube-api-access-9fkwr\") pod \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " Jul 09 16:46:12.434174 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.434082 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-data\") pod \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " Jul 09 16:46:12.434174 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.434104 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-podinfo\") pod \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\" (UID: \"b3abf520-39e8-49f0-81e6-46c8ddf09daf\") " Jul 09 16:46:12.434276 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.434208 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3abf520-39e8-49f0-81e6-46c8ddf09daf" (UID: "b3abf520-39e8-49f0-81e6-46c8ddf09daf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:46:12.434276 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.434223 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3abf520-39e8-49f0-81e6-46c8ddf09daf" (UID: "b3abf520-39e8-49f0-81e6-46c8ddf09daf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:46:12.434555 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.434525 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3abf520-39e8-49f0-81e6-46c8ddf09daf" (UID: "b3abf520-39e8-49f0-81e6-46c8ddf09daf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:46:12.435185 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.435152 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3abf520-39e8-49f0-81e6-46c8ddf09daf" (UID: "b3abf520-39e8-49f0-81e6-46c8ddf09daf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:46:12.435485 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.435461 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-workload-socket\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:12.435558 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.435490 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-data\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:12.435558 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.435505 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istiod-ca-cert\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:12.435558 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.435517 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-workload-certs\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:12.435558 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.435529 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-credential-socket\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:12.436263 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.436234 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3abf520-39e8-49f0-81e6-46c8ddf09daf" (UID: "b3abf520-39e8-49f0-81e6-46c8ddf09daf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:46:12.436372 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.436276 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3abf520-39e8-49f0-81e6-46c8ddf09daf" (UID: "b3abf520-39e8-49f0-81e6-46c8ddf09daf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:46:12.436536 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.436518 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3abf520-39e8-49f0-81e6-46c8ddf09daf" (UID: "b3abf520-39e8-49f0-81e6-46c8ddf09daf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 16:46:12.436608 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.436592 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3abf520-39e8-49f0-81e6-46c8ddf09daf-kube-api-access-9fkwr" (OuterVolumeSpecName: "kube-api-access-9fkwr") pod "b3abf520-39e8-49f0-81e6-46c8ddf09daf" (UID: "b3abf520-39e8-49f0-81e6-46c8ddf09daf"). InnerVolumeSpecName "kube-api-access-9fkwr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:46:12.536765 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.536719 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fkwr\" (UniqueName: \"kubernetes.io/projected/b3abf520-39e8-49f0-81e6-46c8ddf09daf-kube-api-access-9fkwr\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:12.536765 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.536764 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-podinfo\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:12.536962 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.536788 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-envoy\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:12.536962 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.536800 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3abf520-39e8-49f0-81e6-46c8ddf09daf-istio-token\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:12.830999 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.830967 2579 generic.go:356] "Generic (PLEG): container finished" podID="b3abf520-39e8-49f0-81e6-46c8ddf09daf" containerID="5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8" exitCode=0 Jul 09 16:46:12.831191 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.831032 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" Jul 09 16:46:12.831191 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.831044 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" event={"ID":"b3abf520-39e8-49f0-81e6-46c8ddf09daf","Type":"ContainerDied","Data":"5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8"} Jul 09 16:46:12.831191 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.831098 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q" event={"ID":"b3abf520-39e8-49f0-81e6-46c8ddf09daf","Type":"ContainerDied","Data":"5e6fc26c1a955e8d27e8934cad852bd48392305dd245395ecd34f14030db7cb7"} Jul 09 16:46:12.831191 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.831119 2579 scope.go:117] "RemoveContainer" containerID="5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8" Jul 09 16:46:12.839932 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.839918 2579 scope.go:117] "RemoveContainer" containerID="5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8" Jul 09 16:46:12.840203 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:46:12.840181 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8\": container with ID starting with 5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8 not found: ID does not exist" containerID="5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8" Jul 09 16:46:12.840298 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.840208 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8"} err="failed to get container status \"5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8\": rpc error: code = NotFound desc = could not find container \"5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8\": container with ID starting with 5e3005c150067615382102fd32d7e166ecf317d89cd2ec560020add37fe66fe8 not found: ID does not exist" Jul 09 16:46:12.856183 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.856162 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q"] Jul 09 16:46:12.860659 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:12.860640 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5aa593b6-openshift-default-6d56f864cf-tjx7q"] Jul 09 16:46:13.765952 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:13.765917 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3abf520-39e8-49f0-81e6-46c8ddf09daf" path="/var/lib/kubelet/pods/b3abf520-39e8-49f0-81e6-46c8ddf09daf/volumes" Jul 09 16:46:16.926676 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:16.926643 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b"] Jul 09 16:46:16.927222 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:16.927203 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3abf520-39e8-49f0-81e6-46c8ddf09daf" containerName="istio-proxy" Jul 09 16:46:16.927270 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:16.927228 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3abf520-39e8-49f0-81e6-46c8ddf09daf" containerName="istio-proxy" Jul 09 16:46:16.927356 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:16.927345 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3abf520-39e8-49f0-81e6-46c8ddf09daf" containerName="istio-proxy" Jul 09 16:46:16.932140 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:16.932104 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:16.935638 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:16.935609 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5e823c1a-openshift-default-dockercfg-9zg8z\"" Jul 09 16:46:16.945621 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:16.945596 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b"] Jul 09 16:46:17.078251 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.078216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa01972-7534-4ed9-92cb-859f233be223-istio-token\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.078251 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.078254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-workload-certs\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.078521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.078335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-credential-socket\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.078521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.078418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-workload-socket\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.078521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.078442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-istio-data\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.078521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.078466 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa01972-7534-4ed9-92cb-859f233be223-istio-podinfo\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.078521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.078480 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa01972-7534-4ed9-92cb-859f233be223-istiod-ca-cert\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.078521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.078502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lkdp\" (UniqueName: \"kubernetes.io/projected/dfa01972-7534-4ed9-92cb-859f233be223-kube-api-access-7lkdp\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.078782 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.078528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-istio-envoy\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.179249 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.179164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-istio-envoy\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.179249 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.179216 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa01972-7534-4ed9-92cb-859f233be223-istio-token\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.179249 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.179235 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-workload-certs\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.179529 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.179288 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-credential-socket\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.179529 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.179318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-workload-socket\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.179529 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.179351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-istio-data\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.179529 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.179389 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa01972-7534-4ed9-92cb-859f233be223-istio-podinfo\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.179529 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.179413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa01972-7534-4ed9-92cb-859f233be223-istiod-ca-cert\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.179529 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.179451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lkdp\" (UniqueName: \"kubernetes.io/projected/dfa01972-7534-4ed9-92cb-859f233be223-kube-api-access-7lkdp\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.180031 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.179980 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-workload-certs\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.180394 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.180369 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-workload-socket\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.180535 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.180428 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa01972-7534-4ed9-92cb-859f233be223-istiod-ca-cert\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.180876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.180826 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-credential-socket\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.180876 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.180846 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-istio-data\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.181841 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.181819 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-istio-envoy\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.182292 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.182271 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa01972-7534-4ed9-92cb-859f233be223-istio-podinfo\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.188504 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.188477 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa01972-7534-4ed9-92cb-859f233be223-istio-token\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.188605 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.188589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lkdp\" (UniqueName: \"kubernetes.io/projected/dfa01972-7534-4ed9-92cb-859f233be223-kube-api-access-7lkdp\") pod \"e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.242675 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.242639 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:17.379920 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.379893 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b"] Jul 09 16:46:17.382409 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:46:17.382347 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa01972_7534_4ed9_92cb_859f233be223.slice/crio-793acefd7ba4bdb0e8df25db3de5679bfe9b160c7193ae37eaffd180f0e5ac2c WatchSource:0}: Error finding container 793acefd7ba4bdb0e8df25db3de5679bfe9b160c7193ae37eaffd180f0e5ac2c: Status 404 returned error can't find the container with id 793acefd7ba4bdb0e8df25db3de5679bfe9b160c7193ae37eaffd180f0e5ac2c Jul 09 16:46:17.384569 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.384540 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:46:17.384684 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.384601 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:46:17.384684 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.384627 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:46:17.857299 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.857269 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" event={"ID":"dfa01972-7534-4ed9-92cb-859f233be223","Type":"ContainerStarted","Data":"0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810"} Jul 09 16:46:17.857487 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.857334 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" event={"ID":"dfa01972-7534-4ed9-92cb-859f233be223","Type":"ContainerStarted","Data":"793acefd7ba4bdb0e8df25db3de5679bfe9b160c7193ae37eaffd180f0e5ac2c"} Jul 09 16:46:17.879822 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:17.879764 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" podStartSLOduration=1.879746033 podStartE2EDuration="1.879746033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:46:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:46:17.878974805 +0000 UTC m=+1602.797546158" watchObservedRunningTime="2026-07-09 16:46:17.879746033 +0000 UTC m=+1602.798317364" Jul 09 16:46:18.243273 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:18.243201 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:18.247617 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:18.247596 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:18.862198 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:18.862169 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:18.863108 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:18.863088 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:25.643679 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:25.643641 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b"] Jul 09 16:46:25.644209 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:25.643923 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" podUID="dfa01972-7534-4ed9-92cb-859f233be223" containerName="istio-proxy" containerID="cri-o://0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810" gracePeriod=30 Jul 09 16:46:30.897986 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:30.897958 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:30.918934 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:30.918872 2579 generic.go:356] "Generic (PLEG): container finished" podID="dfa01972-7534-4ed9-92cb-859f233be223" containerID="0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810" exitCode=0 Jul 09 16:46:30.918934 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:30.918908 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" Jul 09 16:46:30.919087 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:30.918943 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" event={"ID":"dfa01972-7534-4ed9-92cb-859f233be223","Type":"ContainerDied","Data":"0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810"} Jul 09 16:46:30.919087 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:30.918981 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b" event={"ID":"dfa01972-7534-4ed9-92cb-859f233be223","Type":"ContainerDied","Data":"793acefd7ba4bdb0e8df25db3de5679bfe9b160c7193ae37eaffd180f0e5ac2c"} Jul 09 16:46:30.919087 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:30.919001 2579 scope.go:117] "RemoveContainer" containerID="0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810" Jul 09 16:46:30.928787 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:30.928769 2579 scope.go:117] "RemoveContainer" containerID="0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810" Jul 09 16:46:30.929090 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:46:30.929067 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810\": container with ID starting with 0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810 not found: ID does not exist" containerID="0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810" Jul 09 16:46:30.929145 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:30.929106 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810"} err="failed to get container status \"0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810\": rpc error: code = NotFound desc = could not find container \"0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810\": container with ID starting with 0772ed38a7dbb8947f048111562a0fabd3171fb0ccc9173ed3abe802b8680810 not found: ID does not exist" Jul 09 16:46:31.015666 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.015638 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-istio-envoy\") pod \"dfa01972-7534-4ed9-92cb-859f233be223\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " Jul 09 16:46:31.015828 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.015683 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-istio-data\") pod \"dfa01972-7534-4ed9-92cb-859f233be223\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " Jul 09 16:46:31.015828 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.015720 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-workload-certs\") pod \"dfa01972-7534-4ed9-92cb-859f233be223\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " Jul 09 16:46:31.015828 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.015761 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa01972-7534-4ed9-92cb-859f233be223-istio-token\") pod \"dfa01972-7534-4ed9-92cb-859f233be223\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " Jul 09 16:46:31.015828 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.015812 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa01972-7534-4ed9-92cb-859f233be223-istiod-ca-cert\") pod \"dfa01972-7534-4ed9-92cb-859f233be223\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " Jul 09 16:46:31.015998 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.015848 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa01972-7534-4ed9-92cb-859f233be223-istio-podinfo\") pod \"dfa01972-7534-4ed9-92cb-859f233be223\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " Jul 09 16:46:31.015998 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.015982 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-credential-socket\") pod \"dfa01972-7534-4ed9-92cb-859f233be223\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " Jul 09 16:46:31.016159 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.016035 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-istio-data" (OuterVolumeSpecName: "istio-data") pod "dfa01972-7534-4ed9-92cb-859f233be223" (UID: "dfa01972-7534-4ed9-92cb-859f233be223"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:46:31.016159 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.016055 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dfa01972-7534-4ed9-92cb-859f233be223" (UID: "dfa01972-7534-4ed9-92cb-859f233be223"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:46:31.016159 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.016043 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lkdp\" (UniqueName: \"kubernetes.io/projected/dfa01972-7534-4ed9-92cb-859f233be223-kube-api-access-7lkdp\") pod \"dfa01972-7534-4ed9-92cb-859f233be223\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " Jul 09 16:46:31.016318 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.016163 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-workload-socket\") pod \"dfa01972-7534-4ed9-92cb-859f233be223\" (UID: \"dfa01972-7534-4ed9-92cb-859f233be223\") " Jul 09 16:46:31.016380 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.016312 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dfa01972-7534-4ed9-92cb-859f233be223" (UID: "dfa01972-7534-4ed9-92cb-859f233be223"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:46:31.016380 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.016330 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfa01972-7534-4ed9-92cb-859f233be223-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dfa01972-7534-4ed9-92cb-859f233be223" (UID: "dfa01972-7534-4ed9-92cb-859f233be223"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:46:31.016563 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.016513 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dfa01972-7534-4ed9-92cb-859f233be223" (UID: "dfa01972-7534-4ed9-92cb-859f233be223"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:46:31.016669 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.016645 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfa01972-7534-4ed9-92cb-859f233be223-istiod-ca-cert\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:31.016732 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.016676 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-credential-socket\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:31.016732 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.016690 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-workload-socket\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:31.016732 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.016704 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-istio-data\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:31.016732 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.016717 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-workload-certs\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:31.018100 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.018072 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dfa01972-7534-4ed9-92cb-859f233be223-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dfa01972-7534-4ed9-92cb-859f233be223" (UID: "dfa01972-7534-4ed9-92cb-859f233be223"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 16:46:31.018183 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.018080 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dfa01972-7534-4ed9-92cb-859f233be223" (UID: "dfa01972-7534-4ed9-92cb-859f233be223"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:46:31.018431 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.018412 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfa01972-7534-4ed9-92cb-859f233be223-istio-token" (OuterVolumeSpecName: "istio-token") pod "dfa01972-7534-4ed9-92cb-859f233be223" (UID: "dfa01972-7534-4ed9-92cb-859f233be223"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:46:31.018473 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.018440 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfa01972-7534-4ed9-92cb-859f233be223-kube-api-access-7lkdp" (OuterVolumeSpecName: "kube-api-access-7lkdp") pod "dfa01972-7534-4ed9-92cb-859f233be223" (UID: "dfa01972-7534-4ed9-92cb-859f233be223"). InnerVolumeSpecName "kube-api-access-7lkdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:46:31.118003 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.117974 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfa01972-7534-4ed9-92cb-859f233be223-istio-podinfo\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:31.118003 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.117999 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lkdp\" (UniqueName: \"kubernetes.io/projected/dfa01972-7534-4ed9-92cb-859f233be223-kube-api-access-7lkdp\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:31.118184 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.118024 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfa01972-7534-4ed9-92cb-859f233be223-istio-envoy\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:31.118184 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.118033 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfa01972-7534-4ed9-92cb-859f233be223-istio-token\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:46:31.242418 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.242386 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b"] Jul 09 16:46:31.249162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.249135 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5e823c1a-openshift-default-54bc95c45f-g7j4b"] Jul 09 16:46:31.765279 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:46:31.765248 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfa01972-7534-4ed9-92cb-859f233be223" path="/var/lib/kubelet/pods/dfa01972-7534-4ed9-92cb-859f233be223/volumes" Jul 09 16:49:35.660409 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:35.660378 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:49:35.662176 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:35.662151 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:49:53.745842 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.745806 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq"] Jul 09 16:49:53.746288 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.746210 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa01972-7534-4ed9-92cb-859f233be223" containerName="istio-proxy" Jul 09 16:49:53.746288 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.746222 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa01972-7534-4ed9-92cb-859f233be223" containerName="istio-proxy" Jul 09 16:49:53.746361 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.746289 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa01972-7534-4ed9-92cb-859f233be223" containerName="istio-proxy" Jul 09 16:49:53.749285 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.749268 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:53.751832 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.751812 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-857c916f-openshift-default-dockercfg-gj8mf\"" Jul 09 16:49:53.771101 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.771076 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq"] Jul 09 16:49:53.908289 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.908257 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-podinfo\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:53.908445 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.908320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-credential-socket\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:53.908445 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.908341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-token\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:53.908521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.908474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-workload-socket\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:53.908558 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.908528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22108ecf-75df-4902-afc6-2af9aff1f19a-istiod-ca-cert\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:53.908657 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.908644 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-workload-certs\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:53.908694 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.908667 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-envoy\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:53.908694 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.908685 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t7zz\" (UniqueName: \"kubernetes.io/projected/22108ecf-75df-4902-afc6-2af9aff1f19a-kube-api-access-2t7zz\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:53.908766 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:53.908744 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-data\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.009868 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.009785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-credential-socket\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.009868 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.009824 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-token\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.009868 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.009854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-workload-socket\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.010186 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.009877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22108ecf-75df-4902-afc6-2af9aff1f19a-istiod-ca-cert\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.010186 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.009906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-workload-certs\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.010186 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.009930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-envoy\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.010186 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.009957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t7zz\" (UniqueName: \"kubernetes.io/projected/22108ecf-75df-4902-afc6-2af9aff1f19a-kube-api-access-2t7zz\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.010186 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.009988 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-data\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.010186 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.010060 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-podinfo\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.010450 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.010195 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-credential-socket\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.010450 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.010236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-workload-socket\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.010450 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.010292 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-workload-certs\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.010561 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.010508 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-data\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.010874 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.010857 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22108ecf-75df-4902-afc6-2af9aff1f19a-istiod-ca-cert\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.012312 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.012290 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-envoy\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.012739 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.012723 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-podinfo\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.017433 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.017413 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-token\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.017784 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.017763 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t7zz\" (UniqueName: \"kubernetes.io/projected/22108ecf-75df-4902-afc6-2af9aff1f19a-kube-api-access-2t7zz\") pod \"e2e-mt-857c916f-openshift-default-64899d557f-bxkbq\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.059194 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.059160 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:54.199361 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.199329 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq"] Jul 09 16:49:54.201843 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:49:54.201813 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22108ecf_75df_4902_afc6_2af9aff1f19a.slice/crio-82e54f03b7ae9f7bce61e8ea8e498be75c2a83bbd8a1664b11b5d32c03855fb7 WatchSource:0}: Error finding container 82e54f03b7ae9f7bce61e8ea8e498be75c2a83bbd8a1664b11b5d32c03855fb7: Status 404 returned error can't find the container with id 82e54f03b7ae9f7bce61e8ea8e498be75c2a83bbd8a1664b11b5d32c03855fb7 Jul 09 16:49:54.204140 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.204109 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:49:54.204220 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.204175 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:49:54.204220 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.204204 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:49:54.859882 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.859845 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" event={"ID":"22108ecf-75df-4902-afc6-2af9aff1f19a","Type":"ContainerStarted","Data":"0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a"} Jul 09 16:49:54.860295 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.859907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" event={"ID":"22108ecf-75df-4902-afc6-2af9aff1f19a","Type":"ContainerStarted","Data":"82e54f03b7ae9f7bce61e8ea8e498be75c2a83bbd8a1664b11b5d32c03855fb7"} Jul 09 16:49:54.879675 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:54.879626 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" podStartSLOduration=1.8796091320000001 podStartE2EDuration="1.879609132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:49:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:49:54.878471225 +0000 UTC m=+1819.797042569" watchObservedRunningTime="2026-07-09 16:49:54.879609132 +0000 UTC m=+1819.798180463" Jul 09 16:49:55.059508 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:55.059478 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:55.064135 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:55.064106 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:55.864893 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:55.864861 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:49:55.865870 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:49:55.865853 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:50:10.866446 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:10.866407 2579 patch_prober.go:28] interesting pod/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 09 16:50:10.866869 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:10.866479 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" podUID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 09 16:50:10.942703 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:10.942667 2579 generic.go:356] "Generic (PLEG): container finished" podID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerID="0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a" exitCode=0 Jul 09 16:50:10.942859 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:10.942741 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" event={"ID":"22108ecf-75df-4902-afc6-2af9aff1f19a","Type":"ContainerDied","Data":"0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a"} Jul 09 16:50:10.943161 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:10.943146 2579 scope.go:117] "RemoveContainer" containerID="0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a" Jul 09 16:50:10.944162 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:10.944134 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:50:10.944241 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:10.944226 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:50:10.944279 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:10.944268 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:50:11.949054 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:11.949000 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" event={"ID":"22108ecf-75df-4902-afc6-2af9aff1f19a","Type":"ContainerStarted","Data":"29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7"} Jul 09 16:50:12.059648 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:12.059608 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:50:12.059814 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:12.059795 2579 patch_prober.go:28] interesting pod/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 09 16:50:12.059863 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:12.059838 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" podUID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 09 16:50:13.059631 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:13.059598 2579 patch_prober.go:28] interesting pod/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 09 16:50:13.060027 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:13.059664 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" podUID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 09 16:50:14.059935 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:14.059899 2579 patch_prober.go:28] interesting pod/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 09 16:50:14.060340 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:14.059951 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" podUID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 09 16:50:14.762623 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:14.762587 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq"] Jul 09 16:50:14.762872 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:14.762847 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" podUID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerName="istio-proxy" containerID="cri-o://29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7" gracePeriod=30 Jul 09 16:50:20.715089 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.715062 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:50:20.777260 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.777230 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2t7zz\" (UniqueName: \"kubernetes.io/projected/22108ecf-75df-4902-afc6-2af9aff1f19a-kube-api-access-2t7zz\") pod \"22108ecf-75df-4902-afc6-2af9aff1f19a\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " Jul 09 16:50:20.777426 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.777316 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22108ecf-75df-4902-afc6-2af9aff1f19a-istiod-ca-cert\") pod \"22108ecf-75df-4902-afc6-2af9aff1f19a\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " Jul 09 16:50:20.777426 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.777351 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-podinfo\") pod \"22108ecf-75df-4902-afc6-2af9aff1f19a\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " Jul 09 16:50:20.777426 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.777376 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-workload-certs\") pod \"22108ecf-75df-4902-afc6-2af9aff1f19a\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " Jul 09 16:50:20.777596 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.777577 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-data\") pod \"22108ecf-75df-4902-afc6-2af9aff1f19a\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " Jul 09 16:50:20.777648 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.777636 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-token\") pod \"22108ecf-75df-4902-afc6-2af9aff1f19a\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " Jul 09 16:50:20.777701 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.777641 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "22108ecf-75df-4902-afc6-2af9aff1f19a" (UID: "22108ecf-75df-4902-afc6-2af9aff1f19a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:50:20.777701 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.777694 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-workload-socket\") pod \"22108ecf-75df-4902-afc6-2af9aff1f19a\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " Jul 09 16:50:20.777779 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.777729 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22108ecf-75df-4902-afc6-2af9aff1f19a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "22108ecf-75df-4902-afc6-2af9aff1f19a" (UID: "22108ecf-75df-4902-afc6-2af9aff1f19a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:50:20.777779 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.777736 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-envoy\") pod \"22108ecf-75df-4902-afc6-2af9aff1f19a\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " Jul 09 16:50:20.777885 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.777867 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-credential-socket\") pod \"22108ecf-75df-4902-afc6-2af9aff1f19a\" (UID: \"22108ecf-75df-4902-afc6-2af9aff1f19a\") " Jul 09 16:50:20.778050 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.777987 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "22108ecf-75df-4902-afc6-2af9aff1f19a" (UID: "22108ecf-75df-4902-afc6-2af9aff1f19a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:50:20.778221 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.778115 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "22108ecf-75df-4902-afc6-2af9aff1f19a" (UID: "22108ecf-75df-4902-afc6-2af9aff1f19a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:50:20.778297 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.778274 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22108ecf-75df-4902-afc6-2af9aff1f19a-istiod-ca-cert\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:50:20.778352 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.778295 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-workload-certs\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:50:20.778352 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.778309 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-workload-socket\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:50:20.778352 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.778323 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-credential-socket\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:50:20.778615 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.778590 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-data" (OuterVolumeSpecName: "istio-data") pod "22108ecf-75df-4902-afc6-2af9aff1f19a" (UID: "22108ecf-75df-4902-afc6-2af9aff1f19a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:50:20.779526 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.779505 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22108ecf-75df-4902-afc6-2af9aff1f19a-kube-api-access-2t7zz" (OuterVolumeSpecName: "kube-api-access-2t7zz") pod "22108ecf-75df-4902-afc6-2af9aff1f19a" (UID: "22108ecf-75df-4902-afc6-2af9aff1f19a"). InnerVolumeSpecName "kube-api-access-2t7zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:50:20.779604 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.779508 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "22108ecf-75df-4902-afc6-2af9aff1f19a" (UID: "22108ecf-75df-4902-afc6-2af9aff1f19a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 16:50:20.780058 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.780039 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-token" (OuterVolumeSpecName: "istio-token") pod "22108ecf-75df-4902-afc6-2af9aff1f19a" (UID: "22108ecf-75df-4902-afc6-2af9aff1f19a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:50:20.780058 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.780042 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "22108ecf-75df-4902-afc6-2af9aff1f19a" (UID: "22108ecf-75df-4902-afc6-2af9aff1f19a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:50:20.879372 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.879277 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-envoy\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:50:20.879372 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.879312 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t7zz\" (UniqueName: \"kubernetes.io/projected/22108ecf-75df-4902-afc6-2af9aff1f19a-kube-api-access-2t7zz\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:50:20.879372 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.879327 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-podinfo\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:50:20.879372 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.879339 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-data\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:50:20.879372 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.879350 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22108ecf-75df-4902-afc6-2af9aff1f19a-istio-token\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:50:20.993521 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.993489 2579 generic.go:356] "Generic (PLEG): container finished" podID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerID="29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7" exitCode=0 Jul 09 16:50:20.993695 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.993542 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" Jul 09 16:50:20.993695 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.993572 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" event={"ID":"22108ecf-75df-4902-afc6-2af9aff1f19a","Type":"ContainerDied","Data":"29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7"} Jul 09 16:50:20.993695 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.993631 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq" event={"ID":"22108ecf-75df-4902-afc6-2af9aff1f19a","Type":"ContainerDied","Data":"82e54f03b7ae9f7bce61e8ea8e498be75c2a83bbd8a1664b11b5d32c03855fb7"} Jul 09 16:50:20.993695 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:20.993661 2579 scope.go:117] "RemoveContainer" containerID="29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7" Jul 09 16:50:21.002669 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:21.002651 2579 scope.go:117] "RemoveContainer" containerID="0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a" Jul 09 16:50:21.010475 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:21.010459 2579 scope.go:117] "RemoveContainer" containerID="29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7" Jul 09 16:50:21.010722 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:50:21.010703 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7\": container with ID starting with 29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7 not found: ID does not exist" containerID="29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7" Jul 09 16:50:21.010778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:21.010729 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7"} err="failed to get container status \"29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7\": rpc error: code = NotFound desc = could not find container \"29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7\": container with ID starting with 29d31198886dd3076b54eb2bb984016d9fe042a181025d6397d66941fca600d7 not found: ID does not exist" Jul 09 16:50:21.010778 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:21.010746 2579 scope.go:117] "RemoveContainer" containerID="0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a" Jul 09 16:50:21.010981 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:50:21.010964 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a\": container with ID starting with 0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a not found: ID does not exist" containerID="0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a" Jul 09 16:50:21.011057 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:21.010984 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a"} err="failed to get container status \"0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a\": rpc error: code = NotFound desc = could not find container \"0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a\": container with ID starting with 0e269acce266bd52ce026560b6b2e3d38495d33e7a837ca721e3dbb30ff47b4a not found: ID does not exist" Jul 09 16:50:21.016389 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:21.016371 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq"] Jul 09 16:50:21.021638 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:21.021618 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-857c916f-openshift-default-64899d557f-bxkbq"] Jul 09 16:50:21.764755 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:21.764723 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22108ecf-75df-4902-afc6-2af9aff1f19a" path="/var/lib/kubelet/pods/22108ecf-75df-4902-afc6-2af9aff1f19a/volumes" Jul 09 16:50:34.514850 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.514809 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2"] Jul 09 16:50:34.515463 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.515343 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerName="istio-proxy" Jul 09 16:50:34.515463 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.515362 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerName="istio-proxy" Jul 09 16:50:34.515463 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.515390 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerName="istio-proxy" Jul 09 16:50:34.515463 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.515398 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerName="istio-proxy" Jul 09 16:50:34.515682 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.515481 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerName="istio-proxy" Jul 09 16:50:34.515682 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.515494 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="22108ecf-75df-4902-afc6-2af9aff1f19a" containerName="istio-proxy" Jul 09 16:50:34.521786 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.521763 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.524353 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.524333 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-756fbf8e-openshift-default-dockercfg-vtbnz\"" Jul 09 16:50:34.531478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.531451 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2"] Jul 09 16:50:34.613589 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.613549 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-istio-envoy\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.613769 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.613595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f566b39-800a-491d-b0d4-c3526a377554-istiod-ca-cert\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.613769 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.613660 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-workload-certs\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.613769 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.613702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f566b39-800a-491d-b0d4-c3526a377554-istio-token\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.613769 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.613752 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5fvw\" (UniqueName: \"kubernetes.io/projected/3f566b39-800a-491d-b0d4-c3526a377554-kube-api-access-m5fvw\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.613914 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.613816 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-istio-data\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.613914 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.613853 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-credential-socket\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.613978 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.613920 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-workload-socket\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.613978 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.613939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f566b39-800a-491d-b0d4-c3526a377554-istio-podinfo\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715134 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5fvw\" (UniqueName: \"kubernetes.io/projected/3f566b39-800a-491d-b0d4-c3526a377554-kube-api-access-m5fvw\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715333 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-istio-data\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715333 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715203 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-credential-socket\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715333 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715266 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-workload-socket\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715333 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715292 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f566b39-800a-491d-b0d4-c3526a377554-istio-podinfo\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715333 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-istio-envoy\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715622 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f566b39-800a-491d-b0d4-c3526a377554-istiod-ca-cert\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715622 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-workload-certs\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715622 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715435 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f566b39-800a-491d-b0d4-c3526a377554-istio-token\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715622 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715613 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-istio-data\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715807 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715655 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-workload-socket\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715807 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715704 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-credential-socket\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.715874 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.715845 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-workload-certs\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.716141 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.716125 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f566b39-800a-491d-b0d4-c3526a377554-istiod-ca-cert\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.718116 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.718096 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-istio-envoy\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.718347 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.718328 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f566b39-800a-491d-b0d4-c3526a377554-istio-podinfo\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.722758 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.722735 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f566b39-800a-491d-b0d4-c3526a377554-istio-token\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.723177 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.723156 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5fvw\" (UniqueName: \"kubernetes.io/projected/3f566b39-800a-491d-b0d4-c3526a377554-kube-api-access-m5fvw\") pod \"e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.833614 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.833493 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:34.968907 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.968881 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2"] Jul 09 16:50:34.970780 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:50:34.970749 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f566b39_800a_491d_b0d4_c3526a377554.slice/crio-adceac973e540cff6db682cb6dcec217862ba23128a89fcdbe543117eb6fc172 WatchSource:0}: Error finding container adceac973e540cff6db682cb6dcec217862ba23128a89fcdbe543117eb6fc172: Status 404 returned error can't find the container with id adceac973e540cff6db682cb6dcec217862ba23128a89fcdbe543117eb6fc172 Jul 09 16:50:34.973225 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.973181 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:50:34.973314 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.973262 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:50:34.973314 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:34.973293 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:50:35.058672 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:35.058630 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" event={"ID":"3f566b39-800a-491d-b0d4-c3526a377554","Type":"ContainerStarted","Data":"209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77"} Jul 09 16:50:35.058848 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:35.058701 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" event={"ID":"3f566b39-800a-491d-b0d4-c3526a377554","Type":"ContainerStarted","Data":"adceac973e540cff6db682cb6dcec217862ba23128a89fcdbe543117eb6fc172"} Jul 09 16:50:35.080164 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:35.080102 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" podStartSLOduration=1.080074049 podStartE2EDuration="1.080074049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:50:35.077944884 +0000 UTC m=+1859.996516216" watchObservedRunningTime="2026-07-09 16:50:35.080074049 +0000 UTC m=+1859.998645381" Jul 09 16:50:35.833855 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:35.833812 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:36.839126 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:36.839095 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:37.068703 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:37.068670 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:37.069679 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:37.069659 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:51.143424 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:51.143389 2579 generic.go:356] "Generic (PLEG): container finished" podID="3f566b39-800a-491d-b0d4-c3526a377554" containerID="209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77" exitCode=0 Jul 09 16:50:51.143939 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:51.143469 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" event={"ID":"3f566b39-800a-491d-b0d4-c3526a377554","Type":"ContainerDied","Data":"209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77"} Jul 09 16:50:51.144152 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:51.144135 2579 scope.go:117] "RemoveContainer" containerID="209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77" Jul 09 16:50:51.145272 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:51.145248 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:50:51.145328 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:51.145315 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:50:51.145362 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:51.145347 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:50:52.068895 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:52.068859 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:52.149955 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:52.149916 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" event={"ID":"3f566b39-800a-491d-b0d4-c3526a377554","Type":"ContainerStarted","Data":"cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc"} Jul 09 16:50:52.834678 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:52.834640 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:52.835797 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:52.835768 2579 patch_prober.go:28] interesting pod/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 09 16:50:52.835934 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:52.835829 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" podUID="3f566b39-800a-491d-b0d4-c3526a377554" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 09 16:50:53.834478 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:53.834444 2579 patch_prober.go:28] interesting pod/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 09 16:50:53.834878 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:53.834498 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" podUID="3f566b39-800a-491d-b0d4-c3526a377554" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 09 16:50:54.834703 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:54.834670 2579 patch_prober.go:28] interesting pod/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 09 16:50:54.835122 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:54.834722 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" podUID="3f566b39-800a-491d-b0d4-c3526a377554" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 09 16:50:55.834575 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:55.834535 2579 patch_prober.go:28] interesting pod/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 09 16:50:55.834755 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:55.834603 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" podUID="3f566b39-800a-491d-b0d4-c3526a377554" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 09 16:50:56.838250 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:56.838220 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:56.838609 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:56.838494 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:50:56.839225 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:50:56.839208 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:52:33.346452 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:33.346369 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2"] Jul 09 16:52:33.346938 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:33.346687 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" podUID="3f566b39-800a-491d-b0d4-c3526a377554" containerName="istio-proxy" containerID="cri-o://cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc" gracePeriod=30 Jul 09 16:52:38.607312 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.607253 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:52:38.665457 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.665428 2579 generic.go:356] "Generic (PLEG): container finished" podID="3f566b39-800a-491d-b0d4-c3526a377554" containerID="cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc" exitCode=0 Jul 09 16:52:38.665589 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.665472 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" Jul 09 16:52:38.665589 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.665505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" event={"ID":"3f566b39-800a-491d-b0d4-c3526a377554","Type":"ContainerDied","Data":"cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc"} Jul 09 16:52:38.665589 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.665585 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2" event={"ID":"3f566b39-800a-491d-b0d4-c3526a377554","Type":"ContainerDied","Data":"adceac973e540cff6db682cb6dcec217862ba23128a89fcdbe543117eb6fc172"} Jul 09 16:52:38.665692 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.665611 2579 scope.go:117] "RemoveContainer" containerID="cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc" Jul 09 16:52:38.673893 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.673877 2579 scope.go:117] "RemoveContainer" containerID="209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77" Jul 09 16:52:38.683831 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.683816 2579 scope.go:117] "RemoveContainer" containerID="cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc" Jul 09 16:52:38.684118 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:52:38.684096 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc\": container with ID starting with cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc not found: ID does not exist" containerID="cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc" Jul 09 16:52:38.684191 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.684127 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc"} err="failed to get container status \"cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc\": rpc error: code = NotFound desc = could not find container \"cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc\": container with ID starting with cf22217fe1def73722abeef828d8dca98769099e3257e8a70b569438de8200bc not found: ID does not exist" Jul 09 16:52:38.684191 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.684144 2579 scope.go:117] "RemoveContainer" containerID="209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77" Jul 09 16:52:38.684404 ip-10-0-136-68 kubenswrapper[2579]: E0709 16:52:38.684388 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77\": container with ID starting with 209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77 not found: ID does not exist" containerID="209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77" Jul 09 16:52:38.684450 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.684412 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77"} err="failed to get container status \"209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77\": rpc error: code = NotFound desc = could not find container \"209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77\": container with ID starting with 209bd595b6c42786c47dc2419d7da3086ff6b0dad415df08fadda30e0c1ecc77 not found: ID does not exist" Jul 09 16:52:38.692737 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.692719 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f566b39-800a-491d-b0d4-c3526a377554-istiod-ca-cert\") pod \"3f566b39-800a-491d-b0d4-c3526a377554\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " Jul 09 16:52:38.692812 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.692754 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-workload-certs\") pod \"3f566b39-800a-491d-b0d4-c3526a377554\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " Jul 09 16:52:38.692812 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.692787 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-credential-socket\") pod \"3f566b39-800a-491d-b0d4-c3526a377554\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " Jul 09 16:52:38.692887 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.692811 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-istio-data\") pod \"3f566b39-800a-491d-b0d4-c3526a377554\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " Jul 09 16:52:38.692887 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.692844 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-istio-envoy\") pod \"3f566b39-800a-491d-b0d4-c3526a377554\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " Jul 09 16:52:38.692887 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.692868 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f566b39-800a-491d-b0d4-c3526a377554-istio-token\") pod \"3f566b39-800a-491d-b0d4-c3526a377554\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " Jul 09 16:52:38.693053 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.692946 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5fvw\" (UniqueName: \"kubernetes.io/projected/3f566b39-800a-491d-b0d4-c3526a377554-kube-api-access-m5fvw\") pod \"3f566b39-800a-491d-b0d4-c3526a377554\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " Jul 09 16:52:38.693053 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.692976 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-workload-socket\") pod \"3f566b39-800a-491d-b0d4-c3526a377554\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " Jul 09 16:52:38.693053 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.693042 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f566b39-800a-491d-b0d4-c3526a377554-istio-podinfo\") pod \"3f566b39-800a-491d-b0d4-c3526a377554\" (UID: \"3f566b39-800a-491d-b0d4-c3526a377554\") " Jul 09 16:52:38.693212 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.693057 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f566b39-800a-491d-b0d4-c3526a377554" (UID: "3f566b39-800a-491d-b0d4-c3526a377554"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:52:38.693212 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.693078 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f566b39-800a-491d-b0d4-c3526a377554" (UID: "3f566b39-800a-491d-b0d4-c3526a377554"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:52:38.693212 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.693123 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f566b39-800a-491d-b0d4-c3526a377554-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f566b39-800a-491d-b0d4-c3526a377554" (UID: "3f566b39-800a-491d-b0d4-c3526a377554"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:52:38.693376 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.693251 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f566b39-800a-491d-b0d4-c3526a377554" (UID: "3f566b39-800a-491d-b0d4-c3526a377554"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:52:38.693488 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.693464 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-workload-certs\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:52:38.693596 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.693491 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-credential-socket\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:52:38.693596 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.693506 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-workload-socket\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:52:38.693596 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.693530 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f566b39-800a-491d-b0d4-c3526a377554-istiod-ca-cert\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:52:38.693984 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.693966 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f566b39-800a-491d-b0d4-c3526a377554" (UID: "3f566b39-800a-491d-b0d4-c3526a377554"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:52:38.695145 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.695120 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f566b39-800a-491d-b0d4-c3526a377554-kube-api-access-m5fvw" (OuterVolumeSpecName: "kube-api-access-m5fvw") pod "3f566b39-800a-491d-b0d4-c3526a377554" (UID: "3f566b39-800a-491d-b0d4-c3526a377554"). InnerVolumeSpecName "kube-api-access-m5fvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:52:38.695228 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.695197 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f566b39-800a-491d-b0d4-c3526a377554-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f566b39-800a-491d-b0d4-c3526a377554" (UID: "3f566b39-800a-491d-b0d4-c3526a377554"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 16:52:38.695567 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.695539 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f566b39-800a-491d-b0d4-c3526a377554" (UID: "3f566b39-800a-491d-b0d4-c3526a377554"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:52:38.695645 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.695544 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f566b39-800a-491d-b0d4-c3526a377554-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f566b39-800a-491d-b0d4-c3526a377554" (UID: "3f566b39-800a-491d-b0d4-c3526a377554"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:52:38.794383 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.794351 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-istio-data\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:52:38.794383 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.794377 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f566b39-800a-491d-b0d4-c3526a377554-istio-envoy\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:52:38.794383 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.794385 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f566b39-800a-491d-b0d4-c3526a377554-istio-token\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:52:38.794576 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.794394 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5fvw\" (UniqueName: \"kubernetes.io/projected/3f566b39-800a-491d-b0d4-c3526a377554-kube-api-access-m5fvw\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:52:38.794576 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.794404 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f566b39-800a-491d-b0d4-c3526a377554-istio-podinfo\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 16:52:38.987117 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.987089 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2"] Jul 09 16:52:38.991430 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:38.991408 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-756fbf8e-openshift-default-7444c69579-cqdr2"] Jul 09 16:52:39.764962 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:52:39.764928 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f566b39-800a-491d-b0d4-c3526a377554" path="/var/lib/kubelet/pods/3f566b39-800a-491d-b0d4-c3526a377554/volumes" Jul 09 16:54:35.685927 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:35.685897 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:54:35.689611 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:35.689592 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:54:46.955071 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:46.955036 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7"] Jul 09 16:54:46.955546 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:46.955530 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f566b39-800a-491d-b0d4-c3526a377554" containerName="istio-proxy" Jul 09 16:54:46.955608 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:46.955548 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f566b39-800a-491d-b0d4-c3526a377554" containerName="istio-proxy" Jul 09 16:54:46.955608 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:46.955578 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f566b39-800a-491d-b0d4-c3526a377554" containerName="istio-proxy" Jul 09 16:54:46.955608 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:46.955587 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f566b39-800a-491d-b0d4-c3526a377554" containerName="istio-proxy" Jul 09 16:54:46.955757 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:46.955672 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f566b39-800a-491d-b0d4-c3526a377554" containerName="istio-proxy" Jul 09 16:54:46.955757 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:46.955686 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f566b39-800a-491d-b0d4-c3526a377554" containerName="istio-proxy" Jul 09 16:54:46.959062 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:46.959042 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:46.961601 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:46.961582 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-9d86cf-openshift-default-dockercfg-25k5h\"" Jul 09 16:54:47.012285 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.012253 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7"] Jul 09 16:54:47.021295 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.021267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-envoy\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.021438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.021307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-data\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.021438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.021343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-token\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.021438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.021369 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-credential-socket\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.021438 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.021427 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-workload-socket\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.021575 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.021450 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-podinfo\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.021575 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.021477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istiod-ca-cert\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.021575 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.021506 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzcmk\" (UniqueName: \"kubernetes.io/projected/b8c331ba-e78f-4a0d-ae42-4bab420316e3-kube-api-access-dzcmk\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.021575 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.021528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-workload-certs\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.122857 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.122816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istiod-ca-cert\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123092 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.122862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzcmk\" (UniqueName: \"kubernetes.io/projected/b8c331ba-e78f-4a0d-ae42-4bab420316e3-kube-api-access-dzcmk\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123092 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.122903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-workload-certs\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123092 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.122951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-envoy\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123092 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.122989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-data\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123092 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.123053 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-token\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123092 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.123083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-credential-socket\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123422 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.123138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-workload-socket\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123422 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.123181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-podinfo\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123422 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.123362 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-data\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123581 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.123437 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-workload-certs\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123581 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.123547 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-credential-socket\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123687 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.123578 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-workload-socket\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.123917 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.123893 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istiod-ca-cert\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.125398 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.125370 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-envoy\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.125636 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.125619 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-podinfo\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.137164 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.137145 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-token\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.137256 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.137204 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzcmk\" (UniqueName: \"kubernetes.io/projected/b8c331ba-e78f-4a0d-ae42-4bab420316e3-kube-api-access-dzcmk\") pod \"e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.269197 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.269154 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:47.411326 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.411298 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7"] Jul 09 16:54:47.413661 ip-10-0-136-68 kubenswrapper[2579]: W0709 16:54:47.413635 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c331ba_e78f_4a0d_ae42_4bab420316e3.slice/crio-6d5479d56327b531f51d9991bc5d15707b5663ef059a8806a505b552818463a4 WatchSource:0}: Error finding container 6d5479d56327b531f51d9991bc5d15707b5663ef059a8806a505b552818463a4: Status 404 returned error can't find the container with id 6d5479d56327b531f51d9991bc5d15707b5663ef059a8806a505b552818463a4 Jul 09 16:54:47.416066 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.416037 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:54:47.416178 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.416121 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:54:47.416178 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:47.416167 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:54:48.291590 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:48.291552 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" event={"ID":"b8c331ba-e78f-4a0d-ae42-4bab420316e3","Type":"ContainerStarted","Data":"6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7"} Jul 09 16:54:48.291974 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:48.291616 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" event={"ID":"b8c331ba-e78f-4a0d-ae42-4bab420316e3","Type":"ContainerStarted","Data":"6d5479d56327b531f51d9991bc5d15707b5663ef059a8806a505b552818463a4"} Jul 09 16:54:48.311747 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:48.311697 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" podStartSLOduration=2.311681881 podStartE2EDuration="2.311681881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:54:48.310403009 +0000 UTC m=+2113.228974366" watchObservedRunningTime="2026-07-09 16:54:48.311681881 +0000 UTC m=+2113.230253211" Jul 09 16:54:49.270049 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:49.269980 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:49.275333 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:49.275304 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:49.297275 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:49.297239 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:54:49.298349 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:54:49.298328 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:55:05.339217 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:05.339161 2579 patch_prober.go:28] interesting pod/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 16:55:05.339627 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:05.339257 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 16:55:06.381552 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:06.381519 2579 generic.go:356] "Generic (PLEG): container finished" podID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerID="6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7" exitCode=0 Jul 09 16:55:06.381978 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:06.381575 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" event={"ID":"b8c331ba-e78f-4a0d-ae42-4bab420316e3","Type":"ContainerDied","Data":"6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7"} Jul 09 16:55:06.382057 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:06.382041 2579 scope.go:117] "RemoveContainer" containerID="6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7" Jul 09 16:55:06.383154 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:06.383122 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:55:06.383258 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:06.383198 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:55:06.383258 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:06.383231 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 16:55:07.392248 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:07.392211 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" event={"ID":"b8c331ba-e78f-4a0d-ae42-4bab420316e3","Type":"ContainerStarted","Data":"33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c"} Jul 09 16:55:08.269924 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:08.269883 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:55:08.270149 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:08.270038 2579 patch_prober.go:28] interesting pod/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 09 16:55:08.270149 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:08.270084 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 09 16:55:09.269940 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:09.269902 2579 patch_prober.go:28] interesting pod/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 09 16:55:09.270984 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:09.270534 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 09 16:55:10.269745 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:10.269707 2579 patch_prober.go:28] interesting pod/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 09 16:55:10.270041 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:10.269999 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 09 16:55:11.270166 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:11.270121 2579 patch_prober.go:28] interesting pod/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 09 16:55:11.270588 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:11.270213 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 09 16:55:12.273618 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:12.273586 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:55:12.274070 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:12.273965 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:55:12.274791 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:55:12.274771 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 16:59:35.718921 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:59:35.718895 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 16:59:35.723972 ip-10-0-136-68 kubenswrapper[2579]: I0709 16:59:35.723952 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 17:00:01.682237 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:01.682163 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7"] Jul 09 17:00:01.682677 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:01.682379 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerName="istio-proxy" containerID="cri-o://33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c" gracePeriod=30 Jul 09 17:00:06.939316 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:06.939290 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 17:00:07.041615 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.041578 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzcmk\" (UniqueName: \"kubernetes.io/projected/b8c331ba-e78f-4a0d-ae42-4bab420316e3-kube-api-access-dzcmk\") pod \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " Jul 09 17:00:07.041795 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.041635 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-workload-socket\") pod \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " Jul 09 17:00:07.041795 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.041673 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-data\") pod \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " Jul 09 17:00:07.041795 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.041723 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-workload-certs\") pod \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " Jul 09 17:00:07.041935 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.041856 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-token\") pod \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " Jul 09 17:00:07.041935 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.041898 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istiod-ca-cert\") pod \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " Jul 09 17:00:07.042074 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.041935 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-credential-socket\") pod \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " Jul 09 17:00:07.042074 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.041970 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-envoy\") pod \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " Jul 09 17:00:07.042074 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.042042 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8c331ba-e78f-4a0d-ae42-4bab420316e3" (UID: "b8c331ba-e78f-4a0d-ae42-4bab420316e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:00:07.042074 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.042064 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8c331ba-e78f-4a0d-ae42-4bab420316e3" (UID: "b8c331ba-e78f-4a0d-ae42-4bab420316e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:00:07.042278 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.042054 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-podinfo\") pod \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\" (UID: \"b8c331ba-e78f-4a0d-ae42-4bab420316e3\") " Jul 09 17:00:07.042430 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.042373 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8c331ba-e78f-4a0d-ae42-4bab420316e3" (UID: "b8c331ba-e78f-4a0d-ae42-4bab420316e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:00:07.042564 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.042475 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-workload-socket\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 17:00:07.042564 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.042476 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8c331ba-e78f-4a0d-ae42-4bab420316e3" (UID: "b8c331ba-e78f-4a0d-ae42-4bab420316e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:00:07.042564 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.042494 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-workload-certs\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 17:00:07.042564 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.042508 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-credential-socket\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 17:00:07.042779 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.042661 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8c331ba-e78f-4a0d-ae42-4bab420316e3" (UID: "b8c331ba-e78f-4a0d-ae42-4bab420316e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:00:07.044223 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.044200 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c331ba-e78f-4a0d-ae42-4bab420316e3-kube-api-access-dzcmk" (OuterVolumeSpecName: "kube-api-access-dzcmk") pod "b8c331ba-e78f-4a0d-ae42-4bab420316e3" (UID: "b8c331ba-e78f-4a0d-ae42-4bab420316e3"). InnerVolumeSpecName "kube-api-access-dzcmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:00:07.044335 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.044215 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8c331ba-e78f-4a0d-ae42-4bab420316e3" (UID: "b8c331ba-e78f-4a0d-ae42-4bab420316e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:00:07.044494 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.044473 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8c331ba-e78f-4a0d-ae42-4bab420316e3" (UID: "b8c331ba-e78f-4a0d-ae42-4bab420316e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:00:07.044494 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.044481 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8c331ba-e78f-4a0d-ae42-4bab420316e3" (UID: "b8c331ba-e78f-4a0d-ae42-4bab420316e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:00:07.143981 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.143940 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzcmk\" (UniqueName: \"kubernetes.io/projected/b8c331ba-e78f-4a0d-ae42-4bab420316e3-kube-api-access-dzcmk\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 17:00:07.143981 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.143974 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-data\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 17:00:07.143981 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.143985 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-token\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 17:00:07.144269 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.143994 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istiod-ca-cert\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 17:00:07.144269 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.144028 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-envoy\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 17:00:07.144269 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.144038 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8c331ba-e78f-4a0d-ae42-4bab420316e3-istio-podinfo\") on node \"ip-10-0-136-68.ec2.internal\" DevicePath \"\"" Jul 09 17:00:07.794242 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.794208 2579 generic.go:356] "Generic (PLEG): container finished" podID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerID="33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c" exitCode=0 Jul 09 17:00:07.794404 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.794252 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" Jul 09 17:00:07.794404 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.794244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" event={"ID":"b8c331ba-e78f-4a0d-ae42-4bab420316e3","Type":"ContainerDied","Data":"33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c"} Jul 09 17:00:07.794404 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.794368 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7" event={"ID":"b8c331ba-e78f-4a0d-ae42-4bab420316e3","Type":"ContainerDied","Data":"6d5479d56327b531f51d9991bc5d15707b5663ef059a8806a505b552818463a4"} Jul 09 17:00:07.794404 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.794390 2579 scope.go:117] "RemoveContainer" containerID="33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c" Jul 09 17:00:07.803431 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.803234 2579 scope.go:117] "RemoveContainer" containerID="6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7" Jul 09 17:00:07.811935 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.811913 2579 scope.go:117] "RemoveContainer" containerID="33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c" Jul 09 17:00:07.812415 ip-10-0-136-68 kubenswrapper[2579]: E0709 17:00:07.812307 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c\": container with ID starting with 33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c not found: ID does not exist" containerID="33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c" Jul 09 17:00:07.812415 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.812345 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c"} err="failed to get container status \"33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c\": rpc error: code = NotFound desc = could not find container \"33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c\": container with ID starting with 33b8914f677b4e4e8ae5c67ded6b8aa71599881c82735741d2b06e683ec24d7c not found: ID does not exist" Jul 09 17:00:07.812415 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.812370 2579 scope.go:117] "RemoveContainer" containerID="6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7" Jul 09 17:00:07.812724 ip-10-0-136-68 kubenswrapper[2579]: E0709 17:00:07.812700 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7\": container with ID starting with 6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7 not found: ID does not exist" containerID="6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7" Jul 09 17:00:07.812789 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.812743 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7"} err="failed to get container status \"6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7\": rpc error: code = NotFound desc = could not find container \"6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7\": container with ID starting with 6a245526c0fa51a89d5c98206db84f2afe6676537f09d5493d59ad43c6eeaef7 not found: ID does not exist" Jul 09 17:00:07.814382 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.814362 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7"] Jul 09 17:00:07.817339 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:07.817316 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-9d86cf-openshift-default-74995d455c-p2qc7"] Jul 09 17:00:09.767640 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:00:09.767597 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" path="/var/lib/kubelet/pods/b8c331ba-e78f-4a0d-ae42-4bab420316e3/volumes" Jul 09 17:04:35.746703 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:04:35.746627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 17:04:35.752173 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:04:35.752153 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2gz42_e7090715-8cae-4699-9092-38e8bb46ce56/ovn-acl-logging/0.log" Jul 09 17:07:59.927814 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:07:59.927784 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-p7n7b_04024ae3-234a-4cda-9e8c-8ba7ab2b2c34/manager/0.log" Jul 09 17:08:00.045248 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:00.045216 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-bwvhw_7015bcc1-1c04-48cd-8c7a-5620d59be538/manager/0.log" Jul 09 17:08:00.520691 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:00.520664 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bd696597f-k54zh_faf80e67-0559-4352-aaaa-fa547df6e787/copy-manifests/0.log" Jul 09 17:08:00.533023 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:00.532980 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bd696597f-k54zh_faf80e67-0559-4352-aaaa-fa547df6e787/manager/0.log" Jul 09 17:08:03.097033 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:03.096970 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fbhd5_9bba78b7-9508-4213-a15a-f7fa2e519d40/manager/0.log" Jul 09 17:08:03.341065 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:03.341032 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-284kn_43a03971-7a20-4e7a-ac3f-f35e60ce25ce/manager/0.log" Jul 09 17:08:03.685130 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:03.685086 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42bqxz_f638b40f-3d4f-43c1-b946-d708b18df685/istio-proxy/0.log" Jul 09 17:08:03.800510 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:03.800481 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mrdzx_6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6/discovery/0.log" Jul 09 17:08:03.911554 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:03.911524 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-868f9f885b-6xghb_ab106f1e-fa20-4f55-8eea-0a85c23723aa/kube-auth-proxy/0.log" Jul 09 17:08:04.141665 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:04.141636 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wlzjt_6882e1ea-646c-468e-8666-e9bd84cce36a/istio-proxy/1.log" Jul 09 17:08:04.254080 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:04.254052 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nkzvf_d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59/payload-pre-processing/0.log" Jul 09 17:08:04.938757 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:04.938725 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-xsfdp_f63fd7fa-cd15-43f3-b3b1-fc37ea4d0f9d/main/0.log" Jul 09 17:08:05.160493 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:05.160462 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6wlm6_f0f01cb0-d90c-45b8-90cc-762b3ec6b398/main/0.log" Jul 09 17:08:05.271701 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:05.271676 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-m6sx4_c6951061-dcbb-46ef-88e5-b8511a12878a/main/0.log" Jul 09 17:08:12.596387 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:12.596334 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sv2vz_6f72de83-30e7-44bf-aa2e-f506b2358e31/global-pull-secret-syncer/0.log" Jul 09 17:08:12.677943 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:12.677915 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lrlzz_3b350930-4666-4d3c-a663-d0940d49511e/konnectivity-agent/0.log" Jul 09 17:08:12.764833 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:12.764802 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-68.ec2.internal_5a636bbdd5023b50004b217a7742580f/haproxy/0.log" Jul 09 17:08:18.678565 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:18.678534 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fbhd5_9bba78b7-9508-4213-a15a-f7fa2e519d40/manager/0.log" Jul 09 17:08:18.811058 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:18.811027 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-284kn_43a03971-7a20-4e7a-ac3f-f35e60ce25ce/manager/0.log" Jul 09 17:08:20.647245 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:20.647160 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-42bpb_70b42ae1-d084-4f97-bbab-358e8aa27134/kube-state-metrics/0.log" Jul 09 17:08:20.669919 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:20.669893 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-42bpb_70b42ae1-d084-4f97-bbab-358e8aa27134/kube-rbac-proxy-main/0.log" Jul 09 17:08:20.693454 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:20.693433 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-42bpb_70b42ae1-d084-4f97-bbab-358e8aa27134/kube-rbac-proxy-self/0.log" Jul 09 17:08:20.728605 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:20.728582 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56d45c967f-7kkf9_f8f1d296-10ea-49da-b87f-1d3c86ed2001/metrics-server/0.log" Jul 09 17:08:20.984278 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:20.984179 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfq4v_70301ea1-d4b9-4b8e-998e-e11fb2f494ce/node-exporter/0.log" Jul 09 17:08:21.005374 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:21.005343 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfq4v_70301ea1-d4b9-4b8e-998e-e11fb2f494ce/kube-rbac-proxy/0.log" Jul 09 17:08:21.038460 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:21.038437 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfq4v_70301ea1-d4b9-4b8e-998e-e11fb2f494ce/init-textfile/0.log" Jul 09 17:08:21.157481 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:21.157447 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2569c2ad-e968-4487-9bf7-33ffe562ff84/prometheus/0.log" Jul 09 17:08:21.178697 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:21.178653 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2569c2ad-e968-4487-9bf7-33ffe562ff84/config-reloader/0.log" Jul 09 17:08:21.202689 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:21.202655 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2569c2ad-e968-4487-9bf7-33ffe562ff84/thanos-sidecar/0.log" Jul 09 17:08:21.224275 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:21.224258 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2569c2ad-e968-4487-9bf7-33ffe562ff84/kube-rbac-proxy-web/0.log" Jul 09 17:08:21.245409 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:21.245356 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2569c2ad-e968-4487-9bf7-33ffe562ff84/kube-rbac-proxy/0.log" Jul 09 17:08:21.265782 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:21.265766 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2569c2ad-e968-4487-9bf7-33ffe562ff84/kube-rbac-proxy-thanos/0.log" Jul 09 17:08:21.287078 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:21.287063 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2569c2ad-e968-4487-9bf7-33ffe562ff84/init-config-reloader/0.log" Jul 09 17:08:21.426413 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:21.426391 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86bfc65db9-l9jxk_0490a9e6-caa4-4146-8f17-86d7be9c4e6c/telemeter-client/0.log" Jul 09 17:08:21.449251 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:21.449231 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86bfc65db9-l9jxk_0490a9e6-caa4-4146-8f17-86d7be9c4e6c/reload/0.log" Jul 09 17:08:21.485309 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:21.485291 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86bfc65db9-l9jxk_0490a9e6-caa4-4146-8f17-86d7be9c4e6c/kube-rbac-proxy/0.log" Jul 09 17:08:23.401832 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.398852 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt"] Jul 09 17:08:23.401832 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.399667 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerName="istio-proxy" Jul 09 17:08:23.401832 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.399688 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerName="istio-proxy" Jul 09 17:08:23.401832 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.399722 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerName="istio-proxy" Jul 09 17:08:23.401832 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.399731 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerName="istio-proxy" Jul 09 17:08:23.401832 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.399911 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerName="istio-proxy" Jul 09 17:08:23.401832 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.399932 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8c331ba-e78f-4a0d-ae42-4bab420316e3" containerName="istio-proxy" Jul 09 17:08:23.404062 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.404026 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.406776 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.406752 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7jqtn\"/\"openshift-service-ca.crt\"" Jul 09 17:08:23.407767 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.407750 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7jqtn\"/\"default-dockercfg-r67xr\"" Jul 09 17:08:23.407767 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.407761 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7jqtn\"/\"kube-root-ca.crt\"" Jul 09 17:08:23.411170 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.411146 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt"] Jul 09 17:08:23.552226 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.552194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-sys\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.552422 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.552261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-lib-modules\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.552422 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.552311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-podres\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.552422 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.552347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9x7j\" (UniqueName: \"kubernetes.io/projected/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-kube-api-access-r9x7j\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.552560 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.552436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-proc\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.653152 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.653058 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-sys\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.653152 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.653093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-lib-modules\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.653152 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.653132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-podres\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.653418 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.653167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9x7j\" (UniqueName: \"kubernetes.io/projected/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-kube-api-access-r9x7j\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.653418 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.653183 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-sys\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.653418 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.653228 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-lib-modules\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.653418 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.653242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-proc\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.653418 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.653275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-proc\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.653418 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.653306 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-podres\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.660962 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.660940 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9x7j\" (UniqueName: \"kubernetes.io/projected/c3c9f8df-df7f-4a06-962f-ce0e989bc08e-kube-api-access-r9x7j\") pod \"perf-node-gather-daemonset-n9pdt\" (UID: \"c3c9f8df-df7f-4a06-962f-ce0e989bc08e\") " pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.716184 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.716158 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:23.854707 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.854682 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dc48bccdd-ncz62_59fa6de1-0010-4f99-9203-8198f35e0035/console/0.log" Jul 09 17:08:23.855337 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:23.855311 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt"] Jul 09 17:08:23.857072 ip-10-0-136-68 kubenswrapper[2579]: W0709 17:08:23.857050 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc3c9f8df_df7f_4a06_962f_ce0e989bc08e.slice/crio-88e554ef1ae46e460ba50926a6bfee95151030b04ee3fb53a44b06857383ddae WatchSource:0}: Error finding container 88e554ef1ae46e460ba50926a6bfee95151030b04ee3fb53a44b06857383ddae: Status 404 returned error can't find the container with id 88e554ef1ae46e460ba50926a6bfee95151030b04ee3fb53a44b06857383ddae Jul 09 17:08:24.086734 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:24.086699 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" event={"ID":"c3c9f8df-df7f-4a06-962f-ce0e989bc08e","Type":"ContainerStarted","Data":"1ff6be7f453debb73788ad055abab399ec94d78c0c953621a1364cebd9e9f8bc"} Jul 09 17:08:24.086901 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:24.086751 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" event={"ID":"c3c9f8df-df7f-4a06-962f-ce0e989bc08e","Type":"ContainerStarted","Data":"88e554ef1ae46e460ba50926a6bfee95151030b04ee3fb53a44b06857383ddae"} Jul 09 17:08:24.086901 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:24.086834 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:24.102574 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:24.102519 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" podStartSLOduration=1.102504777 podStartE2EDuration="1.102504777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:08:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:08:24.101225662 +0000 UTC m=+2929.019796994" watchObservedRunningTime="2026-07-09 17:08:24.102504777 +0000 UTC m=+2929.021076142" Jul 09 17:08:25.532414 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:25.532383 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tqcq5_b0b21e1c-e140-4f27-8883-6c04c6e7041c/dns/0.log" Jul 09 17:08:25.554080 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:25.554053 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tqcq5_b0b21e1c-e140-4f27-8883-6c04c6e7041c/kube-rbac-proxy/0.log" Jul 09 17:08:25.678396 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:25.678359 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vncrr_4bc9ab36-d3a5-498c-b475-8ee3766e22ba/dns-node-resolver/0.log" Jul 09 17:08:26.223019 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:26.222976 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54b8dd799c-drkx7_6aed1829-a31e-42b5-abb0-88e805c7a227/registry/0.log" Jul 09 17:08:26.242689 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:26.242663 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rhv24_25d1d3b8-87e8-420e-bfe7-e911c28de230/node-ca/0.log" Jul 09 17:08:27.193274 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:27.193243 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42bqxz_f638b40f-3d4f-43c1-b946-d708b18df685/istio-proxy/0.log" Jul 09 17:08:27.308136 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:27.308100 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mrdzx_6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6/discovery/0.log" Jul 09 17:08:27.400514 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:27.400486 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-868f9f885b-6xghb_ab106f1e-fa20-4f55-8eea-0a85c23723aa/kube-auth-proxy/0.log" Jul 09 17:08:27.483387 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:27.483312 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wlzjt_6882e1ea-646c-468e-8666-e9bd84cce36a/istio-proxy/0.log" Jul 09 17:08:27.516659 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:27.516632 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wlzjt_6882e1ea-646c-468e-8666-e9bd84cce36a/istio-proxy/1.log" Jul 09 17:08:27.563889 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:27.563862 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nkzvf_d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59/payload-pre-processing/0.log" Jul 09 17:08:28.383079 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:28.383053 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cc55l_678c07ab-a5c6-4759-9f6d-84016f2808b6/serve-healthcheck-canary/0.log" Jul 09 17:08:29.110843 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:29.110814 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlwd8_f3f16d4e-7999-4f39-980f-e2f0d3559b0a/kube-rbac-proxy/0.log" Jul 09 17:08:29.132270 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:29.132245 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlwd8_f3f16d4e-7999-4f39-980f-e2f0d3559b0a/exporter/0.log" Jul 09 17:08:29.153566 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:29.153539 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlwd8_f3f16d4e-7999-4f39-980f-e2f0d3559b0a/extractor/0.log" Jul 09 17:08:30.102076 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:30.102049 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7jqtn/perf-node-gather-daemonset-n9pdt" Jul 09 17:08:31.253624 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:31.253597 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-p7n7b_04024ae3-234a-4cda-9e8c-8ba7ab2b2c34/manager/0.log" Jul 09 17:08:31.396025 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:31.395988 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-bwvhw_7015bcc1-1c04-48cd-8c7a-5620d59be538/manager/0.log" Jul 09 17:08:31.714079 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:31.714048 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bd696597f-k54zh_faf80e67-0559-4352-aaaa-fa547df6e787/manager/0.log" Jul 09 17:08:31.733131 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:31.733109 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bd696597f-k54zh_faf80e67-0559-4352-aaaa-fa547df6e787/copy-manifests/0.log" Jul 09 17:08:33.520681 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:33.520653 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42bqxz_f638b40f-3d4f-43c1-b946-d708b18df685/istio-proxy/0.log" Jul 09 17:08:33.651198 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:33.651170 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mrdzx_6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6/discovery/0.log" Jul 09 17:08:33.662365 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:33.662341 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-868f9f885b-6xghb_ab106f1e-fa20-4f55-8eea-0a85c23723aa/kube-auth-proxy/0.log" Jul 09 17:08:33.698168 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:33.698140 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wlzjt_6882e1ea-646c-468e-8666-e9bd84cce36a/istio-proxy/0.log" Jul 09 17:08:33.726174 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:33.726146 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wlzjt_6882e1ea-646c-468e-8666-e9bd84cce36a/istio-proxy/1.log" Jul 09 17:08:33.754511 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:33.754485 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nkzvf_d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59/payload-pre-processing/0.log" Jul 09 17:08:34.971669 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:34.971638 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42bqxz_f638b40f-3d4f-43c1-b946-d708b18df685/istio-proxy/0.log" Jul 09 17:08:35.099372 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:35.099342 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mrdzx_6ed2cff4-c9d7-4dde-ab4e-bfc4c7f497f6/discovery/0.log" Jul 09 17:08:35.110849 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:35.110823 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-868f9f885b-6xghb_ab106f1e-fa20-4f55-8eea-0a85c23723aa/kube-auth-proxy/0.log" Jul 09 17:08:35.146651 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:35.146619 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wlzjt_6882e1ea-646c-468e-8666-e9bd84cce36a/istio-proxy/0.log" Jul 09 17:08:35.177727 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:35.177698 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wlzjt_6882e1ea-646c-468e-8666-e9bd84cce36a/istio-proxy/1.log" Jul 09 17:08:35.208759 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:35.208729 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nkzvf_d3b5d5cf-4d4c-467c-a542-0db2aaf1eb59/payload-pre-processing/0.log" Jul 09 17:08:39.906256 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:39.906228 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9k6g_05665ae0-dbfa-4fdf-b7f8-223e87d067d2/kube-multus-additional-cni-plugins/0.log" Jul 09 17:08:39.930511 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:39.930486 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9k6g_05665ae0-dbfa-4fdf-b7f8-223e87d067d2/egress-router-binary-copy/0.log" Jul 09 17:08:39.953813 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:39.953795 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9k6g_05665ae0-dbfa-4fdf-b7f8-223e87d067d2/cni-plugins/0.log" Jul 09 17:08:39.978344 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:39.978321 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9k6g_05665ae0-dbfa-4fdf-b7f8-223e87d067d2/bond-cni-plugin/0.log" Jul 09 17:08:40.008882 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:40.008866 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9k6g_05665ae0-dbfa-4fdf-b7f8-223e87d067d2/routeoverride-cni/0.log" Jul 09 17:08:40.039685 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:40.039663 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9k6g_05665ae0-dbfa-4fdf-b7f8-223e87d067d2/whereabouts-cni-bincopy/0.log" Jul 09 17:08:40.077844 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:40.077822 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9k6g_05665ae0-dbfa-4fdf-b7f8-223e87d067d2/whereabouts-cni/0.log" Jul 09 17:08:40.410665 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:40.410622 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rcg8w_384df07c-6bfc-4b00-b3cd-d2a1fb445456/kube-multus/0.log" Jul 09 17:08:40.538300 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:40.538268 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m7dk6_9317c64f-d51f-422c-a451-9e6e408c9a92/network-metrics-daemon/0.log" Jul 09 17:08:40.563147 ip-10-0-136-68 kubenswrapper[2579]: I0709 17:08:40.563123 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m7dk6_9317c64f-d51f-422c-a451-9e6e408c9a92/kube-rbac-proxy/0.log"