Jul 07 13:57:19.716573 ip-10-0-136-167 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 13:57:19.716586 ip-10-0-136-167 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 13:57:19.716596 ip-10-0-136-167 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 13:57:19.716896 ip-10-0-136-167 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 13:57:29.856356 ip-10-0-136-167 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 13:57:29.856372 ip-10-0-136-167 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e7e4a966fc874608aa6f9b447e1df093 -- Jul 07 13:59:27.716481 ip-10-0-136-167 systemd[1]: Starting Kubernetes Kubelet... Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.084382 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088756 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088769 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088773 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088776 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088779 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088782 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088784 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:59:28.201251 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088793 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:59:28.164972 ip-10-0-136-167 systemd[1]: Started Kubernetes Kubelet. Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088796 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088799 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088802 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088805 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088807 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088810 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088813 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088816 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088818 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088821 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088824 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088826 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088829 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088831 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088834 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088836 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088839 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088842 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088844 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:59:28.202656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088847 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088849 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088852 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088854 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088857 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088859 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088862 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088865 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088867 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088870 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088873 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088875 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088878 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088881 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088884 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088886 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088889 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088891 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088894 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088897 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:59:28.204259 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088900 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088902 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088908 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088912 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088914 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088917 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088920 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088922 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088924 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088928 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088931 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088934 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088936 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088939 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088942 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088944 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088946 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088949 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088951 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:59:28.205138 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088954 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088957 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088960 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088963 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088965 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088968 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088970 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088973 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088976 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088979 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088981 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088984 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088987 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088989 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088992 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088994 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088997 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.088999 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089002 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089004 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:59:28.206455 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089006 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089012 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089015 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089018 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089021 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089023 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089027 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089029 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089031 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089034 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089037 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089039 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.089043 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.090963 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.090975 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.090978 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.090981 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.090984 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.090987 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:59:28.207434 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.090990 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.090993 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.090996 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.090999 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091002 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091005 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091008 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091010 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091013 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091016 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091019 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091023 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091028 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091031 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091034 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091037 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091039 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091044 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091048 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:59:28.208470 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091051 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091053 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091056 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091059 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091062 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091064 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091067 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091071 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091074 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091076 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091079 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091082 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091084 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091086 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091089 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091092 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091094 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091097 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091099 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:59:28.209682 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091102 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091104 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091107 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091137 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091142 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091146 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091150 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091152 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091155 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091159 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091162 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091165 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091168 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091171 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091173 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091175 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091179 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091182 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091185 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091188 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:59:28.210646 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091191 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091193 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091197 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091199 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091202 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091204 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091207 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091209 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091212 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091214 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091217 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091219 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091238 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091241 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091244 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091246 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091249 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091252 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091254 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091257 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:59:28.211745 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091260 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091262 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091265 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091268 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091270 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091273 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091276 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091279 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091281 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091285 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091288 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091290 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091293 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091295 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091297 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091675 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091680 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091682 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091685 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:59:28.212636 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091690 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091694 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091696 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091699 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091702 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091704 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091707 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091710 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091712 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091715 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091718 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091720 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091723 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091726 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091730 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091734 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091737 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091740 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091743 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:59:28.213158 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091746 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091749 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091751 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091754 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091757 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091759 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091762 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091764 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091767 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091770 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091772 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091775 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091778 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091780 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091783 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091785 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091788 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091790 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091793 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091795 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:59:28.216282 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091798 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091801 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091803 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091805 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091808 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091810 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091813 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091816 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091819 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091821 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091824 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091826 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091829 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091833 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091837 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091839 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091842 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091845 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091848 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:59:28.217029 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091850 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091853 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091855 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091858 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091860 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091863 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091865 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091867 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091870 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091872 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091875 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091878 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091881 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091883 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091886 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091889 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091892 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091895 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091897 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:59:28.217663 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091900 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091902 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091905 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091908 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091911 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091913 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091916 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091919 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091921 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091937 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091940 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091943 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091946 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091949 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091952 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091954 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091957 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.091960 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092023 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092030 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092904 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 13:59:28.218485 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092909 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092914 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092917 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092922 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092926 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092929 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092932 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092936 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092940 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092944 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092947 2583 flags.go:64] FLAG: --cgroup-root="" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092950 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092953 2583 flags.go:64] FLAG: --client-ca-file="" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092957 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092960 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092968 2583 flags.go:64] FLAG: --cluster-domain="" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092970 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092973 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092976 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092980 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092984 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092987 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092990 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 13:59:28.219390 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092993 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092996 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.092999 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093002 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093005 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093008 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093012 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093016 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093019 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093022 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093035 2583 flags.go:64] FLAG: --enable-server="true" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093038 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093045 2583 flags.go:64] FLAG: --event-burst="100" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093048 2583 flags.go:64] FLAG: --event-qps="50" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093052 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093055 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093060 2583 flags.go:64] FLAG: --eviction-hard="" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093064 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093067 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093070 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093073 2583 flags.go:64] FLAG: --eviction-soft="" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093076 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093078 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093082 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093085 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 13:59:28.220023 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093087 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093090 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093093 2583 flags.go:64] FLAG: --feature-gates="" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093097 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093100 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093102 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093105 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093108 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093111 2583 flags.go:64] FLAG: --help="false" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093114 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093118 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093121 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093124 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093127 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093130 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093133 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093136 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093139 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093142 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093145 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093148 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093151 2583 flags.go:64] FLAG: --kube-reserved="" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093154 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093158 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 13:59:28.220845 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093161 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093164 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093166 2583 flags.go:64] FLAG: --lock-file="" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093169 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093172 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093175 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093184 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093187 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093190 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093193 2583 flags.go:64] FLAG: --logging-format="text" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093196 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093199 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093202 2583 flags.go:64] FLAG: --manifest-url="" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093204 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093209 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093212 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093216 2583 flags.go:64] FLAG: --max-pods="110" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093219 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093288 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093292 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093295 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093298 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093301 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093304 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093313 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 13:59:28.221806 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093316 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093319 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093322 2583 flags.go:64] FLAG: --pod-cidr="" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093325 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093331 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093334 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093338 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093341 2583 flags.go:64] FLAG: --port="10250" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093344 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093347 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0af80df9f6dff274f" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093350 2583 flags.go:64] FLAG: --qos-reserved="" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093353 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093356 2583 flags.go:64] FLAG: --register-node="true" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093359 2583 flags.go:64] FLAG: --register-with-taints="" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093362 2583 flags.go:64] FLAG: --registry-burst="10" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093372 2583 flags.go:64] FLAG: --registry-qps="5" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093375 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093377 2583 flags.go:64] FLAG: --reserved-memory="" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093381 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093384 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093387 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093390 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093392 2583 flags.go:64] FLAG: --runonce="false" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093395 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093398 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 13:59:28.415996 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093401 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093403 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093406 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093409 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093412 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093415 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093418 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093422 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093425 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093428 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093431 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093434 2583 flags.go:64] FLAG: --system-cgroups="" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093436 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093443 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093446 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093448 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093453 2583 flags.go:64] FLAG: --tls-min-version="" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093455 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093458 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093461 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093464 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093467 2583 flags.go:64] FLAG: --v="2" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093470 2583 flags.go:64] FLAG: --version="false" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093480 2583 flags.go:64] FLAG: --vmodule="" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093483 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 13:59:28.432719 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.093487 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093611 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093615 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093619 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093622 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093625 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093627 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093630 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093633 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093655 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093659 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093663 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093666 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093670 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093675 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093679 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093683 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093686 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093690 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093694 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:59:28.434186 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093699 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093703 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093708 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093711 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093713 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093716 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093719 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093723 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093728 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093731 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093736 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093748 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093752 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093756 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093760 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093763 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093767 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093771 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093775 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093779 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:59:28.435195 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093783 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093786 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093791 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093794 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093798 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093801 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093807 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093811 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093815 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093819 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093822 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093826 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093833 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093839 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093843 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093846 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093850 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093854 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093858 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:59:28.436019 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093862 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093865 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093869 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093873 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093877 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093888 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093892 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093896 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093900 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093904 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093908 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093912 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093916 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093919 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093921 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093925 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093929 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093933 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093936 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093941 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:59:28.437125 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093945 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093949 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093953 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093958 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093963 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093969 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093975 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093980 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093984 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093988 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093992 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.093996 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.094000 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.094004 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.094008 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.094011 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.094016 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.094020 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.094031 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:59:28.437749 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.094035 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.094038 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.094957 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.102180 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.102197 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.102919 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.102930 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.102990 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.102995 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.102999 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103002 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103005 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103008 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103010 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103013 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:59:28.438314 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103019 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103022 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103025 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103028 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103030 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103033 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103036 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103038 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103041 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103043 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103046 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103048 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103051 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103055 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103057 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103060 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103062 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103065 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103068 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103072 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:59:28.438805 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103076 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103080 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103082 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103085 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103088 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103092 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103094 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103097 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103100 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103103 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103105 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103108 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103112 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103115 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103118 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103121 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103124 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103127 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103129 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103132 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:59:28.439485 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103134 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103137 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103139 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103142 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103144 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103148 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103151 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103154 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103156 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103159 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103163 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103166 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103169 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103172 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103176 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103178 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103181 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103184 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103187 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:59:28.440163 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103189 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103192 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103195 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103198 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103200 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103204 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103207 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103210 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103212 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103215 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103218 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103220 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103234 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103238 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103240 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103244 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103248 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103251 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103256 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103258 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:59:28.440790 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103261 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103263 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103266 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103269 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103271 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103274 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103276 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103279 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103282 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103285 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103287 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103290 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.103295 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103824 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103829 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:59:28.441418 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103832 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103834 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103837 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103842 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103846 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103849 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103852 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103870 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103874 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103877 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103880 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103883 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103886 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103888 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103891 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103895 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103897 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103900 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103903 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:59:28.441921 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103905 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103908 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103910 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103913 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103915 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103918 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103920 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103923 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103926 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103929 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103931 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103934 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103936 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103939 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103941 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103944 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103947 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103950 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103952 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103955 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:59:28.442535 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103958 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103961 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103963 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103967 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103971 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103974 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103976 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103979 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103983 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103986 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103988 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103991 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103993 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103996 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.103999 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104002 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104004 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104007 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104010 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:59:28.443211 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104012 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104016 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104018 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104021 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104023 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104026 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104028 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104031 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104034 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104038 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104040 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104043 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104045 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104048 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104051 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104053 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104056 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104058 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104061 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104064 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:59:28.443831 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104066 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104070 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104072 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104075 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104078 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104080 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104083 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104087 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104090 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104093 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104096 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104099 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104101 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104104 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104107 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104109 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104112 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104115 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:59:28.444500 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:28.104117 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:59:28.445048 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.104122 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 13:59:28.445048 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.104237 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 13:59:28.445048 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.106555 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 13:59:28.445048 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.108000 2583 server.go:1019] "Starting client certificate rotation" Jul 07 13:59:28.445048 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.108126 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 13:59:28.445048 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.108155 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 13:59:28.445048 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.110445 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 13:59:28.445048 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.111536 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 13:59:28.445048 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.124656 2583 log.go:25] "Validated CRI v1 runtime API" Jul 07 13:59:28.445048 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.129740 2583 log.go:25] "Validated CRI v1 image API" Jul 07 13:59:28.445048 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.130547 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 13:59:28.445048 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.132477 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 13:59:28.445562 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.134883 2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 83779c09-5697-4292-bfaa-befe4d2236f9:/dev/nvme0n1p3 f29ad64e-2d38-4407-983f-f764fa05223b:/dev/nvme0n1p4] Jul 07 13:59:28.445562 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.134900 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.140666 2583 manager.go:216] Machine: {Timestamp:2026-07-07 13:59:28.139330937 +0000 UTC m=+0.313118502 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099796 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f3242118e8f21e129b8c76a0dd350 SystemUUID:ec2f3242-118e-8f21-e129-b8c76a0dd350 BootID:e7e4a966-fc87-4608-aa6f-9b447e1df093 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c5:ee:03:07:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c5:ee:03:07:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:6e:99:5b:ce:9a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.140761 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.140867 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.143967 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.143994 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-167.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.145327 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.145339 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.145348 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.146008 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.147745 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.151081 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.151239 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.151273 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.151285 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.151303 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.151317 2583 kubelet.go:398] "Adding apiserver pod source" Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.151328 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 13:59:28.445738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.151709 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.151729 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.155200 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.157171 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.157199 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.158730 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.158745 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.158751 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.158757 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.158767 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.158773 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.158783 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.158793 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.158802 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.158808 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.158829 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.158835 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.160374 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.160384 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.162276 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-167.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.162289 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.162300 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.164039 2583 server.go:1268] "Started kubelet" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.164115 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.164133 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.164204 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.164753 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lf5lv" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.167153 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.169549 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.170568 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lf5lv" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.172126 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.174882 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-167.ec2.internal.18c006a753350e8d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-167.ec2.internal,UID:ip-10-0-136-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-167.ec2.internal,},FirstTimestamp:2026-07-07 13:59:28.164007565 +0000 UTC m=+0.337795130,LastTimestamp:2026-07-07 13:59:28.164007565 +0000 UTC m=+0.337795130,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-167.ec2.internal,}" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.180306 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.180318 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.180385 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.180870 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.180892 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.180922 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.181051 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.181059 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 07 13:59:28.446337 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.181215 2583 factory.go:55] Registering systemd factory Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.181248 2583 factory.go:223] Registration of the systemd container factory successfully Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.181456 2583 factory.go:153] Registering CRI-O factory Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.181471 2583 factory.go:223] Registration of the crio container factory successfully Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.181526 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.181550 2583 factory.go:103] Registering Raw factory Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.181566 2583 manager.go:1196] Started watching for new ooms in manager Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.189392 2583 manager.go:349] Starting recovery of all containers Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.192756 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.205603 2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-167.ec2.internal\" not found" node="ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.206111 2583 manager.go:354] Recovery completed Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.212361 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.214210 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.214256 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.214272 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.214749 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.214758 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.214773 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.214811 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.215495 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.215517 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.215526 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.215852 2583 policy_none.go:49] "None policy: Start" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.215874 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.215885 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.216708 2583 policy_none.go:47] "Start" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.258750 2583 manager.go:337] "Starting Device Plugin manager" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.258899 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.258911 2583 server.go:87] "Starting device plugin registration server" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.259139 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.259150 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.259272 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.259363 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.259371 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.259780 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.259825 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.359403 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.360369 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.360399 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.360410 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.360442 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.370563 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.370583 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-167.ec2.internal\": node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.398391 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.418744 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.420056 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.420084 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.420104 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.420135 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 13:59:28.447524 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.422660 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.498527 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.520702 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal"] Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.520789 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.522788 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.522817 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.522828 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.524070 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.524214 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.524262 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.524847 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.524858 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.524878 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.524890 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.524880 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.524972 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.526143 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.526163 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.526835 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.526858 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.526869 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.546817 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-167.ec2.internal\" not found" node="ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.554358 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-167.ec2.internal\" not found" node="ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.583527 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ddbd14da7139adf25758f98178d8d0ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal\" (UID: \"ddbd14da7139adf25758f98178d8d0ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.583548 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddbd14da7139adf25758f98178d8d0ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal\" (UID: \"ddbd14da7139adf25758f98178d8d0ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.583565 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/684e505a654ab219cfa598f20931a3ab-config\") pod \"kube-apiserver-proxy-ip-10-0-136-167.ec2.internal\" (UID: \"684e505a654ab219cfa598f20931a3ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.639176 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.599042 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:28.866295 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.684292 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ddbd14da7139adf25758f98178d8d0ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal\" (UID: \"ddbd14da7139adf25758f98178d8d0ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.866295 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.684326 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddbd14da7139adf25758f98178d8d0ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal\" (UID: \"ddbd14da7139adf25758f98178d8d0ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.866295 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.684343 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/684e505a654ab219cfa598f20931a3ab-config\") pod \"kube-apiserver-proxy-ip-10-0-136-167.ec2.internal\" (UID: \"684e505a654ab219cfa598f20931a3ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.866295 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.684372 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/684e505a654ab219cfa598f20931a3ab-config\") pod \"kube-apiserver-proxy-ip-10-0-136-167.ec2.internal\" (UID: \"684e505a654ab219cfa598f20931a3ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.866295 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.684410 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddbd14da7139adf25758f98178d8d0ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal\" (UID: \"ddbd14da7139adf25758f98178d8d0ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.866295 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.684410 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ddbd14da7139adf25758f98178d8d0ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal\" (UID: \"ddbd14da7139adf25758f98178d8d0ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.866295 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.700180 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:28.866295 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.800372 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:28.866295 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.850977 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 13:59:28.866295 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:28.859336 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" Jul 07 13:59:29.067708 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:28.901420 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:29.067708 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:29.001711 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:29.251381 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:29.102260 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:29.251381 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:29.107641 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 13:59:29.251381 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:29.107814 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 13:59:29.251381 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:29.107811 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 13:59:29.251381 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:29.178075 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 13:54:28 +0000 UTC" deadline="2028-01-01 22:12:34.182690653 +0000 UTC" Jul 07 13:59:29.251381 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:29.178098 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13040h13m5.004595101s" Jul 07 13:59:29.251381 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:29.199446 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:59:29.251381 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:29.202840 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:29.418977 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:29.303005 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:29.418977 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:29.403813 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:29.527036 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:29.504716 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-167.ec2.internal\" not found" Jul 07 13:59:29.597263 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:29.586217 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:59:29.654447 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:29.654397 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684e505a654ab219cfa598f20931a3ab.slice/crio-04986708293f2125b295710bc6ded03c3aa26f1ceab1bea19db442017395c164 WatchSource:0}: Error finding container 04986708293f2125b295710bc6ded03c3aa26f1ceab1bea19db442017395c164: Status 404 returned error can't find the container with id 04986708293f2125b295710bc6ded03c3aa26f1ceab1bea19db442017395c164 Jul 07 13:59:29.654656 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:29.654632 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddbd14da7139adf25758f98178d8d0ef.slice/crio-64d38743686a5270d41496e42f79872e33b2e3b868c1a13c9de10799411b6d25 WatchSource:0}: Error finding container 64d38743686a5270d41496e42f79872e33b2e3b868c1a13c9de10799411b6d25: Status 404 returned error can't find the container with id 64d38743686a5270d41496e42f79872e33b2e3b868c1a13c9de10799411b6d25 Jul 07 13:59:29.658737 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:29.658716 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 13:59:29.680485 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:29.680465 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" Jul 07 13:59:29.693158 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:29.693144 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 13:59:29.694209 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:29.694197 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" Jul 07 13:59:29.701358 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:29.701346 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 13:59:30.152738 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.152702 2583 apiserver.go:52] "Watching apiserver" Jul 07 13:59:30.161523 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.161496 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 13:59:30.162712 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.162686 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-xp88p","openshift-network-diagnostics/network-check-target-dxr69","kube-system/konnectivity-agent-swvbl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs","openshift-dns/node-resolver-qvpbf","openshift-multus/multus-additional-cni-plugins-l4kmx","openshift-multus/network-metrics-daemon-g7n7m","openshift-network-operator/iptables-alerter-ftzxm","openshift-ovn-kubernetes/ovnkube-node-ksnt5","kube-system/global-pull-secret-syncer-kkd6d","kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal","openshift-cluster-node-tuning-operator/tuned-n6h5x","openshift-image-registry/node-ca-8mhsp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal"] Jul 07 13:59:30.165415 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.165393 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:30.165509 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.165491 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:30.167607 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.167581 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8mhsp" Jul 07 13:59:30.169783 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.169764 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swvbl" Jul 07 13:59:30.170540 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.170520 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 13:59:30.170731 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.170712 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l9rsc\"" Jul 07 13:59:30.170873 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.170713 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 13:59:30.170979 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.170965 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 13:59:30.171982 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.171964 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.172931 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.172913 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 13:59:30.173021 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.172994 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 13:59:30.173079 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.173051 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-252w8\"" Jul 07 13:59:30.174111 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.174093 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qvpbf" Jul 07 13:59:30.174498 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.174478 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 13:59:30.174618 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.174546 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nbrvp\"" Jul 07 13:59:30.175017 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.174998 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 13:59:30.175106 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.175038 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 13:59:30.176445 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.176423 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.178323 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.178301 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sb6mq\"" Jul 07 13:59:30.178416 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.178397 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 13:59:30.178451 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.178428 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 13:59:30.178758 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.178742 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.179860 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.179842 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 13:59:30.179956 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.179861 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 13:59:30.179956 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.179848 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 13:59:30.180348 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.180332 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 13:59:30.180459 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.180335 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-llr8z\"" Jul 07 13:59:30.180643 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.180628 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 13:59:30.181083 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.181067 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 13:59:30.181315 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.181296 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.183651 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.183631 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:30.183738 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.183714 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:30.184630 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.184556 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 13:59:30.185054 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.184892 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 13:59:30.185937 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.185724 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 13:59:30.185937 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.185746 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 13:59:30.188403 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.187163 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:30.188403 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.187411 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:30.188980 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.188960 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 13:59:30.189151 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.189132 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 13:59:30.189197 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.189133 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 13:59:30.189197 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.189140 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ggsck\"" Jul 07 13:59:30.190201 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.190184 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5gqrv\"" Jul 07 13:59:30.190403 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.190365 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ftzxm" Jul 07 13:59:30.190978 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.190571 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-var-lib-openvswitch\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.190978 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.190620 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-log-socket\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.190978 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.190656 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:30.190978 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.190683 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e53774d3-9199-4e60-9c05-d506c750eb57-agent-certs\") pod \"konnectivity-agent-swvbl\" (UID: \"e53774d3-9199-4e60-9c05-d506c750eb57\") " pod="kube-system/konnectivity-agent-swvbl" Jul 07 13:59:30.190978 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.190714 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-device-dir\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.190978 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.190771 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.190978 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.190809 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-etc-selinux\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.190978 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.190842 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.190978 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.190898 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.190978 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.190949 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.191561 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191006 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-os-release\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.191561 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191054 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-etc-kubernetes\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.191561 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191114 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brqgf\" (UniqueName: \"kubernetes.io/projected/9de446cb-1f40-47b8-8a8b-b3eae68467b2-kube-api-access-brqgf\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.191561 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191161 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10dab8ee-1c27-48a5-b012-6571cff52216-ovnkube-config\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.191561 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191375 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e53774d3-9199-4e60-9c05-d506c750eb57-konnectivity-ca\") pod \"konnectivity-agent-swvbl\" (UID: \"e53774d3-9199-4e60-9c05-d506c750eb57\") " pod="kube-system/konnectivity-agent-swvbl" Jul 07 13:59:30.191561 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191453 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-system-cni-dir\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.191561 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191505 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-var-lib-cni-multus\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.191561 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191538 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.191943 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191893 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-run-openvswitch\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.191943 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191921 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10dab8ee-1c27-48a5-b012-6571cff52216-ovnkube-script-lib\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.191943 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191939 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1a809a6-2c4c-4c61-956a-a49b09d2da26-host\") pod \"node-ca-8mhsp\" (UID: \"a1a809a6-2c4c-4c61-956a-a49b09d2da26\") " pod="openshift-image-registry/node-ca-8mhsp" Jul 07 13:59:30.192075 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191962 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1a809a6-2c4c-4c61-956a-a49b09d2da26-serviceca\") pod \"node-ca-8mhsp\" (UID: \"a1a809a6-2c4c-4c61-956a-a49b09d2da26\") " pod="openshift-image-registry/node-ca-8mhsp" Jul 07 13:59:30.192075 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.191980 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-slash\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.192075 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192001 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-etc-openvswitch\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.192075 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192021 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-run-ovn\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.192075 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192059 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-multus-cni-dir\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.192433 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192080 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-multus-socket-dir-parent\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.192433 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192121 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-hostroot\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.192433 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192160 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.192433 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192185 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9de446cb-1f40-47b8-8a8b-b3eae68467b2-cni-binary-copy\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.192433 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192208 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4da12c5-b21c-4fd1-9516-fb2f2d934118-hosts-file\") pod \"node-resolver-qvpbf\" (UID: \"b4da12c5-b21c-4fd1-9516-fb2f2d934118\") " pod="openshift-dns/node-resolver-qvpbf" Jul 07 13:59:30.192433 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192279 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plvxd\" (UniqueName: \"kubernetes.io/projected/b4da12c5-b21c-4fd1-9516-fb2f2d934118-kube-api-access-plvxd\") pod \"node-resolver-qvpbf\" (UID: \"b4da12c5-b21c-4fd1-9516-fb2f2d934118\") " pod="openshift-dns/node-resolver-qvpbf" Jul 07 13:59:30.192433 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192329 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-socket-dir\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.192433 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192353 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-var-lib-kubelet\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.192433 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192376 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-run-netns\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.192836 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192438 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rznj\" (UniqueName: \"kubernetes.io/projected/10dab8ee-1c27-48a5-b012-6571cff52216-kube-api-access-9rznj\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.192836 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192483 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7wmw\" (UniqueName: \"kubernetes.io/projected/45b31c2e-32c0-441b-a10a-2e25700bbb10-kube-api-access-n7wmw\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:30.192836 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192516 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmn45\" (UniqueName: \"kubernetes.io/projected/a1a809a6-2c4c-4c61-956a-a49b09d2da26-kube-api-access-dmn45\") pod \"node-ca-8mhsp\" (UID: \"a1a809a6-2c4c-4c61-956a-a49b09d2da26\") " pod="openshift-image-registry/node-ca-8mhsp" Jul 07 13:59:30.192836 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192647 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4da12c5-b21c-4fd1-9516-fb2f2d934118-tmp-dir\") pod \"node-resolver-qvpbf\" (UID: \"b4da12c5-b21c-4fd1-9516-fb2f2d934118\") " pod="openshift-dns/node-resolver-qvpbf" Jul 07 13:59:30.192836 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192671 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-sys-fs\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.192836 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192739 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5696\" (UniqueName: \"kubernetes.io/projected/6208511b-989b-4362-9ef5-7989b57cfba9-kube-api-access-h5696\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.192836 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192794 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.192836 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192805 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-node-log\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.193125 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192846 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-cni-netd\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.193125 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192924 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-run-k8s-cni-cncf-io\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.193125 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192950 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.193125 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192974 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-system-cni-dir\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.193125 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.192999 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-systemd-units\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.193125 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193021 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10dab8ee-1c27-48a5-b012-6571cff52216-env-overrides\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.193125 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193042 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-var-lib-cni-bin\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.193125 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193063 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-registration-dir\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.193125 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193086 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-cnibin\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.193125 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193116 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10dab8ee-1c27-48a5-b012-6571cff52216-ovn-node-metrics-cert\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.193567 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193138 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-cnibin\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.193567 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193161 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-run-netns\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.193567 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193184 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-multus-conf-dir\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.193567 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193214 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-os-release\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.193567 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193300 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-cni-bin\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.193567 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193348 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-run-multus-certs\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.193567 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193371 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-kubelet\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.193567 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193440 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-run-systemd\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.193567 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193458 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:59:30.194009 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193599 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9de446cb-1f40-47b8-8a8b-b3eae68467b2-multus-daemon-config\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.194009 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193629 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st2nj\" (UniqueName: \"kubernetes.io/projected/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-kube-api-access-st2nj\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.194009 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193666 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mwltc\"" Jul 07 13:59:30.194009 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.193717 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 13:59:30.194630 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.194609 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 13:59:30.195709 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.195682 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:59:30.195802 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.195710 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s2qhx\"" Jul 07 13:59:30.196002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.195982 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 13:59:30.199438 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.199220 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 13:59:30.228909 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.228658 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m4b4f" Jul 07 13:59:30.232853 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.232473 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m4b4f" Jul 07 13:59:30.282372 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.282347 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 13:59:30.294114 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294086 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-sysctl-conf\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.294258 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294129 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e53774d3-9199-4e60-9c05-d506c750eb57-konnectivity-ca\") pod \"konnectivity-agent-swvbl\" (UID: \"e53774d3-9199-4e60-9c05-d506c750eb57\") " pod="kube-system/konnectivity-agent-swvbl" Jul 07 13:59:30.294258 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294183 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-system-cni-dir\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.294258 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294239 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-var-lib-cni-multus\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.294360 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294271 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/108358e2-5eca-49e7-a373-8e46c2fc1258-host-slash\") pod \"iptables-alerter-ftzxm\" (UID: \"108358e2-5eca-49e7-a373-8e46c2fc1258\") " pod="openshift-network-operator/iptables-alerter-ftzxm" Jul 07 13:59:30.294360 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294296 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.294360 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294307 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-system-cni-dir\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.294360 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294326 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-run-openvswitch\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.294360 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294354 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10dab8ee-1c27-48a5-b012-6571cff52216-ovnkube-script-lib\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.294498 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294409 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-run-openvswitch\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.294498 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294448 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1a809a6-2c4c-4c61-956a-a49b09d2da26-host\") pod \"node-ca-8mhsp\" (UID: \"a1a809a6-2c4c-4c61-956a-a49b09d2da26\") " pod="openshift-image-registry/node-ca-8mhsp" Jul 07 13:59:30.294498 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294486 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1a809a6-2c4c-4c61-956a-a49b09d2da26-host\") pod \"node-ca-8mhsp\" (UID: \"a1a809a6-2c4c-4c61-956a-a49b09d2da26\") " pod="openshift-image-registry/node-ca-8mhsp" Jul 07 13:59:30.294582 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294513 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1a809a6-2c4c-4c61-956a-a49b09d2da26-serviceca\") pod \"node-ca-8mhsp\" (UID: \"a1a809a6-2c4c-4c61-956a-a49b09d2da26\") " pod="openshift-image-registry/node-ca-8mhsp" Jul 07 13:59:30.294801 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294775 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e53774d3-9199-4e60-9c05-d506c750eb57-konnectivity-ca\") pod \"konnectivity-agent-swvbl\" (UID: \"e53774d3-9199-4e60-9c05-d506c750eb57\") " pod="kube-system/konnectivity-agent-swvbl" Jul 07 13:59:30.294961 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294940 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10dab8ee-1c27-48a5-b012-6571cff52216-ovnkube-script-lib\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.295031 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.294944 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1a809a6-2c4c-4c61-956a-a49b09d2da26-serviceca\") pod \"node-ca-8mhsp\" (UID: \"a1a809a6-2c4c-4c61-956a-a49b09d2da26\") " pod="openshift-image-registry/node-ca-8mhsp" Jul 07 13:59:30.295031 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295003 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-slash\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.295031 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295008 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-var-lib-cni-multus\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.295182 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295048 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-etc-openvswitch\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.295182 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295072 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-run-ovn\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.295182 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295108 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-multus-cni-dir\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.295182 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295132 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-multus-socket-dir-parent\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.295182 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295155 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-hostroot\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.295182 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295180 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.295490 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295252 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9de446cb-1f40-47b8-8a8b-b3eae68467b2-cni-binary-copy\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.295490 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295259 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.295490 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295281 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d84h9\" (UniqueName: \"kubernetes.io/projected/108358e2-5eca-49e7-a373-8e46c2fc1258-kube-api-access-d84h9\") pod \"iptables-alerter-ftzxm\" (UID: \"108358e2-5eca-49e7-a373-8e46c2fc1258\") " pod="openshift-network-operator/iptables-alerter-ftzxm" Jul 07 13:59:30.295490 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295306 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-sysctl-d\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.295490 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295315 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-run-ovn\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.295490 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295318 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-etc-openvswitch\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.295490 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295331 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-var-lib-kubelet\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.295490 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295365 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-hostroot\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.295490 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295385 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-host\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.295490 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295413 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7666798-8423-4317-8a36-d046005734cb-tmp\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.295490 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295456 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4da12c5-b21c-4fd1-9516-fb2f2d934118-hosts-file\") pod \"node-resolver-qvpbf\" (UID: \"b4da12c5-b21c-4fd1-9516-fb2f2d934118\") " pod="openshift-dns/node-resolver-qvpbf" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295492 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-multus-socket-dir-parent\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295502 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plvxd\" (UniqueName: \"kubernetes.io/projected/b4da12c5-b21c-4fd1-9516-fb2f2d934118-kube-api-access-plvxd\") pod \"node-resolver-qvpbf\" (UID: \"b4da12c5-b21c-4fd1-9516-fb2f2d934118\") " pod="openshift-dns/node-resolver-qvpbf" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295553 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-socket-dir\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295580 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-var-lib-kubelet\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295632 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-run-netns\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295682 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rznj\" (UniqueName: \"kubernetes.io/projected/10dab8ee-1c27-48a5-b012-6571cff52216-kube-api-access-9rznj\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295713 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-systemd\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295765 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4vzs\" (UniqueName: \"kubernetes.io/projected/e7666798-8423-4317-8a36-d046005734cb-kube-api-access-w4vzs\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295787 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295807 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7wmw\" (UniqueName: \"kubernetes.io/projected/45b31c2e-32c0-441b-a10a-2e25700bbb10-kube-api-access-n7wmw\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295835 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmn45\" (UniqueName: \"kubernetes.io/projected/a1a809a6-2c4c-4c61-956a-a49b09d2da26-kube-api-access-dmn45\") pod \"node-ca-8mhsp\" (UID: \"a1a809a6-2c4c-4c61-956a-a49b09d2da26\") " pod="openshift-image-registry/node-ca-8mhsp" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295840 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-slash\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295852 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9de446cb-1f40-47b8-8a8b-b3eae68467b2-cni-binary-copy\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295860 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4da12c5-b21c-4fd1-9516-fb2f2d934118-tmp-dir\") pod \"node-resolver-qvpbf\" (UID: \"b4da12c5-b21c-4fd1-9516-fb2f2d934118\") " pod="openshift-dns/node-resolver-qvpbf" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295866 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-multus-cni-dir\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295919 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4da12c5-b21c-4fd1-9516-fb2f2d934118-hosts-file\") pod \"node-resolver-qvpbf\" (UID: \"b4da12c5-b21c-4fd1-9516-fb2f2d934118\") " pod="openshift-dns/node-resolver-qvpbf" Jul 07 13:59:30.296002 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295950 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-var-lib-kubelet\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.295974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-sys-fs\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296015 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-socket-dir\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296132 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5696\" (UniqueName: \"kubernetes.io/projected/6208511b-989b-4362-9ef5-7989b57cfba9-kube-api-access-h5696\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296156 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-sys-fs\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296177 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-node-log\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296196 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-run-netns\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296247 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-cni-netd\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296275 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-run-k8s-cni-cncf-io\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296289 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-node-log\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296326 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296354 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-system-cni-dir\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296399 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-systemd-units\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296401 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4da12c5-b21c-4fd1-9516-fb2f2d934118-tmp-dir\") pod \"node-resolver-qvpbf\" (UID: \"b4da12c5-b21c-4fd1-9516-fb2f2d934118\") " pod="openshift-dns/node-resolver-qvpbf" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296424 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10dab8ee-1c27-48a5-b012-6571cff52216-env-overrides\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296493 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-run-k8s-cni-cncf-io\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296504 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-cni-netd\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.296854 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296538 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-systemd-units\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296537 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296570 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-var-lib-cni-bin\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296586 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-system-cni-dir\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296599 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7666798-8423-4317-8a36-d046005734cb-etc-tuned\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296633 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-var-lib-cni-bin\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296652 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-registration-dir\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296685 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-cnibin\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296701 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-registration-dir\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296717 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10dab8ee-1c27-48a5-b012-6571cff52216-ovn-node-metrics-cert\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296749 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-cnibin\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296775 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-run-netns\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296775 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-cnibin\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296821 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-run-netns\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-multus-conf-dir\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296868 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-kubernetes\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296904 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-run\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.297647 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296937 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-os-release\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.296974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-cni-bin\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297028 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-run-multus-certs\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297061 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10dab8ee-1c27-48a5-b012-6571cff52216-env-overrides\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297082 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-modprobe-d\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297114 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-sysconfig\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297128 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297148 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-host-run-multus-certs\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297154 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-sys\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297179 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-lib-modules\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297196 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-cnibin\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297244 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-kubelet\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297270 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-run-systemd\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297289 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-os-release\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297304 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9de446cb-1f40-47b8-8a8b-b3eae68467b2-multus-daemon-config\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297339 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/108358e2-5eca-49e7-a373-8e46c2fc1258-iptables-alerter-script\") pod \"iptables-alerter-ftzxm\" (UID: \"108358e2-5eca-49e7-a373-8e46c2fc1258\") " pod="openshift-network-operator/iptables-alerter-ftzxm" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297344 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-cni-bin\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297367 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st2nj\" (UniqueName: \"kubernetes.io/projected/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-kube-api-access-st2nj\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.298468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297417 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-var-lib-openvswitch\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297443 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-log-socket\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297468 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf6s9\" (UniqueName: \"kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9\") pod \"network-check-target-dxr69\" (UID: \"ba39a144-c65d-4c6c-a181-68171f97f77b\") " pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297492 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297532 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297540 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-kubelet\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297557 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e53774d3-9199-4e60-9c05-d506c750eb57-agent-certs\") pod \"konnectivity-agent-swvbl\" (UID: \"e53774d3-9199-4e60-9c05-d506c750eb57\") " pod="kube-system/konnectivity-agent-swvbl" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297590 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-run-systemd\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297593 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-device-dir\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297584 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-log-socket\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297651 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-device-dir\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297698 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.297705 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297715 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-var-lib-openvswitch\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297418 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-multus-conf-dir\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297727 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01865e08-26a6-463c-b42f-d466b8a23b34-kubelet-config\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297851 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-etc-selinux\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.299305 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297887 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297909 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9de446cb-1f40-47b8-8a8b-b3eae68467b2-multus-daemon-config\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297919 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01865e08-26a6-463c-b42f-d466b8a23b34-dbus\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.297950 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.297974 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs podName:45b31c2e-32c0-441b-a10a-2e25700bbb10 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:30.797951887 +0000 UTC m=+2.971739440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs") pod "network-metrics-daemon-g7n7m" (UID: "45b31c2e-32c0-441b-a10a-2e25700bbb10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298026 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298058 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-os-release\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298071 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6208511b-989b-4362-9ef5-7989b57cfba9-etc-selinux\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298085 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-etc-kubernetes\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298112 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brqgf\" (UniqueName: \"kubernetes.io/projected/9de446cb-1f40-47b8-8a8b-b3eae68467b2-kube-api-access-brqgf\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298120 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298156 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10dab8ee-1c27-48a5-b012-6571cff52216-ovnkube-config\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298183 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-os-release\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298242 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9de446cb-1f40-47b8-8a8b-b3eae68467b2-etc-kubernetes\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298454 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298525 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10dab8ee-1c27-48a5-b012-6571cff52216-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.300065 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298566 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.300818 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.298605 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10dab8ee-1c27-48a5-b012-6571cff52216-ovnkube-config\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.302026 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.302004 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10dab8ee-1c27-48a5-b012-6571cff52216-ovn-node-metrics-cert\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.302871 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.302848 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e53774d3-9199-4e60-9c05-d506c750eb57-agent-certs\") pod \"konnectivity-agent-swvbl\" (UID: \"e53774d3-9199-4e60-9c05-d506c750eb57\") " pod="kube-system/konnectivity-agent-swvbl" Jul 07 13:59:30.305049 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.305027 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plvxd\" (UniqueName: \"kubernetes.io/projected/b4da12c5-b21c-4fd1-9516-fb2f2d934118-kube-api-access-plvxd\") pod \"node-resolver-qvpbf\" (UID: \"b4da12c5-b21c-4fd1-9516-fb2f2d934118\") " pod="openshift-dns/node-resolver-qvpbf" Jul 07 13:59:30.310209 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.306448 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7wmw\" (UniqueName: \"kubernetes.io/projected/45b31c2e-32c0-441b-a10a-2e25700bbb10-kube-api-access-n7wmw\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:30.310209 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.306643 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rznj\" (UniqueName: \"kubernetes.io/projected/10dab8ee-1c27-48a5-b012-6571cff52216-kube-api-access-9rznj\") pod \"ovnkube-node-ksnt5\" (UID: \"10dab8ee-1c27-48a5-b012-6571cff52216\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.310209 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.308872 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st2nj\" (UniqueName: \"kubernetes.io/projected/7adb66bc-ea72-44f2-a6dc-cdcbb32919d1-kube-api-access-st2nj\") pod \"multus-additional-cni-plugins-l4kmx\" (UID: \"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1\") " pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.310209 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.309031 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brqgf\" (UniqueName: \"kubernetes.io/projected/9de446cb-1f40-47b8-8a8b-b3eae68467b2-kube-api-access-brqgf\") pod \"multus-xp88p\" (UID: \"9de446cb-1f40-47b8-8a8b-b3eae68467b2\") " pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.312283 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.312201 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5696\" (UniqueName: \"kubernetes.io/projected/6208511b-989b-4362-9ef5-7989b57cfba9-kube-api-access-h5696\") pod \"aws-ebs-csi-driver-node-sxhvs\" (UID: \"6208511b-989b-4362-9ef5-7989b57cfba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.314562 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.314539 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmn45\" (UniqueName: \"kubernetes.io/projected/a1a809a6-2c4c-4c61-956a-a49b09d2da26-kube-api-access-dmn45\") pod \"node-ca-8mhsp\" (UID: \"a1a809a6-2c4c-4c61-956a-a49b09d2da26\") " pod="openshift-image-registry/node-ca-8mhsp" Jul 07 13:59:30.399339 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399293 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-systemd\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.399510 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399348 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4vzs\" (UniqueName: \"kubernetes.io/projected/e7666798-8423-4317-8a36-d046005734cb-kube-api-access-w4vzs\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.399510 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399383 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7666798-8423-4317-8a36-d046005734cb-etc-tuned\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.399510 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399406 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-kubernetes\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.399510 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399427 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-run\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.399510 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399442 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-systemd\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.399510 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399450 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-modprobe-d\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.399510 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399499 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-sysconfig\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.399905 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399522 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-sys\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.399905 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399547 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-lib-modules\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.399905 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399573 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-modprobe-d\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.399905 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399574 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/108358e2-5eca-49e7-a373-8e46c2fc1258-iptables-alerter-script\") pod \"iptables-alerter-ftzxm\" (UID: \"108358e2-5eca-49e7-a373-8e46c2fc1258\") " pod="openshift-network-operator/iptables-alerter-ftzxm" Jul 07 13:59:30.399905 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399620 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6s9\" (UniqueName: \"kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9\") pod \"network-check-target-dxr69\" (UID: \"ba39a144-c65d-4c6c-a181-68171f97f77b\") " pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:30.399905 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399647 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:30.399905 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399687 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01865e08-26a6-463c-b42f-d466b8a23b34-kubelet-config\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:30.399905 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399711 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01865e08-26a6-463c-b42f-d466b8a23b34-dbus\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:30.399905 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399741 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-sysctl-conf\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.399905 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399776 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/108358e2-5eca-49e7-a373-8e46c2fc1258-host-slash\") pod \"iptables-alerter-ftzxm\" (UID: \"108358e2-5eca-49e7-a373-8e46c2fc1258\") " pod="openshift-network-operator/iptables-alerter-ftzxm" Jul 07 13:59:30.399905 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399863 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/108358e2-5eca-49e7-a373-8e46c2fc1258-host-slash\") pod \"iptables-alerter-ftzxm\" (UID: \"108358e2-5eca-49e7-a373-8e46c2fc1258\") " pod="openshift-network-operator/iptables-alerter-ftzxm" Jul 07 13:59:30.399905 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399891 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-sys\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.399949 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-sysconfig\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.399975 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.400033 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret podName:01865e08-26a6-463c-b42f-d466b8a23b34 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:30.900014751 +0000 UTC m=+3.073802311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret") pod "global-pull-secret-syncer-kkd6d" (UID: "01865e08-26a6-463c-b42f-d466b8a23b34") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400048 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-lib-modules\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400100 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-kubernetes\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400119 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-run\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400121 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/108358e2-5eca-49e7-a373-8e46c2fc1258-iptables-alerter-script\") pod \"iptables-alerter-ftzxm\" (UID: \"108358e2-5eca-49e7-a373-8e46c2fc1258\") " pod="openshift-network-operator/iptables-alerter-ftzxm" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400159 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d84h9\" (UniqueName: \"kubernetes.io/projected/108358e2-5eca-49e7-a373-8e46c2fc1258-kube-api-access-d84h9\") pod \"iptables-alerter-ftzxm\" (UID: \"108358e2-5eca-49e7-a373-8e46c2fc1258\") " pod="openshift-network-operator/iptables-alerter-ftzxm" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400188 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01865e08-26a6-463c-b42f-d466b8a23b34-dbus\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400189 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-sysctl-d\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400248 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-var-lib-kubelet\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400294 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01865e08-26a6-463c-b42f-d466b8a23b34-kubelet-config\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400324 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-sysctl-d\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400330 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-var-lib-kubelet\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400362 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-host\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400391 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-etc-sysctl-conf\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.400487 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400398 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7666798-8423-4317-8a36-d046005734cb-tmp\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.401291 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.400432 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7666798-8423-4317-8a36-d046005734cb-host\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.403205 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.403145 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7666798-8423-4317-8a36-d046005734cb-etc-tuned\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.406379 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.406358 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7666798-8423-4317-8a36-d046005734cb-tmp\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.406702 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.406684 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:59:30.406774 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.406709 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:59:30.406774 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.406722 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jf6s9 for pod openshift-network-diagnostics/network-check-target-dxr69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:59:30.406890 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.406780 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9 podName:ba39a144-c65d-4c6c-a181-68171f97f77b nodeName:}" failed. No retries permitted until 2026-07-07 13:59:30.906761324 +0000 UTC m=+3.080548876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6s9" (UniqueName: "kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9") pod "network-check-target-dxr69" (UID: "ba39a144-c65d-4c6c-a181-68171f97f77b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:59:30.410451 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.410427 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d84h9\" (UniqueName: \"kubernetes.io/projected/108358e2-5eca-49e7-a373-8e46c2fc1258-kube-api-access-d84h9\") pod \"iptables-alerter-ftzxm\" (UID: \"108358e2-5eca-49e7-a373-8e46c2fc1258\") " pod="openshift-network-operator/iptables-alerter-ftzxm" Jul 07 13:59:30.411368 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.411327 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4vzs\" (UniqueName: \"kubernetes.io/projected/e7666798-8423-4317-8a36-d046005734cb-kube-api-access-w4vzs\") pod \"tuned-n6h5x\" (UID: \"e7666798-8423-4317-8a36-d046005734cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.425477 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.425427 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" event={"ID":"684e505a654ab219cfa598f20931a3ab","Type":"ContainerStarted","Data":"04986708293f2125b295710bc6ded03c3aa26f1ceab1bea19db442017395c164"} Jul 07 13:59:30.426930 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.426905 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" event={"ID":"ddbd14da7139adf25758f98178d8d0ef","Type":"ContainerStarted","Data":"64d38743686a5270d41496e42f79872e33b2e3b868c1a13c9de10799411b6d25"} Jul 07 13:59:30.479821 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.479781 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8mhsp" Jul 07 13:59:30.488050 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.487820 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swvbl" Jul 07 13:59:30.493035 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:30.492998 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a809a6_2c4c_4c61_956a_a49b09d2da26.slice/crio-049f3bf2b6a157ccb2be3df095df5fa7747e978de082b3d24809acdd87cb3a04 WatchSource:0}: Error finding container 049f3bf2b6a157ccb2be3df095df5fa7747e978de082b3d24809acdd87cb3a04: Status 404 returned error can't find the container with id 049f3bf2b6a157ccb2be3df095df5fa7747e978de082b3d24809acdd87cb3a04 Jul 07 13:59:30.498801 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:30.498769 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53774d3_9199_4e60_9c05_d506c750eb57.slice/crio-dfae540b25cca2ff9f57ddb7ce96e7ac878c5572f45cc906712aa2b872d8ae30 WatchSource:0}: Error finding container dfae540b25cca2ff9f57ddb7ce96e7ac878c5572f45cc906712aa2b872d8ae30: Status 404 returned error can't find the container with id dfae540b25cca2ff9f57ddb7ce96e7ac878c5572f45cc906712aa2b872d8ae30 Jul 07 13:59:30.500345 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.500158 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" Jul 07 13:59:30.506695 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.506470 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qvpbf" Jul 07 13:59:30.513210 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:30.513160 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6208511b_989b_4362_9ef5_7989b57cfba9.slice/crio-b80a7e3b3166084cd44c870e7696cbead715623c735d87fa0a9c061f988cf87c WatchSource:0}: Error finding container b80a7e3b3166084cd44c870e7696cbead715623c735d87fa0a9c061f988cf87c: Status 404 returned error can't find the container with id b80a7e3b3166084cd44c870e7696cbead715623c735d87fa0a9c061f988cf87c Jul 07 13:59:30.515139 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.515118 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l4kmx" Jul 07 13:59:30.516091 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:30.516069 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4da12c5_b21c_4fd1_9516_fb2f2d934118.slice/crio-a2b249cdcf9a5e909f054ecceae91395b9f0b4964e4d214eeeae5c2aa4b4b669 WatchSource:0}: Error finding container a2b249cdcf9a5e909f054ecceae91395b9f0b4964e4d214eeeae5c2aa4b4b669: Status 404 returned error can't find the container with id a2b249cdcf9a5e909f054ecceae91395b9f0b4964e4d214eeeae5c2aa4b4b669 Jul 07 13:59:30.523653 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:30.523633 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7adb66bc_ea72_44f2_a6dc_cdcbb32919d1.slice/crio-753edc950e3800ded84929aeecec5d634fb577eafdaf39ebf187f8a2f3147b55 WatchSource:0}: Error finding container 753edc950e3800ded84929aeecec5d634fb577eafdaf39ebf187f8a2f3147b55: Status 404 returned error can't find the container with id 753edc950e3800ded84929aeecec5d634fb577eafdaf39ebf187f8a2f3147b55 Jul 07 13:59:30.524439 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.524420 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:30.532541 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:30.532517 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10dab8ee_1c27_48a5_b012_6571cff52216.slice/crio-4293022e937ea713d7b96e8ab71296d4e4b602f64669cdd52f91a6ec84d4f14c WatchSource:0}: Error finding container 4293022e937ea713d7b96e8ab71296d4e4b602f64669cdd52f91a6ec84d4f14c: Status 404 returned error can't find the container with id 4293022e937ea713d7b96e8ab71296d4e4b602f64669cdd52f91a6ec84d4f14c Jul 07 13:59:30.534654 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.534634 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xp88p" Jul 07 13:59:30.541640 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.541618 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ftzxm" Jul 07 13:59:30.543836 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:30.543811 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de446cb_1f40_47b8_8a8b_b3eae68467b2.slice/crio-63a4b8a2a477075e13b2110a2ff48615210483b628390a0e44a59f282fd3243a WatchSource:0}: Error finding container 63a4b8a2a477075e13b2110a2ff48615210483b628390a0e44a59f282fd3243a: Status 404 returned error can't find the container with id 63a4b8a2a477075e13b2110a2ff48615210483b628390a0e44a59f282fd3243a Jul 07 13:59:30.545456 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.545437 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:59:30.546422 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.546405 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" Jul 07 13:59:30.552972 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:30.552949 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod108358e2_5eca_49e7_a373_8e46c2fc1258.slice/crio-8e1e0540a752c1f0769799e8b61d40bdb4ad2bec0fecc7c77883b499f2976b74 WatchSource:0}: Error finding container 8e1e0540a752c1f0769799e8b61d40bdb4ad2bec0fecc7c77883b499f2976b74: Status 404 returned error can't find the container with id 8e1e0540a752c1f0769799e8b61d40bdb4ad2bec0fecc7c77883b499f2976b74 Jul 07 13:59:30.556308 ip-10-0-136-167 kubenswrapper[2583]: W0707 13:59:30.556276 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7666798_8423_4317_8a36_d046005734cb.slice/crio-b7d72f04a80d78e44cc42969b6fbd05c8c1b4a808c5f20f0a97d18a19eb460d9 WatchSource:0}: Error finding container b7d72f04a80d78e44cc42969b6fbd05c8c1b4a808c5f20f0a97d18a19eb460d9: Status 404 returned error can't find the container with id b7d72f04a80d78e44cc42969b6fbd05c8c1b4a808c5f20f0a97d18a19eb460d9 Jul 07 13:59:30.582143 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.582120 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:59:30.803040 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.802957 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:30.803197 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.803118 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:59:30.803197 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.803195 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs podName:45b31c2e-32c0-441b-a10a-2e25700bbb10 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:31.803179801 +0000 UTC m=+3.976967356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs") pod "network-metrics-daemon-g7n7m" (UID: "45b31c2e-32c0-441b-a10a-2e25700bbb10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:59:30.903965 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:30.903926 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:30.904123 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.904084 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:59:30.904163 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:30.904145 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret podName:01865e08-26a6-463c-b42f-d466b8a23b34 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:31.904131983 +0000 UTC m=+4.077919534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret") pod "global-pull-secret-syncer-kkd6d" (UID: "01865e08-26a6-463c-b42f-d466b8a23b34") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:59:31.004468 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.004434 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6s9\" (UniqueName: \"kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9\") pod \"network-check-target-dxr69\" (UID: \"ba39a144-c65d-4c6c-a181-68171f97f77b\") " pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:31.004613 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:31.004578 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:59:31.004613 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:31.004604 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:59:31.004613 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:31.004614 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jf6s9 for pod openshift-network-diagnostics/network-check-target-dxr69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:59:31.004759 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:31.004674 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9 podName:ba39a144-c65d-4c6c-a181-68171f97f77b nodeName:}" failed. No retries permitted until 2026-07-07 13:59:32.004659045 +0000 UTC m=+4.178446601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6s9" (UniqueName: "kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9") pod "network-check-target-dxr69" (UID: "ba39a144-c65d-4c6c-a181-68171f97f77b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:59:31.236280 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.236171 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:54:30 +0000 UTC" deadline="2028-01-18 15:19:53.361596479 +0000 UTC" Jul 07 13:59:31.236280 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.236203 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13441h20m22.125397849s" Jul 07 13:59:31.420666 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.420634 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:31.421199 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:31.420780 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:31.430162 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.430130 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qvpbf" event={"ID":"b4da12c5-b21c-4fd1-9516-fb2f2d934118","Type":"ContainerStarted","Data":"a2b249cdcf9a5e909f054ecceae91395b9f0b4964e4d214eeeae5c2aa4b4b669"} Jul 07 13:59:31.431708 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.431639 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swvbl" event={"ID":"e53774d3-9199-4e60-9c05-d506c750eb57","Type":"ContainerStarted","Data":"dfae540b25cca2ff9f57ddb7ce96e7ac878c5572f45cc906712aa2b872d8ae30"} Jul 07 13:59:31.433371 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.433344 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ftzxm" event={"ID":"108358e2-5eca-49e7-a373-8e46c2fc1258","Type":"ContainerStarted","Data":"8e1e0540a752c1f0769799e8b61d40bdb4ad2bec0fecc7c77883b499f2976b74"} Jul 07 13:59:31.434795 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.434773 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4kmx" event={"ID":"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1","Type":"ContainerStarted","Data":"753edc950e3800ded84929aeecec5d634fb577eafdaf39ebf187f8a2f3147b55"} Jul 07 13:59:31.436376 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.436354 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" event={"ID":"6208511b-989b-4362-9ef5-7989b57cfba9","Type":"ContainerStarted","Data":"b80a7e3b3166084cd44c870e7696cbead715623c735d87fa0a9c061f988cf87c"} Jul 07 13:59:31.438194 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.438170 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8mhsp" event={"ID":"a1a809a6-2c4c-4c61-956a-a49b09d2da26","Type":"ContainerStarted","Data":"049f3bf2b6a157ccb2be3df095df5fa7747e978de082b3d24809acdd87cb3a04"} Jul 07 13:59:31.440252 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.440214 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" event={"ID":"e7666798-8423-4317-8a36-d046005734cb","Type":"ContainerStarted","Data":"b7d72f04a80d78e44cc42969b6fbd05c8c1b4a808c5f20f0a97d18a19eb460d9"} Jul 07 13:59:31.441957 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.441935 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xp88p" event={"ID":"9de446cb-1f40-47b8-8a8b-b3eae68467b2","Type":"ContainerStarted","Data":"63a4b8a2a477075e13b2110a2ff48615210483b628390a0e44a59f282fd3243a"} Jul 07 13:59:31.447080 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.445697 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" event={"ID":"10dab8ee-1c27-48a5-b012-6571cff52216","Type":"ContainerStarted","Data":"4293022e937ea713d7b96e8ab71296d4e4b602f64669cdd52f91a6ec84d4f14c"} Jul 07 13:59:31.811327 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.811277 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:31.811508 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:31.811424 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:59:31.811508 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:31.811486 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs podName:45b31c2e-32c0-441b-a10a-2e25700bbb10 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:33.811468092 +0000 UTC m=+5.985255661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs") pod "network-metrics-daemon-g7n7m" (UID: "45b31c2e-32c0-441b-a10a-2e25700bbb10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:59:31.912432 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:31.912395 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:31.912589 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:31.912570 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:59:31.912661 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:31.912631 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret podName:01865e08-26a6-463c-b42f-d466b8a23b34 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:33.9126129 +0000 UTC m=+6.086400475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret") pod "global-pull-secret-syncer-kkd6d" (UID: "01865e08-26a6-463c-b42f-d466b8a23b34") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:59:32.014143 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:32.013496 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6s9\" (UniqueName: \"kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9\") pod \"network-check-target-dxr69\" (UID: \"ba39a144-c65d-4c6c-a181-68171f97f77b\") " pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:32.014143 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:32.013686 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:59:32.014143 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:32.013706 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:59:32.014143 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:32.013718 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jf6s9 for pod openshift-network-diagnostics/network-check-target-dxr69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:59:32.014143 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:32.013777 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9 podName:ba39a144-c65d-4c6c-a181-68171f97f77b nodeName:}" failed. No retries permitted until 2026-07-07 13:59:34.013758173 +0000 UTC m=+6.187545785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6s9" (UniqueName: "kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9") pod "network-check-target-dxr69" (UID: "ba39a144-c65d-4c6c-a181-68171f97f77b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:59:32.236509 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:32.236405 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:54:30 +0000 UTC" deadline="2028-03-15 10:45:30.437925414 +0000 UTC" Jul 07 13:59:32.236509 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:32.236457 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14804h45m58.201472329s" Jul 07 13:59:32.421642 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:32.421050 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:32.421642 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:32.421186 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:32.422209 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:32.422104 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:32.422209 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:32.422181 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:32.464868 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:32.464832 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" event={"ID":"684e505a654ab219cfa598f20931a3ab","Type":"ContainerStarted","Data":"52c63294022ed41659cd308ff256b7ccacff5e7882662e587c5b0cbeeb07705c"} Jul 07 13:59:32.480617 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:32.480555 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-167.ec2.internal" podStartSLOduration=3.480519745 podStartE2EDuration="3.480519745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:32.479794427 +0000 UTC m=+4.653582000" watchObservedRunningTime="2026-07-07 13:59:32.480519745 +0000 UTC m=+4.654307318" Jul 07 13:59:33.420722 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:33.420692 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:33.420904 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:33.420854 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:33.484103 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:33.484071 2583 generic.go:356] "Generic (PLEG): container finished" podID="ddbd14da7139adf25758f98178d8d0ef" containerID="493ca1394ecb7fce39d9bedab849f8fde88718873fa10750e4615c4f030e2c18" exitCode=0 Jul 07 13:59:33.484609 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:33.484586 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" event={"ID":"ddbd14da7139adf25758f98178d8d0ef","Type":"ContainerDied","Data":"493ca1394ecb7fce39d9bedab849f8fde88718873fa10750e4615c4f030e2c18"} Jul 07 13:59:33.830709 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:33.829845 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:33.830709 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:33.830005 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:59:33.830709 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:33.830082 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs podName:45b31c2e-32c0-441b-a10a-2e25700bbb10 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:37.830063262 +0000 UTC m=+10.003850828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs") pod "network-metrics-daemon-g7n7m" (UID: "45b31c2e-32c0-441b-a10a-2e25700bbb10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:59:33.931558 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:33.930869 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:33.931558 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:33.931019 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:59:33.931558 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:33.931082 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret podName:01865e08-26a6-463c-b42f-d466b8a23b34 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:37.931064501 +0000 UTC m=+10.104852068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret") pod "global-pull-secret-syncer-kkd6d" (UID: "01865e08-26a6-463c-b42f-d466b8a23b34") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:59:34.032319 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:34.032166 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6s9\" (UniqueName: \"kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9\") pod \"network-check-target-dxr69\" (UID: \"ba39a144-c65d-4c6c-a181-68171f97f77b\") " pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:34.032832 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:34.032352 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:59:34.032832 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:34.032370 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:59:34.032832 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:34.032382 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jf6s9 for pod openshift-network-diagnostics/network-check-target-dxr69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:59:34.032832 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:34.032439 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9 podName:ba39a144-c65d-4c6c-a181-68171f97f77b nodeName:}" failed. No retries permitted until 2026-07-07 13:59:38.032421536 +0000 UTC m=+10.206209094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6s9" (UniqueName: "kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9") pod "network-check-target-dxr69" (UID: "ba39a144-c65d-4c6c-a181-68171f97f77b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:59:34.421817 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:34.421324 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:34.421817 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:34.421464 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:34.422310 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:34.422139 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:34.422310 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:34.422256 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:35.421554 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:35.421042 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:35.421554 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:35.421168 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:36.421453 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:36.421376 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:36.421612 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:36.421523 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:36.421962 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:36.421376 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:36.421962 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:36.421910 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:37.420799 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:37.420568 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:37.420799 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:37.420688 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:37.864072 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:37.863986 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:37.864493 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:37.864195 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:59:37.864493 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:37.864275 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs podName:45b31c2e-32c0-441b-a10a-2e25700bbb10 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:45.864260049 +0000 UTC m=+18.038047601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs") pod "network-metrics-daemon-g7n7m" (UID: "45b31c2e-32c0-441b-a10a-2e25700bbb10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:59:37.965481 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:37.965384 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:37.965634 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:37.965500 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:59:37.965634 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:37.965560 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret podName:01865e08-26a6-463c-b42f-d466b8a23b34 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:45.965543755 +0000 UTC m=+18.139331306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret") pod "global-pull-secret-syncer-kkd6d" (UID: "01865e08-26a6-463c-b42f-d466b8a23b34") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:59:38.066605 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:38.066568 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6s9\" (UniqueName: \"kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9\") pod \"network-check-target-dxr69\" (UID: \"ba39a144-c65d-4c6c-a181-68171f97f77b\") " pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:38.066792 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:38.066776 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:59:38.066862 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:38.066799 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:59:38.066862 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:38.066821 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jf6s9 for pod openshift-network-diagnostics/network-check-target-dxr69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:59:38.066974 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:38.066879 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9 podName:ba39a144-c65d-4c6c-a181-68171f97f77b nodeName:}" failed. No retries permitted until 2026-07-07 13:59:46.066862592 +0000 UTC m=+18.240650148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6s9" (UniqueName: "kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9") pod "network-check-target-dxr69" (UID: "ba39a144-c65d-4c6c-a181-68171f97f77b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:59:38.422955 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:38.422241 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:38.422955 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:38.422372 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:38.422955 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:38.422729 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:38.422955 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:38.422818 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:39.420956 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:39.420923 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:39.421486 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:39.421050 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:40.421155 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:40.421120 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:40.421621 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:40.421277 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:40.421724 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:40.421705 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:40.421831 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:40.421805 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:41.420498 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:41.420410 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:41.420651 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:41.420562 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:42.421216 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:42.421179 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:42.421670 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:42.421234 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:42.421670 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:42.421346 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:42.421670 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:42.421465 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:43.420617 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:43.420584 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:43.420757 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:43.420708 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:44.420726 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:44.420642 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:44.421170 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:44.420791 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:44.421170 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:44.420835 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:44.421170 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:44.420978 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:45.420869 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:45.420783 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:45.421320 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:45.420904 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:45.922307 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:45.922267 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:45.922513 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:45.922427 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:59:45.922513 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:45.922493 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs podName:45b31c2e-32c0-441b-a10a-2e25700bbb10 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:01.9224776 +0000 UTC m=+34.096265157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs") pod "network-metrics-daemon-g7n7m" (UID: "45b31c2e-32c0-441b-a10a-2e25700bbb10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:59:46.022899 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:46.022858 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:46.023069 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:46.022986 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:59:46.023069 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:46.023051 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret podName:01865e08-26a6-463c-b42f-d466b8a23b34 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:02.023032651 +0000 UTC m=+34.196820215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret") pod "global-pull-secret-syncer-kkd6d" (UID: "01865e08-26a6-463c-b42f-d466b8a23b34") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:59:46.124053 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:46.124016 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6s9\" (UniqueName: \"kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9\") pod \"network-check-target-dxr69\" (UID: \"ba39a144-c65d-4c6c-a181-68171f97f77b\") " pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:46.124270 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:46.124206 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:59:46.124270 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:46.124244 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:59:46.124270 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:46.124257 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jf6s9 for pod openshift-network-diagnostics/network-check-target-dxr69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:59:46.124417 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:46.124323 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9 podName:ba39a144-c65d-4c6c-a181-68171f97f77b nodeName:}" failed. No retries permitted until 2026-07-07 14:00:02.124304708 +0000 UTC m=+34.298092259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6s9" (UniqueName: "kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9") pod "network-check-target-dxr69" (UID: "ba39a144-c65d-4c6c-a181-68171f97f77b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:59:46.420868 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:46.420832 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:46.421289 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:46.420842 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:46.421289 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:46.420964 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:46.421289 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:46.421060 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:47.420619 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:47.420584 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:47.420826 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:47.420710 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:48.421555 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:48.421518 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:48.422042 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:48.421638 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:48.422042 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:48.421689 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:48.422042 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:48.421810 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:49.421095 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.420948 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:49.421188 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:49.421168 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:49.517784 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.517755 2583 generic.go:356] "Generic (PLEG): container finished" podID="7adb66bc-ea72-44f2-a6dc-cdcbb32919d1" containerID="3ad03e4d8c0a8b4d13804da5c3a405eb0730196e4c16fb79df085e6561be25ca" exitCode=0 Jul 07 13:59:49.518631 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.517799 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4kmx" event={"ID":"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1","Type":"ContainerDied","Data":"3ad03e4d8c0a8b4d13804da5c3a405eb0730196e4c16fb79df085e6561be25ca"} Jul 07 13:59:49.519469 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.519426 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" event={"ID":"6208511b-989b-4362-9ef5-7989b57cfba9","Type":"ContainerStarted","Data":"6850cc0d08bf8976b1d1edda69b461add5c8c55811114bbaeb426646e6ed2339"} Jul 07 13:59:49.520918 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.520816 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8mhsp" event={"ID":"a1a809a6-2c4c-4c61-956a-a49b09d2da26","Type":"ContainerStarted","Data":"4a1a354a2fb539e2991495cb384b1c922718ab27d8b14146d1b3fdddc298e437"} Jul 07 13:59:49.522898 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.522880 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" event={"ID":"ddbd14da7139adf25758f98178d8d0ef","Type":"ContainerStarted","Data":"068c1cedb6fa6a05202553b05754379b4fcbfa593027fce95bcdc96effb7c7b1"} Jul 07 13:59:49.524582 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.524545 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" event={"ID":"e7666798-8423-4317-8a36-d046005734cb","Type":"ContainerStarted","Data":"1a3117ef051a7f6799f99058d5b578986b33f095e021b4da8bb963757d91eb02"} Jul 07 13:59:49.526049 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.526020 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xp88p" event={"ID":"9de446cb-1f40-47b8-8a8b-b3eae68467b2","Type":"ContainerStarted","Data":"ba25c62c56083519abfc78fa12308861fae602916a864465349cb34b95755c32"} Jul 07 13:59:49.528418 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.528396 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" event={"ID":"10dab8ee-1c27-48a5-b012-6571cff52216","Type":"ContainerStarted","Data":"2c6d61ed48c641c901608ef2b9de3047d71d6a113d100a1a268a78d02c2e87ef"} Jul 07 13:59:49.528514 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.528465 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" event={"ID":"10dab8ee-1c27-48a5-b012-6571cff52216","Type":"ContainerStarted","Data":"360e46037d560b213ca9b05a126c8e2f879f114eb4f576fa015fefad1097b1fb"} Jul 07 13:59:49.529851 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.529830 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qvpbf" event={"ID":"b4da12c5-b21c-4fd1-9516-fb2f2d934118","Type":"ContainerStarted","Data":"4f4c6545029551ba58c4f6b63306b7368e5731189165c011328bb2f24f34417b"} Jul 07 13:59:49.531501 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.531476 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swvbl" event={"ID":"e53774d3-9199-4e60-9c05-d506c750eb57","Type":"ContainerStarted","Data":"70757cd79b7bd5db640125d9d91a4e620f084ba04e2bfcaa72e1e00c4605c2fe"} Jul 07 13:59:49.585033 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.584934 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-167.ec2.internal" podStartSLOduration=20.584918088 podStartE2EDuration="20.584918088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:49.584847765 +0000 UTC m=+21.758635334" watchObservedRunningTime="2026-07-07 13:59:49.584918088 +0000 UTC m=+21.758705660" Jul 07 13:59:49.585494 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.585469 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n6h5x" podStartSLOduration=3.057242769 podStartE2EDuration="21.585462404s" totalImagesPullingTime="18.528219635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:49.567861269 +0000 UTC m=+21.741648842" watchObservedRunningTime="2026-07-07 13:59:49.585462404 +0000 UTC m=+21.759249976" Jul 07 13:59:49.604847 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.604791 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8mhsp" podStartSLOduration=7.443407702 podStartE2EDuration="21.604769602s" totalImagesPullingTime="14.1613619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:49.603950314 +0000 UTC m=+21.777737901" watchObservedRunningTime="2026-07-07 13:59:49.604769602 +0000 UTC m=+21.778557177" Jul 07 13:59:49.628558 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.628505 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-swvbl" podStartSLOduration=3.057273052 podStartE2EDuration="21.628485904s" totalImagesPullingTime="18.571212852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:49.628137735 +0000 UTC m=+21.801925308" watchObservedRunningTime="2026-07-07 13:59:49.628485904 +0000 UTC m=+21.802273478" Jul 07 13:59:49.671960 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.671887 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xp88p" podStartSLOduration=2.790041112 podStartE2EDuration="21.671868141s" totalImagesPullingTime="18.881827029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:49.670593515 +0000 UTC m=+21.844381135" watchObservedRunningTime="2026-07-07 13:59:49.671868141 +0000 UTC m=+21.845655716" Jul 07 13:59:49.672529 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:49.672495 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qvpbf" podStartSLOduration=3.111941993 podStartE2EDuration="21.672478419s" totalImagesPullingTime="18.560536426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:49.64677482 +0000 UTC m=+21.820562396" watchObservedRunningTime="2026-07-07 13:59:49.672478419 +0000 UTC m=+21.846265992" Jul 07 13:59:50.420779 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:50.420743 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:50.420955 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:50.420888 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:50.420955 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:50.420946 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:50.421085 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:50.421059 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:50.536936 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:50.536896 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" event={"ID":"10dab8ee-1c27-48a5-b012-6571cff52216","Type":"ContainerStarted","Data":"18dc051231162b146bbbee66d7e20483121dff3602c5a49e58d80c0060513b3a"} Jul 07 13:59:50.537443 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:50.536989 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" event={"ID":"10dab8ee-1c27-48a5-b012-6571cff52216","Type":"ContainerStarted","Data":"4a8f7e05eaae155433071c2b72f7023672a31015c926521e8dee4d2d31aad506"} Jul 07 13:59:50.537443 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:50.537039 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" event={"ID":"10dab8ee-1c27-48a5-b012-6571cff52216","Type":"ContainerStarted","Data":"e76d5c167b8aedb306fcb29711844c166834b6f67550f2f9a139d4637b0495da"} Jul 07 13:59:50.537443 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:50.537088 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" event={"ID":"10dab8ee-1c27-48a5-b012-6571cff52216","Type":"ContainerStarted","Data":"3ce4ee477a635213e025608b8e5c95141b45316f7726ea89422f345c68cffe52"} Jul 07 13:59:50.538526 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:50.538476 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ftzxm" event={"ID":"108358e2-5eca-49e7-a373-8e46c2fc1258","Type":"ContainerStarted","Data":"936df607a1ea31563bd1fc9bb8874862625cd5eda5fd97a146316bbcf1f5291e"} Jul 07 13:59:50.555343 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:50.555299 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ftzxm" podStartSLOduration=4.032508754 podStartE2EDuration="22.555286268s" totalImagesPullingTime="18.522777514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:50.554973384 +0000 UTC m=+22.728760972" watchObservedRunningTime="2026-07-07 13:59:50.555286268 +0000 UTC m=+22.729073841" Jul 07 13:59:50.890880 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:50.890851 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 13:59:51.270604 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:51.270505 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T13:59:50.890872452Z","UUID":"ef36e8e4-be77-40be-a91d-63fbb7a08e09","Handler":null,"Name":"","Endpoint":""} Jul 07 13:59:51.271887 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:51.271870 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 13:59:51.272010 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:51.271907 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 13:59:51.420488 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:51.420451 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:51.420639 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:51.420567 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:51.541916 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:51.541845 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" event={"ID":"6208511b-989b-4362-9ef5-7989b57cfba9","Type":"ContainerStarted","Data":"8af49481601a059b7bd7e9dae5e18b6ba3bf45d241366b1600a9873f62562332"} Jul 07 13:59:52.420953 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:52.420737 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:52.421146 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:52.420737 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:52.421146 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:52.421069 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:52.421279 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:52.421179 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:52.546346 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:52.546308 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" event={"ID":"6208511b-989b-4362-9ef5-7989b57cfba9","Type":"ContainerStarted","Data":"98425e396aeb3515c569fdc75f8e04c82d158af5604b86dc8844a6d8758fce8d"} Jul 07 13:59:52.550657 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:52.550622 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" event={"ID":"10dab8ee-1c27-48a5-b012-6571cff52216","Type":"ContainerStarted","Data":"bb77942aeb738a67cd33657251b1ac533b1e2d88505025342153e2c08eb35274"} Jul 07 13:59:52.567238 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:52.567164 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxhvs" podStartSLOduration=3.212094988 podStartE2EDuration="24.567150005s" totalImagesPullingTime="21.355055017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:52.566562558 +0000 UTC m=+24.740350150" watchObservedRunningTime="2026-07-07 13:59:52.567150005 +0000 UTC m=+24.740937578" Jul 07 13:59:53.288410 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:53.288376 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-swvbl" Jul 07 13:59:53.288952 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:53.288929 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-swvbl" Jul 07 13:59:53.420598 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:53.420568 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:53.420766 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:53.420694 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:53.553037 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:53.552959 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-swvbl" Jul 07 13:59:53.553580 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:53.553479 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-swvbl" Jul 07 13:59:54.421491 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:54.421396 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:54.421644 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:54.421510 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:54.421644 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:54.421586 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:54.421753 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:54.421678 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:55.421216 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:55.421046 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:55.421800 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:55.421319 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:55.559189 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:55.559149 2583 generic.go:356] "Generic (PLEG): container finished" podID="7adb66bc-ea72-44f2-a6dc-cdcbb32919d1" containerID="dbafc6459d0bac956c570266e2a8b4480c8147ba3e47323885e00ef24ae7a418" exitCode=0 Jul 07 13:59:55.559378 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:55.559248 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4kmx" event={"ID":"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1","Type":"ContainerDied","Data":"dbafc6459d0bac956c570266e2a8b4480c8147ba3e47323885e00ef24ae7a418"} Jul 07 13:59:55.562834 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:55.562810 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" event={"ID":"10dab8ee-1c27-48a5-b012-6571cff52216","Type":"ContainerStarted","Data":"1495cced28cf479f3f614dd1d8342bb0c8e910709e5540836ef92c973d249f3c"} Jul 07 13:59:55.611315 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:55.611274 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" podStartSLOduration=8.837992105 podStartE2EDuration="27.61126039s" totalImagesPullingTime="18.773268285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:55.609633881 +0000 UTC m=+27.783421469" watchObservedRunningTime="2026-07-07 13:59:55.61126039 +0000 UTC m=+27.785047962" Jul 07 13:59:56.420553 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:56.420523 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:56.420765 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:56.420658 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:56.420765 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:56.420711 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:56.420845 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:56.420815 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:56.564984 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:56.564955 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:56.565420 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:56.565042 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:56.565420 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:56.565086 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:56.579759 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:56.579733 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:56.579898 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:56.579831 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 13:59:57.421188 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:57.421154 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:57.421404 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:57.421297 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:57.569004 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:57.568972 2583 generic.go:356] "Generic (PLEG): container finished" podID="7adb66bc-ea72-44f2-a6dc-cdcbb32919d1" containerID="ccc503a3780e9ca472afe56cb3ef2b5fc11abbbdebf06939e606910754d574e4" exitCode=0 Jul 07 13:59:57.569459 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:57.569007 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4kmx" event={"ID":"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1","Type":"ContainerDied","Data":"ccc503a3780e9ca472afe56cb3ef2b5fc11abbbdebf06939e606910754d574e4"} Jul 07 13:59:58.421282 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:58.421246 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 13:59:58.421469 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:58.421344 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 13:59:58.421469 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:58.421387 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 13:59:58.421579 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:58.421471 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 13:59:59.420559 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:59.420525 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 13:59:59.420975 ip-10-0-136-167 kubenswrapper[2583]: E0707 13:59:59.420628 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 13:59:59.575420 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:59.575387 2583 generic.go:356] "Generic (PLEG): container finished" podID="7adb66bc-ea72-44f2-a6dc-cdcbb32919d1" containerID="561d6feddf70c7dfd89d88f6b222b22b09c1ed9c03b1c57410d3d6e8c977998f" exitCode=0 Jul 07 13:59:59.575566 ip-10-0-136-167 kubenswrapper[2583]: I0707 13:59:59.575434 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4kmx" event={"ID":"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1","Type":"ContainerDied","Data":"561d6feddf70c7dfd89d88f6b222b22b09c1ed9c03b1c57410d3d6e8c977998f"} Jul 07 14:00:00.421464 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:00.421432 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:00.421878 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:00.421444 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:00.421878 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:00.421626 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 14:00:00.421878 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:00.421639 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 14:00:01.420949 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:01.420918 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 14:00:01.421118 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:01.421018 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 14:00:01.946198 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:01.946161 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:01.946633 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:01.946288 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:00:01.946633 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:01.946370 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs podName:45b31c2e-32c0-441b-a10a-2e25700bbb10 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:33.946348634 +0000 UTC m=+66.120136190 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs") pod "network-metrics-daemon-g7n7m" (UID: "45b31c2e-32c0-441b-a10a-2e25700bbb10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:00:02.046947 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:02.046907 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 14:00:02.047111 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:02.047057 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:00:02.047199 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:02.047177 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret podName:01865e08-26a6-463c-b42f-d466b8a23b34 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:34.047112725 +0000 UTC m=+66.220900289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret") pod "global-pull-secret-syncer-kkd6d" (UID: "01865e08-26a6-463c-b42f-d466b8a23b34") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:00:02.147787 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:02.147753 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6s9\" (UniqueName: \"kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9\") pod \"network-check-target-dxr69\" (UID: \"ba39a144-c65d-4c6c-a181-68171f97f77b\") " pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:02.147945 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:02.147902 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:00:02.147945 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:02.147917 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:00:02.147945 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:02.147927 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jf6s9 for pod openshift-network-diagnostics/network-check-target-dxr69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:00:02.148042 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:02.147972 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9 podName:ba39a144-c65d-4c6c-a181-68171f97f77b nodeName:}" failed. No retries permitted until 2026-07-07 14:00:34.147959901 +0000 UTC m=+66.321747455 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jf6s9" (UniqueName: "kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9") pod "network-check-target-dxr69" (UID: "ba39a144-c65d-4c6c-a181-68171f97f77b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:00:02.420700 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:02.420669 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:02.420860 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:02.420796 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 14:00:02.420860 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:02.420843 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:02.420980 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:02.420958 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 14:00:03.420866 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:03.420835 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 14:00:03.421323 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:03.420954 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 14:00:04.420565 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:04.420414 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:04.420643 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:04.420414 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:04.420684 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:04.420654 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 14:00:04.420725 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:04.420702 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 14:00:04.592524 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:04.592499 2583 generic.go:356] "Generic (PLEG): container finished" podID="7adb66bc-ea72-44f2-a6dc-cdcbb32919d1" containerID="f4013e156c3701932793a5012510c8684bdebf26f8d61e5c48a8a9c78f8bd9f8" exitCode=0 Jul 07 14:00:04.592852 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:04.592528 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4kmx" event={"ID":"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1","Type":"ContainerDied","Data":"f4013e156c3701932793a5012510c8684bdebf26f8d61e5c48a8a9c78f8bd9f8"} Jul 07 14:00:05.420714 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:05.420684 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 14:00:05.420856 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:05.420779 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 14:00:05.596888 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:05.596857 2583 generic.go:356] "Generic (PLEG): container finished" podID="7adb66bc-ea72-44f2-a6dc-cdcbb32919d1" containerID="e1a3e87233198bc91ad986b3256d89975bd68d3bcde6465d700f2d7e979a5c39" exitCode=0 Jul 07 14:00:05.597282 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:05.596917 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4kmx" event={"ID":"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1","Type":"ContainerDied","Data":"e1a3e87233198bc91ad986b3256d89975bd68d3bcde6465d700f2d7e979a5c39"} Jul 07 14:00:06.421026 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:06.421000 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:06.421189 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:06.421088 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 14:00:06.421189 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:06.421127 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:06.421345 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:06.421189 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 14:00:06.601862 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:06.601831 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4kmx" event={"ID":"7adb66bc-ea72-44f2-a6dc-cdcbb32919d1","Type":"ContainerStarted","Data":"604f1ea17915ba9f0398f49c37a30d3e3d4d5e6424287827c65f6c4a9c5e20af"} Jul 07 14:00:06.628464 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:06.628422 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l4kmx" podStartSLOduration=7.712794025 podStartE2EDuration="38.628409446s" totalImagesPullingTime="30.915615421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:06.628119455 +0000 UTC m=+38.801907045" watchObservedRunningTime="2026-07-07 14:00:06.628409446 +0000 UTC m=+38.802197018" Jul 07 14:00:07.420750 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:07.420725 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 14:00:07.420897 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:07.420821 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 14:00:08.421883 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:08.421800 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:08.422712 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:08.421913 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 14:00:08.422712 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:08.422113 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:08.422712 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:08.422199 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 14:00:08.581667 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:08.581631 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kkd6d"] Jul 07 14:00:08.581815 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:08.581727 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 14:00:08.581857 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:08.581810 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 14:00:08.583796 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:08.583774 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dxr69"] Jul 07 14:00:08.595478 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:08.595453 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g7n7m"] Jul 07 14:00:08.605755 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:08.605727 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:08.605856 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:08.605728 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:08.605856 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:08.605824 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 14:00:08.605958 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:08.605925 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 14:00:10.421166 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:10.421136 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:10.421629 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:10.421136 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:10.421629 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:10.421238 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 14:00:10.421629 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:10.421141 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 14:00:10.421629 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:10.421328 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 14:00:10.421629 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:10.421403 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 14:00:12.420930 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:12.420900 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:12.421458 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:12.420907 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 14:00:12.421458 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:12.421020 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7n7m" podUID="45b31c2e-32c0-441b-a10a-2e25700bbb10" Jul 07 14:00:12.421458 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:12.420907 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:12.421458 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:12.421072 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkd6d" podUID="01865e08-26a6-463c-b42f-d466b8a23b34" Jul 07 14:00:12.421458 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:12.421133 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dxr69" podUID="ba39a144-c65d-4c6c-a181-68171f97f77b" Jul 07 14:00:13.146726 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.146497 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-167.ec2.internal" event="NodeReady" Jul 07 14:00:13.146876 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.146752 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 14:00:13.181196 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.181164 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b7586867f-jj6zh"] Jul 07 14:00:13.210484 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.210464 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xnjlx"] Jul 07 14:00:13.210618 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.210578 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.215445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.214610 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2sf6c\"" Jul 07 14:00:13.215445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.214758 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 14:00:13.215445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.214621 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 14:00:13.215445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.215059 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 14:00:13.222051 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.221770 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 14:00:13.226548 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.226532 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b7586867f-jj6zh"] Jul 07 14:00:13.226617 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.226558 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gg4cd"] Jul 07 14:00:13.226677 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.226652 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.229065 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.229029 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 14:00:13.229142 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.229115 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 14:00:13.229256 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.229239 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7m8lp\"" Jul 07 14:00:13.240482 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.240464 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xnjlx"] Jul 07 14:00:13.240570 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.240499 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gg4cd"] Jul 07 14:00:13.240631 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.240597 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.243173 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.243157 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 14:00:13.243318 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.243303 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 14:00:13.243396 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.243383 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 14:00:13.243456 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.243419 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 14:00:13.243509 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.243469 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5hr8l\"" Jul 07 14:00:13.298174 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.298155 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w4lx4"] Jul 07 14:00:13.321214 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.321191 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4lx4"] Jul 07 14:00:13.321322 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.321288 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4lx4" Jul 07 14:00:13.323984 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.323963 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 14:00:13.324084 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.323968 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 14:00:13.324084 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.324000 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 14:00:13.324084 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.323969 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cgt9h\"" Jul 07 14:00:13.340021 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340001 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.340098 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340036 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7f1e163-33f3-469c-a11a-e1cd268a89fe-trusted-ca\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.340142 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340111 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-data-volume\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.340189 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340158 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7f1e163-33f3-469c-a11a-e1cd268a89fe-image-registry-private-configuration\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.340189 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340177 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7f1e163-33f3-469c-a11a-e1cd268a89fe-ca-trust-extracted\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.340309 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340199 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7f1e163-33f3-469c-a11a-e1cd268a89fe-registry-tls\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.340309 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340269 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f85f374-2b96-49f3-bbee-190907c09083-tmp-dir\") pod \"dns-default-xnjlx\" (UID: \"6f85f374-2b96-49f3-bbee-190907c09083\") " pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.340309 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340295 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-crio-socket\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.340456 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340364 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f85f374-2b96-49f3-bbee-190907c09083-config-volume\") pod \"dns-default-xnjlx\" (UID: \"6f85f374-2b96-49f3-bbee-190907c09083\") " pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.340456 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340390 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw9rc\" (UniqueName: \"kubernetes.io/projected/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-kube-api-access-rw9rc\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.340456 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340436 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7f1e163-33f3-469c-a11a-e1cd268a89fe-registry-certificates\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.340588 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340454 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.340588 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340500 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7f1e163-33f3-469c-a11a-e1cd268a89fe-installation-pull-secrets\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.340588 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340516 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f85f374-2b96-49f3-bbee-190907c09083-metrics-tls\") pod \"dns-default-xnjlx\" (UID: \"6f85f374-2b96-49f3-bbee-190907c09083\") " pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.340588 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340535 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sszkm\" (UniqueName: \"kubernetes.io/projected/6f85f374-2b96-49f3-bbee-190907c09083-kube-api-access-sszkm\") pod \"dns-default-xnjlx\" (UID: \"6f85f374-2b96-49f3-bbee-190907c09083\") " pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.340588 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340582 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7f1e163-33f3-469c-a11a-e1cd268a89fe-bound-sa-token\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.340786 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.340602 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdl7x\" (UniqueName: \"kubernetes.io/projected/d7f1e163-33f3-469c-a11a-e1cd268a89fe-kube-api-access-pdl7x\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.441106 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441062 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr8ng\" (UniqueName: \"kubernetes.io/projected/2a66d209-1ba4-4e2e-b631-3118ba9b7199-kube-api-access-vr8ng\") pod \"ingress-canary-w4lx4\" (UID: \"2a66d209-1ba4-4e2e-b631-3118ba9b7199\") " pod="openshift-ingress-canary/ingress-canary-w4lx4" Jul 07 14:00:13.441106 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441097 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7f1e163-33f3-469c-a11a-e1cd268a89fe-registry-certificates\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.441483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441115 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.441483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441133 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7f1e163-33f3-469c-a11a-e1cd268a89fe-installation-pull-secrets\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.441483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441148 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f85f374-2b96-49f3-bbee-190907c09083-metrics-tls\") pod \"dns-default-xnjlx\" (UID: \"6f85f374-2b96-49f3-bbee-190907c09083\") " pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.441483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441167 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sszkm\" (UniqueName: \"kubernetes.io/projected/6f85f374-2b96-49f3-bbee-190907c09083-kube-api-access-sszkm\") pod \"dns-default-xnjlx\" (UID: \"6f85f374-2b96-49f3-bbee-190907c09083\") " pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.441483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441191 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7f1e163-33f3-469c-a11a-e1cd268a89fe-bound-sa-token\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.441483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441209 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdl7x\" (UniqueName: \"kubernetes.io/projected/d7f1e163-33f3-469c-a11a-e1cd268a89fe-kube-api-access-pdl7x\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.441483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441263 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a66d209-1ba4-4e2e-b631-3118ba9b7199-cert\") pod \"ingress-canary-w4lx4\" (UID: \"2a66d209-1ba4-4e2e-b631-3118ba9b7199\") " pod="openshift-ingress-canary/ingress-canary-w4lx4" Jul 07 14:00:13.441483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.441483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441390 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7f1e163-33f3-469c-a11a-e1cd268a89fe-trusted-ca\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.441483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441446 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-data-volume\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.441483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441481 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7f1e163-33f3-469c-a11a-e1cd268a89fe-image-registry-private-configuration\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.442016 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441502 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7f1e163-33f3-469c-a11a-e1cd268a89fe-ca-trust-extracted\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.442016 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441524 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7f1e163-33f3-469c-a11a-e1cd268a89fe-registry-tls\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.442016 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441542 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f85f374-2b96-49f3-bbee-190907c09083-tmp-dir\") pod \"dns-default-xnjlx\" (UID: \"6f85f374-2b96-49f3-bbee-190907c09083\") " pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.442016 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441834 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f85f374-2b96-49f3-bbee-190907c09083-tmp-dir\") pod \"dns-default-xnjlx\" (UID: \"6f85f374-2b96-49f3-bbee-190907c09083\") " pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.442016 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.441857 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.442293 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.442106 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7f1e163-33f3-469c-a11a-e1cd268a89fe-ca-trust-extracted\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.442347 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.442291 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-crio-socket\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.442347 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.442327 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-data-volume\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.442427 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.442328 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f85f374-2b96-49f3-bbee-190907c09083-config-volume\") pod \"dns-default-xnjlx\" (UID: \"6f85f374-2b96-49f3-bbee-190907c09083\") " pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.442427 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.442372 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9rc\" (UniqueName: \"kubernetes.io/projected/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-kube-api-access-rw9rc\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.442427 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.442412 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7f1e163-33f3-469c-a11a-e1cd268a89fe-trusted-ca\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.442581 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.442539 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-crio-socket\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.442774 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.442754 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f85f374-2b96-49f3-bbee-190907c09083-config-volume\") pod \"dns-default-xnjlx\" (UID: \"6f85f374-2b96-49f3-bbee-190907c09083\") " pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.445479 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.445446 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.445479 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.445453 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7f1e163-33f3-469c-a11a-e1cd268a89fe-installation-pull-secrets\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.445635 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.445499 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7f1e163-33f3-469c-a11a-e1cd268a89fe-registry-tls\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.445635 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.445514 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7f1e163-33f3-469c-a11a-e1cd268a89fe-image-registry-private-configuration\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.445712 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.445685 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f85f374-2b96-49f3-bbee-190907c09083-metrics-tls\") pod \"dns-default-xnjlx\" (UID: \"6f85f374-2b96-49f3-bbee-190907c09083\") " pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.450460 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.450439 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdl7x\" (UniqueName: \"kubernetes.io/projected/d7f1e163-33f3-469c-a11a-e1cd268a89fe-kube-api-access-pdl7x\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.450566 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.450494 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7f1e163-33f3-469c-a11a-e1cd268a89fe-bound-sa-token\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.450669 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.450654 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sszkm\" (UniqueName: \"kubernetes.io/projected/6f85f374-2b96-49f3-bbee-190907c09083-kube-api-access-sszkm\") pod \"dns-default-xnjlx\" (UID: \"6f85f374-2b96-49f3-bbee-190907c09083\") " pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.451589 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.451570 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw9rc\" (UniqueName: \"kubernetes.io/projected/ca65422c-ff55-4b7c-9238-ee9cbe4caf66-kube-api-access-rw9rc\") pod \"insights-runtime-extractor-gg4cd\" (UID: \"ca65422c-ff55-4b7c-9238-ee9cbe4caf66\") " pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.452678 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.452662 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7f1e163-33f3-469c-a11a-e1cd268a89fe-registry-certificates\") pod \"image-registry-6b7586867f-jj6zh\" (UID: \"d7f1e163-33f3-469c-a11a-e1cd268a89fe\") " pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.524577 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.524550 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:13.534677 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.534654 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:13.542888 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.542864 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a66d209-1ba4-4e2e-b631-3118ba9b7199-cert\") pod \"ingress-canary-w4lx4\" (UID: \"2a66d209-1ba4-4e2e-b631-3118ba9b7199\") " pod="openshift-ingress-canary/ingress-canary-w4lx4" Jul 07 14:00:13.542978 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.542932 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr8ng\" (UniqueName: \"kubernetes.io/projected/2a66d209-1ba4-4e2e-b631-3118ba9b7199-kube-api-access-vr8ng\") pod \"ingress-canary-w4lx4\" (UID: \"2a66d209-1ba4-4e2e-b631-3118ba9b7199\") " pod="openshift-ingress-canary/ingress-canary-w4lx4" Jul 07 14:00:13.545059 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.545034 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a66d209-1ba4-4e2e-b631-3118ba9b7199-cert\") pod \"ingress-canary-w4lx4\" (UID: \"2a66d209-1ba4-4e2e-b631-3118ba9b7199\") " pod="openshift-ingress-canary/ingress-canary-w4lx4" Jul 07 14:00:13.547966 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.547909 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gg4cd" Jul 07 14:00:13.550931 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.550911 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr8ng\" (UniqueName: \"kubernetes.io/projected/2a66d209-1ba4-4e2e-b631-3118ba9b7199-kube-api-access-vr8ng\") pod \"ingress-canary-w4lx4\" (UID: \"2a66d209-1ba4-4e2e-b631-3118ba9b7199\") " pod="openshift-ingress-canary/ingress-canary-w4lx4" Jul 07 14:00:13.628830 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.628807 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4lx4" Jul 07 14:00:13.729047 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.726835 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gg4cd"] Jul 07 14:00:13.729047 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.728551 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xnjlx"] Jul 07 14:00:13.731930 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:13.731854 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca65422c_ff55_4b7c_9238_ee9cbe4caf66.slice/crio-9274932998bc3bab8ecd600e1d3104c2ad014adf6ede53cd134d3937a29b875c WatchSource:0}: Error finding container 9274932998bc3bab8ecd600e1d3104c2ad014adf6ede53cd134d3937a29b875c: Status 404 returned error can't find the container with id 9274932998bc3bab8ecd600e1d3104c2ad014adf6ede53cd134d3937a29b875c Jul 07 14:00:13.733649 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:13.733627 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f85f374_2b96_49f3_bbee_190907c09083.slice/crio-f812b5b0f59bd6617ab57ea6d6be94cd34aaea07df2faf3abff32aa34373b04a WatchSource:0}: Error finding container f812b5b0f59bd6617ab57ea6d6be94cd34aaea07df2faf3abff32aa34373b04a: Status 404 returned error can't find the container with id f812b5b0f59bd6617ab57ea6d6be94cd34aaea07df2faf3abff32aa34373b04a Jul 07 14:00:13.742961 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.742941 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b7586867f-jj6zh"] Jul 07 14:00:13.746465 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:13.746443 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f1e163_33f3_469c_a11a_e1cd268a89fe.slice/crio-3f72858eceac49a8f1bca56b52cf5a0fb4288df872127f1ca647a3ba9d8b8fe4 WatchSource:0}: Error finding container 3f72858eceac49a8f1bca56b52cf5a0fb4288df872127f1ca647a3ba9d8b8fe4: Status 404 returned error can't find the container with id 3f72858eceac49a8f1bca56b52cf5a0fb4288df872127f1ca647a3ba9d8b8fe4 Jul 07 14:00:13.783955 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:13.783936 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4lx4"] Jul 07 14:00:13.798273 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:13.798247 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a66d209_1ba4_4e2e_b631_3118ba9b7199.slice/crio-f335340a719df01d8199f1dd742e7c34a4de4e4b59ec0bb97ff594ee487b3c85 WatchSource:0}: Error finding container f335340a719df01d8199f1dd742e7c34a4de4e4b59ec0bb97ff594ee487b3c85: Status 404 returned error can't find the container with id f335340a719df01d8199f1dd742e7c34a4de4e4b59ec0bb97ff594ee487b3c85 Jul 07 14:00:14.420565 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.420526 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:14.420713 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.420543 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:14.420713 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.420650 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 14:00:14.424672 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.424471 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rw24\"" Jul 07 14:00:14.424672 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.424479 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9zznv\"" Jul 07 14:00:14.424672 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.424515 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:00:14.424859 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.424778 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:00:14.424898 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.424880 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:00:14.424939 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.424916 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:00:14.622343 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.622241 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4lx4" event={"ID":"2a66d209-1ba4-4e2e-b631-3118ba9b7199","Type":"ContainerStarted","Data":"f335340a719df01d8199f1dd742e7c34a4de4e4b59ec0bb97ff594ee487b3c85"} Jul 07 14:00:14.624199 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.624169 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gg4cd" event={"ID":"ca65422c-ff55-4b7c-9238-ee9cbe4caf66","Type":"ContainerStarted","Data":"9274932998bc3bab8ecd600e1d3104c2ad014adf6ede53cd134d3937a29b875c"} Jul 07 14:00:14.625747 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.625722 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xnjlx" event={"ID":"6f85f374-2b96-49f3-bbee-190907c09083","Type":"ContainerStarted","Data":"f812b5b0f59bd6617ab57ea6d6be94cd34aaea07df2faf3abff32aa34373b04a"} Jul 07 14:00:14.628286 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.628264 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" event={"ID":"d7f1e163-33f3-469c-a11a-e1cd268a89fe","Type":"ContainerStarted","Data":"e9dfdf2d3630137592e5135738aeafcd887ca9458b1ccecb9e2458975e66a3f3"} Jul 07 14:00:14.628379 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.628304 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" event={"ID":"d7f1e163-33f3-469c-a11a-e1cd268a89fe","Type":"ContainerStarted","Data":"3f72858eceac49a8f1bca56b52cf5a0fb4288df872127f1ca647a3ba9d8b8fe4"} Jul 07 14:00:14.628497 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.628482 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:14.650352 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:14.650307 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" podStartSLOduration=7.650290198 podStartE2EDuration="7.650290198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:14.649937469 +0000 UTC m=+46.823725034" watchObservedRunningTime="2026-07-07 14:00:14.650290198 +0000 UTC m=+46.824077765" Jul 07 14:00:20.644889 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:20.644675 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4lx4" event={"ID":"2a66d209-1ba4-4e2e-b631-3118ba9b7199","Type":"ContainerStarted","Data":"90c80321b479985ae46b8338a833e8107097d8308463aca17f5cefdeb760be3e"} Jul 07 14:00:20.646123 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:20.646102 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gg4cd" event={"ID":"ca65422c-ff55-4b7c-9238-ee9cbe4caf66","Type":"ContainerStarted","Data":"6cb57684b43b8a38b120a2843337a27358ac18a8bbf482535cf6b9bc5ed00e07"} Jul 07 14:00:20.647733 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:20.647714 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xnjlx" event={"ID":"6f85f374-2b96-49f3-bbee-190907c09083","Type":"ContainerStarted","Data":"38aa906a6a4d9675e5659dda486997dffd8dc20516e714342e8d5d7501e596ec"} Jul 07 14:00:20.647811 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:20.647757 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xnjlx" event={"ID":"6f85f374-2b96-49f3-bbee-190907c09083","Type":"ContainerStarted","Data":"db1b6cab52ffcfc94bad79647db87163aa19a47bfc7c8114f8282be7f350636a"} Jul 07 14:00:20.647811 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:20.647799 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:20.664542 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:20.664506 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w4lx4" podStartSLOduration=1.5331457419999999 podStartE2EDuration="7.664495442s" totalImagesPullingTime="6.1313497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:20.664490339 +0000 UTC m=+52.838277911" watchObservedRunningTime="2026-07-07 14:00:20.664495442 +0000 UTC m=+52.838282993" Jul 07 14:00:20.685998 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:20.685935 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xnjlx" podStartSLOduration=1.497383635 podStartE2EDuration="7.685912567s" totalImagesPullingTime="6.188528932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:20.685842652 +0000 UTC m=+52.859630224" watchObservedRunningTime="2026-07-07 14:00:20.685912567 +0000 UTC m=+52.859700141" Jul 07 14:00:21.653103 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:21.653074 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gg4cd" event={"ID":"ca65422c-ff55-4b7c-9238-ee9cbe4caf66","Type":"ContainerStarted","Data":"db38b5711322fb7d840841489af91da8994ac50ffb4c6897441b78fa727302c7"} Jul 07 14:00:22.896863 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.896832 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d747c5d7-772lp"] Jul 07 14:00:22.899291 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.899266 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:22.902044 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.902024 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 14:00:22.903448 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.903218 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 14:00:22.903448 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.903283 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 14:00:22.903448 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.903288 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 14:00:22.903448 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.903341 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6f7x2\"" Jul 07 14:00:22.903682 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.903642 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 14:00:22.903936 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.903877 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 14:00:22.903936 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.903893 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 14:00:22.908191 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.908172 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 14:00:22.908695 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.908668 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d747c5d7-772lp"] Jul 07 14:00:22.919623 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.919601 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-oauth-serving-cert\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:22.919715 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.919640 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-console-config\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:22.919715 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.919669 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-service-ca\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:22.919715 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.919697 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c39e645b-1045-405d-a5b4-287296f14664-console-serving-cert\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:22.919844 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.919723 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc9gc\" (UniqueName: \"kubernetes.io/projected/c39e645b-1045-405d-a5b4-287296f14664-kube-api-access-fc9gc\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:22.919844 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.919776 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c39e645b-1045-405d-a5b4-287296f14664-console-oauth-config\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:22.919844 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:22.919798 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-trusted-ca-bundle\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.020505 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.020473 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c39e645b-1045-405d-a5b4-287296f14664-console-oauth-config\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.020505 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.020516 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-trusted-ca-bundle\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.020720 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.020627 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-oauth-serving-cert\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.020720 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.020669 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-console-config\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.020720 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.020699 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-service-ca\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.020862 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.020728 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c39e645b-1045-405d-a5b4-287296f14664-console-serving-cert\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.020862 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.020752 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc9gc\" (UniqueName: \"kubernetes.io/projected/c39e645b-1045-405d-a5b4-287296f14664-kube-api-access-fc9gc\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.021522 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.021460 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-oauth-serving-cert\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.021522 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.021463 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-service-ca\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.021666 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.021636 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-trusted-ca-bundle\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.021793 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.021771 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-console-config\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.024975 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.024951 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c39e645b-1045-405d-a5b4-287296f14664-console-serving-cert\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.025385 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.025362 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c39e645b-1045-405d-a5b4-287296f14664-console-oauth-config\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.029588 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.029565 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc9gc\" (UniqueName: \"kubernetes.io/projected/c39e645b-1045-405d-a5b4-287296f14664-kube-api-access-fc9gc\") pod \"console-5d747c5d7-772lp\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:23.210711 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:23.210641 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:24.249991 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:24.249947 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d747c5d7-772lp"] Jul 07 14:00:24.252818 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:24.252796 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39e645b_1045_405d_a5b4_287296f14664.slice/crio-3fc3e393c39b40c1ea119106ed2e5d62029eae18265f94a20c10013abb4d356a WatchSource:0}: Error finding container 3fc3e393c39b40c1ea119106ed2e5d62029eae18265f94a20c10013abb4d356a: Status 404 returned error can't find the container with id 3fc3e393c39b40c1ea119106ed2e5d62029eae18265f94a20c10013abb4d356a Jul 07 14:00:24.666386 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:24.666357 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gg4cd" event={"ID":"ca65422c-ff55-4b7c-9238-ee9cbe4caf66","Type":"ContainerStarted","Data":"faab445dfb67fac7c7541874a87c74fb1b9dc50fdf3f3342fd3dfa7ce039cb4b"} Jul 07 14:00:24.667631 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:24.667605 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d747c5d7-772lp" event={"ID":"c39e645b-1045-405d-a5b4-287296f14664","Type":"ContainerStarted","Data":"3fc3e393c39b40c1ea119106ed2e5d62029eae18265f94a20c10013abb4d356a"} Jul 07 14:00:24.686893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:24.686849 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gg4cd" podStartSLOduration=1.4953248860000001 podStartE2EDuration="11.686834962s" totalImagesPullingTime="10.191510076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:00:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:24.685134571 +0000 UTC m=+56.858922145" watchObservedRunningTime="2026-07-07 14:00:24.686834962 +0000 UTC m=+56.860622536" Jul 07 14:00:25.060767 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.060733 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n"] Jul 07 14:00:25.062972 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.062948 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.066093 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.065858 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 14:00:25.066207 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.066117 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 14:00:25.066297 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.066254 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 14:00:25.067387 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.067331 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 14:00:25.067485 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.067425 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9bnbv\"" Jul 07 14:00:25.067626 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.067608 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 14:00:25.067698 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.067612 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 14:00:25.077522 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.077500 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4gsw5"] Jul 07 14:00:25.079731 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.079712 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n"] Jul 07 14:00:25.079830 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.079808 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.082622 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.082390 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 14:00:25.082622 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.082459 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 14:00:25.082622 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.082397 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4zbsd\"" Jul 07 14:00:25.082622 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.082546 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 14:00:25.136504 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.136474 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.136614 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.136516 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fff9a581-0792-4744-b783-2276a817971a-node-exporter-accelerators-collector-config\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.136614 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.136544 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fff9a581-0792-4744-b783-2276a817971a-sys\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.136697 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.136608 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.136697 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.136638 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5rbm\" (UniqueName: \"kubernetes.io/projected/fff9a581-0792-4744-b783-2276a817971a-kube-api-access-k5rbm\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.136697 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.136672 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a9cfdd26-61bf-4b70-964a-58e73f9362cc-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.136827 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.136698 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fff9a581-0792-4744-b783-2276a817971a-node-exporter-wtmp\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.136827 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.136721 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fff9a581-0792-4744-b783-2276a817971a-root\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.136827 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.136734 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fff9a581-0792-4744-b783-2276a817971a-node-exporter-tls\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.136827 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.136763 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fff9a581-0792-4744-b783-2276a817971a-metrics-client-ca\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.137015 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.136862 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9cfdd26-61bf-4b70-964a-58e73f9362cc-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.137069 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.137013 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fff9a581-0792-4744-b783-2276a817971a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.137069 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.137051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.137162 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.137078 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk4lh\" (UniqueName: \"kubernetes.io/projected/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-api-access-fk4lh\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.137162 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.137102 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fff9a581-0792-4744-b783-2276a817971a-node-exporter-textfile\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.238052 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238023 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fff9a581-0792-4744-b783-2276a817971a-metrics-client-ca\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.238177 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238104 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9cfdd26-61bf-4b70-964a-58e73f9362cc-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.238177 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238150 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fff9a581-0792-4744-b783-2276a817971a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.238314 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238186 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.238314 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238211 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk4lh\" (UniqueName: \"kubernetes.io/projected/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-api-access-fk4lh\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.238314 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238255 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fff9a581-0792-4744-b783-2276a817971a-node-exporter-textfile\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.238314 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238291 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.238491 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238317 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fff9a581-0792-4744-b783-2276a817971a-node-exporter-accelerators-collector-config\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.238491 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238342 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fff9a581-0792-4744-b783-2276a817971a-sys\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.238491 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:25.238346 2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 07 14:00:25.238491 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238372 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.238491 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:25.238406 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-state-metrics-tls podName:a9cfdd26-61bf-4b70-964a-58e73f9362cc nodeName:}" failed. No retries permitted until 2026-07-07 14:00:25.738385754 +0000 UTC m=+57.912173312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-jlm5n" (UID: "a9cfdd26-61bf-4b70-964a-58e73f9362cc") : secret "kube-state-metrics-tls" not found Jul 07 14:00:25.238491 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238442 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5rbm\" (UniqueName: \"kubernetes.io/projected/fff9a581-0792-4744-b783-2276a817971a-kube-api-access-k5rbm\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.238491 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238484 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a9cfdd26-61bf-4b70-964a-58e73f9362cc-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.238780 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238512 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fff9a581-0792-4744-b783-2276a817971a-node-exporter-wtmp\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.238780 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238540 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fff9a581-0792-4744-b783-2276a817971a-root\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.238780 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238565 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fff9a581-0792-4744-b783-2276a817971a-node-exporter-tls\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.238780 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238700 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fff9a581-0792-4744-b783-2276a817971a-metrics-client-ca\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.238984 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.238967 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9cfdd26-61bf-4b70-964a-58e73f9362cc-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.239052 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.239030 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.239121 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.239062 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fff9a581-0792-4744-b783-2276a817971a-node-exporter-wtmp\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.239185 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.239120 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fff9a581-0792-4744-b783-2276a817971a-sys\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.239185 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.239149 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a9cfdd26-61bf-4b70-964a-58e73f9362cc-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.239185 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.239167 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fff9a581-0792-4744-b783-2276a817971a-root\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.239398 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.239377 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fff9a581-0792-4744-b783-2276a817971a-node-exporter-textfile\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.239619 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.239587 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fff9a581-0792-4744-b783-2276a817971a-node-exporter-accelerators-collector-config\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.240781 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.240760 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fff9a581-0792-4744-b783-2276a817971a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.241028 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.241006 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.241180 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.241164 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fff9a581-0792-4744-b783-2276a817971a-node-exporter-tls\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.247196 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.247165 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5rbm\" (UniqueName: \"kubernetes.io/projected/fff9a581-0792-4744-b783-2276a817971a-kube-api-access-k5rbm\") pod \"node-exporter-4gsw5\" (UID: \"fff9a581-0792-4744-b783-2276a817971a\") " pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.247290 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.247169 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk4lh\" (UniqueName: \"kubernetes.io/projected/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-api-access-fk4lh\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.389765 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.389710 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4gsw5" Jul 07 14:00:25.401457 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:25.401433 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff9a581_0792_4744_b783_2276a817971a.slice/crio-395410952d458c857f0041aebc9e67013ad9b1aff5cc32975841b5740f21fc95 WatchSource:0}: Error finding container 395410952d458c857f0041aebc9e67013ad9b1aff5cc32975841b5740f21fc95: Status 404 returned error can't find the container with id 395410952d458c857f0041aebc9e67013ad9b1aff5cc32975841b5740f21fc95 Jul 07 14:00:25.674642 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.674151 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gsw5" event={"ID":"fff9a581-0792-4744-b783-2276a817971a","Type":"ContainerStarted","Data":"395410952d458c857f0041aebc9e67013ad9b1aff5cc32975841b5740f21fc95"} Jul 07 14:00:25.743516 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.743465 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.746052 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.746029 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9cfdd26-61bf-4b70-964a-58e73f9362cc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jlm5n\" (UID: \"a9cfdd26-61bf-4b70-964a-58e73f9362cc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:25.974527 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:25.974455 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" Jul 07 14:00:26.130630 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.130600 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:00:26.133007 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.132987 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.136203 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.136176 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 14:00:26.136311 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.136180 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 14:00:26.136311 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.136180 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 14:00:26.136427 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.136181 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 14:00:26.136688 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.136672 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 14:00:26.136774 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.136725 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5sp5p\"" Jul 07 14:00:26.136836 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.136775 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 14:00:26.136836 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.136795 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 14:00:26.137048 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.137035 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 14:00:26.137124 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.137035 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 14:00:26.158275 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.158253 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:00:26.248013 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.247954 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.248013 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.247993 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.248192 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.248022 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.248192 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.248075 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.248192 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.248110 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bmh7\" (UniqueName: \"kubernetes.io/projected/f72c3437-681b-4428-962e-cbce434bfcf6-kube-api-access-6bmh7\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.248192 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.248141 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.248192 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.248163 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-web-config\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.248407 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.248199 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.248407 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.248301 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-config-volume\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.248407 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.248333 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.248407 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.248358 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f72c3437-681b-4428-962e-cbce434bfcf6-config-out\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.248542 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.248407 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f72c3437-681b-4428-962e-cbce434bfcf6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.248542 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.248426 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.348906 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.348881 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349050 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.348936 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349050 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.348969 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349050 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.348988 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349050 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.349004 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmh7\" (UniqueName: \"kubernetes.io/projected/f72c3437-681b-4428-962e-cbce434bfcf6-kube-api-access-6bmh7\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349050 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.349026 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349050 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.349048 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-web-config\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349436 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:26.349070 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-trusted-ca-bundle podName:f72c3437-681b-4428-962e-cbce434bfcf6 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:26.849048262 +0000 UTC m=+59.022835817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6") : configmap references non-existent config key: ca-bundle.crt Jul 07 14:00:26.349436 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.349112 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349436 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.349177 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-config-volume\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349436 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.349197 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349436 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.349212 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f72c3437-681b-4428-962e-cbce434bfcf6-config-out\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349436 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.349258 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f72c3437-681b-4428-962e-cbce434bfcf6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349436 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.349274 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349436 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.349424 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.349837 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:26.349820 2583 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 07 14:00:26.349888 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:00:26.349874 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-main-tls podName:f72c3437-681b-4428-962e-cbce434bfcf6 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:26.849857479 +0000 UTC m=+59.023645042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6") : secret "alertmanager-main-tls" not found Jul 07 14:00:26.350616 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.350589 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.351919 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.351878 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.352206 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.352168 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.352477 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.352431 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-config-volume\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.352569 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.352500 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.352679 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.352659 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f72c3437-681b-4428-962e-cbce434bfcf6-config-out\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.352768 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.352659 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f72c3437-681b-4428-962e-cbce434bfcf6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.353741 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.353715 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.354055 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.354033 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-web-config\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.360616 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.360582 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bmh7\" (UniqueName: \"kubernetes.io/projected/f72c3437-681b-4428-962e-cbce434bfcf6-kube-api-access-6bmh7\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.854506 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.854469 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.854974 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.854547 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.855336 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.855315 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:26.856967 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:26.856944 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:27.005957 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:27.005930 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n"] Jul 07 14:00:27.009730 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:27.009702 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cfdd26_61bf_4b70_964a_58e73f9362cc.slice/crio-6f56ddadd6dc99f98802c6bef5fda584d2bceceff4b6a919ad7855bad9331b8a WatchSource:0}: Error finding container 6f56ddadd6dc99f98802c6bef5fda584d2bceceff4b6a919ad7855bad9331b8a: Status 404 returned error can't find the container with id 6f56ddadd6dc99f98802c6bef5fda584d2bceceff4b6a919ad7855bad9331b8a Jul 07 14:00:27.043609 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:27.043574 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:00:27.191700 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:27.191672 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:00:27.195925 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:27.195886 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72c3437_681b_4428_962e_cbce434bfcf6.slice/crio-cba20284e3732f3d5ffef0679dd678e41c9c98fff0f847913a5687cd8fba91dc WatchSource:0}: Error finding container cba20284e3732f3d5ffef0679dd678e41c9c98fff0f847913a5687cd8fba91dc: Status 404 returned error can't find the container with id cba20284e3732f3d5ffef0679dd678e41c9c98fff0f847913a5687cd8fba91dc Jul 07 14:00:27.681179 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:27.681144 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" event={"ID":"a9cfdd26-61bf-4b70-964a-58e73f9362cc","Type":"ContainerStarted","Data":"6f56ddadd6dc99f98802c6bef5fda584d2bceceff4b6a919ad7855bad9331b8a"} Jul 07 14:00:27.682624 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:27.682601 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d747c5d7-772lp" event={"ID":"c39e645b-1045-405d-a5b4-287296f14664","Type":"ContainerStarted","Data":"bce30d1be65a8619b6d518a1da6eba2b70c6813fc547abe6c9f1e27e1dde7803"} Jul 07 14:00:27.683700 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:27.683680 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerStarted","Data":"cba20284e3732f3d5ffef0679dd678e41c9c98fff0f847913a5687cd8fba91dc"} Jul 07 14:00:27.704262 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:27.704200 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d747c5d7-772lp" podStartSLOduration=3.043036501 podStartE2EDuration="5.704189454s" totalImagesPullingTime="2.661152953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:27.703492413 +0000 UTC m=+59.877280003" watchObservedRunningTime="2026-07-07 14:00:27.704189454 +0000 UTC m=+59.877977026" Jul 07 14:00:28.590811 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:28.590780 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksnt5" Jul 07 14:00:28.688242 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:28.688198 2583 generic.go:356] "Generic (PLEG): container finished" podID="fff9a581-0792-4744-b783-2276a817971a" containerID="c8f97753bcdd3339a841b041126a767fcb6ab675d00f757642bfcef3535ef240" exitCode=0 Jul 07 14:00:28.688388 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:28.688259 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gsw5" event={"ID":"fff9a581-0792-4744-b783-2276a817971a","Type":"ContainerDied","Data":"c8f97753bcdd3339a841b041126a767fcb6ab675d00f757642bfcef3535ef240"} Jul 07 14:00:29.518237 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.518182 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6699c57dc8-nwh6t"] Jul 07 14:00:29.520013 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.519997 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.522984 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.522929 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 14:00:29.523096 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.523060 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 14:00:29.523153 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.523131 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 14:00:29.523219 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.523182 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hwj57\"" Jul 07 14:00:29.523994 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.523970 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fem8v8qtllofs\"" Jul 07 14:00:29.524169 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.524154 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 14:00:29.532804 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.532785 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6699c57dc8-nwh6t"] Jul 07 14:00:29.577784 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.577760 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5vw5\" (UniqueName: \"kubernetes.io/projected/516c8155-59d9-484f-8c52-a77e6a4bf1ab-kube-api-access-h5vw5\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.577898 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.577805 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/516c8155-59d9-484f-8c52-a77e6a4bf1ab-secret-metrics-server-tls\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.577898 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.577829 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/516c8155-59d9-484f-8c52-a77e6a4bf1ab-metrics-server-audit-profiles\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.577981 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.577921 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/516c8155-59d9-484f-8c52-a77e6a4bf1ab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.578038 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.578020 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/516c8155-59d9-484f-8c52-a77e6a4bf1ab-client-ca-bundle\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.578092 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.578077 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/516c8155-59d9-484f-8c52-a77e6a4bf1ab-secret-metrics-server-client-certs\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.578134 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.578119 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/516c8155-59d9-484f-8c52-a77e6a4bf1ab-audit-log\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.678473 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.678445 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/516c8155-59d9-484f-8c52-a77e6a4bf1ab-secret-metrics-server-tls\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.678850 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.678478 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/516c8155-59d9-484f-8c52-a77e6a4bf1ab-metrics-server-audit-profiles\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.678850 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.678510 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/516c8155-59d9-484f-8c52-a77e6a4bf1ab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.678850 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.678688 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/516c8155-59d9-484f-8c52-a77e6a4bf1ab-client-ca-bundle\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.678850 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.678753 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/516c8155-59d9-484f-8c52-a77e6a4bf1ab-secret-metrics-server-client-certs\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.678850 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.678789 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/516c8155-59d9-484f-8c52-a77e6a4bf1ab-audit-log\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.678850 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.678828 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5vw5\" (UniqueName: \"kubernetes.io/projected/516c8155-59d9-484f-8c52-a77e6a4bf1ab-kube-api-access-h5vw5\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.679151 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.679131 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/516c8155-59d9-484f-8c52-a77e6a4bf1ab-audit-log\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.679268 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.679253 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/516c8155-59d9-484f-8c52-a77e6a4bf1ab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.679562 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.679542 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/516c8155-59d9-484f-8c52-a77e6a4bf1ab-metrics-server-audit-profiles\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.681090 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.681070 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/516c8155-59d9-484f-8c52-a77e6a4bf1ab-secret-metrics-server-client-certs\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.681402 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.681382 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/516c8155-59d9-484f-8c52-a77e6a4bf1ab-secret-metrics-server-tls\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.681470 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.681426 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/516c8155-59d9-484f-8c52-a77e6a4bf1ab-client-ca-bundle\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.686674 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.686651 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5vw5\" (UniqueName: \"kubernetes.io/projected/516c8155-59d9-484f-8c52-a77e6a4bf1ab-kube-api-access-h5vw5\") pod \"metrics-server-6699c57dc8-nwh6t\" (UID: \"516c8155-59d9-484f-8c52-a77e6a4bf1ab\") " pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.694983 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.694961 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gsw5" event={"ID":"fff9a581-0792-4744-b783-2276a817971a","Type":"ContainerStarted","Data":"fc607924cab8be7b261b4e147e129e7de765b49019bc0b81a46d46a2d27ceadd"} Jul 07 14:00:29.695079 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.695009 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gsw5" event={"ID":"fff9a581-0792-4744-b783-2276a817971a","Type":"ContainerStarted","Data":"43d757d97a8a7ffe12a95773f54a9f75b73dd9579002cb896db3604de4673fe9"} Jul 07 14:00:29.696369 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.696346 2583 generic.go:356] "Generic (PLEG): container finished" podID="f72c3437-681b-4428-962e-cbce434bfcf6" containerID="8052ce2943615f2c9c8ecaa915fcf122549cb04201170363888d42ffd02a57b1" exitCode=0 Jul 07 14:00:29.696441 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.696425 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerDied","Data":"8052ce2943615f2c9c8ecaa915fcf122549cb04201170363888d42ffd02a57b1"} Jul 07 14:00:29.698767 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.698746 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" event={"ID":"a9cfdd26-61bf-4b70-964a-58e73f9362cc","Type":"ContainerStarted","Data":"fde6f37c24d1797d3165dd66902308ed7aec7c0f5a0a12f26c9d289b24231a06"} Jul 07 14:00:29.698864 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.698794 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" event={"ID":"a9cfdd26-61bf-4b70-964a-58e73f9362cc","Type":"ContainerStarted","Data":"60344d317ca20f45a71d30ba91f97f426cb97bb22812d9310f125ef3963c476f"} Jul 07 14:00:29.698864 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.698823 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" event={"ID":"a9cfdd26-61bf-4b70-964a-58e73f9362cc","Type":"ContainerStarted","Data":"707f123d9b387da85504ce173fb3de3d382f48a0c5553fc583f8c64af6c98485"} Jul 07 14:00:29.716018 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.715979 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4gsw5" podStartSLOduration=2.146719933 podStartE2EDuration="4.715967825s" totalImagesPullingTime="2.451065084s" totalInitContainerRuntime="118.182808ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:29.715361595 +0000 UTC m=+61.889149169" watchObservedRunningTime="2026-07-07 14:00:29.715967825 +0000 UTC m=+61.889755399" Jul 07 14:00:29.735090 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.735050 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlm5n" podStartSLOduration=2.6907598310000003 podStartE2EDuration="4.735037114s" totalImagesPullingTime="2.044277283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:29.734209098 +0000 UTC m=+61.907996670" watchObservedRunningTime="2026-07-07 14:00:29.735037114 +0000 UTC m=+61.908824684" Jul 07 14:00:29.830894 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.830817 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:29.950174 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:29.950148 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6699c57dc8-nwh6t"] Jul 07 14:00:29.952522 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:29.952497 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516c8155_59d9_484f_8c52_a77e6a4bf1ab.slice/crio-d887d9a22777c5064ff025c20ab3cea56cf9b602157c5efb974284813face8c2 WatchSource:0}: Error finding container d887d9a22777c5064ff025c20ab3cea56cf9b602157c5efb974284813face8c2: Status 404 returned error can't find the container with id d887d9a22777c5064ff025c20ab3cea56cf9b602157c5efb974284813face8c2 Jul 07 14:00:30.243074 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.242998 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b7dccf98b-bvj29"] Jul 07 14:00:30.245354 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.245335 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.248335 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.248309 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 14:00:30.248335 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.248327 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 14:00:30.248589 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.248309 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 14:00:30.248648 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.248603 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 14:00:30.248701 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.248651 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 14:00:30.248881 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.248864 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7hqn6\"" Jul 07 14:00:30.255210 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.255189 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 14:00:30.261135 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.260889 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b7dccf98b-bvj29"] Jul 07 14:00:30.284722 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.284699 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c8b59c-8447-4518-a26a-f98869bda922-metrics-client-ca\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.284832 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.284732 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c8b59c-8447-4518-a26a-f98869bda922-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.284832 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.284762 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/93c8b59c-8447-4518-a26a-f98869bda922-telemeter-client-tls\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.284832 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.284787 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnhgv\" (UniqueName: \"kubernetes.io/projected/93c8b59c-8447-4518-a26a-f98869bda922-kube-api-access-xnhgv\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.284967 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.284904 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/93c8b59c-8447-4518-a26a-f98869bda922-secret-telemeter-client\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.285009 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.284988 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c8b59c-8447-4518-a26a-f98869bda922-serving-certs-ca-bundle\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.285055 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.285022 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93c8b59c-8447-4518-a26a-f98869bda922-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.285088 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.285051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/93c8b59c-8447-4518-a26a-f98869bda922-federate-client-tls\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.385670 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.385643 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/93c8b59c-8447-4518-a26a-f98869bda922-secret-telemeter-client\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.385777 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.385698 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c8b59c-8447-4518-a26a-f98869bda922-serving-certs-ca-bundle\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.385777 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.385728 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93c8b59c-8447-4518-a26a-f98869bda922-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.385777 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.385745 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/93c8b59c-8447-4518-a26a-f98869bda922-federate-client-tls\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.385918 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.385777 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c8b59c-8447-4518-a26a-f98869bda922-metrics-client-ca\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.385918 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.385808 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c8b59c-8447-4518-a26a-f98869bda922-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.385918 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.385839 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/93c8b59c-8447-4518-a26a-f98869bda922-telemeter-client-tls\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.385918 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.385865 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnhgv\" (UniqueName: \"kubernetes.io/projected/93c8b59c-8447-4518-a26a-f98869bda922-kube-api-access-xnhgv\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.386635 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.386573 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c8b59c-8447-4518-a26a-f98869bda922-serving-certs-ca-bundle\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.386797 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.386772 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c8b59c-8447-4518-a26a-f98869bda922-metrics-client-ca\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.386840 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.386790 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93c8b59c-8447-4518-a26a-f98869bda922-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.388286 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.388262 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/93c8b59c-8447-4518-a26a-f98869bda922-secret-telemeter-client\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.388430 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.388412 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/93c8b59c-8447-4518-a26a-f98869bda922-telemeter-client-tls\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.388528 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.388514 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93c8b59c-8447-4518-a26a-f98869bda922-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.388714 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.388695 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/93c8b59c-8447-4518-a26a-f98869bda922-federate-client-tls\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.394400 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.394377 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnhgv\" (UniqueName: \"kubernetes.io/projected/93c8b59c-8447-4518-a26a-f98869bda922-kube-api-access-xnhgv\") pod \"telemeter-client-5b7dccf98b-bvj29\" (UID: \"93c8b59c-8447-4518-a26a-f98869bda922\") " pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.546021 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.545991 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d747c5d7-772lp"] Jul 07 14:00:30.556400 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.556379 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" Jul 07 14:00:30.656561 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.656538 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xnjlx" Jul 07 14:00:30.710855 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.710160 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" event={"ID":"516c8155-59d9-484f-8c52-a77e6a4bf1ab","Type":"ContainerStarted","Data":"d887d9a22777c5064ff025c20ab3cea56cf9b602157c5efb974284813face8c2"} Jul 07 14:00:30.712851 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:30.712571 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b7dccf98b-bvj29"] Jul 07 14:00:30.714818 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:30.714791 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c8b59c_8447_4518_a26a_f98869bda922.slice/crio-bfb992a505b090f2fb674e74ea746b981770afe9a5f166d458caedc885ad2b99 WatchSource:0}: Error finding container bfb992a505b090f2fb674e74ea746b981770afe9a5f166d458caedc885ad2b99: Status 404 returned error can't find the container with id bfb992a505b090f2fb674e74ea746b981770afe9a5f166d458caedc885ad2b99 Jul 07 14:00:31.723412 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:31.723382 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" event={"ID":"93c8b59c-8447-4518-a26a-f98869bda922","Type":"ContainerStarted","Data":"bfb992a505b090f2fb674e74ea746b981770afe9a5f166d458caedc885ad2b99"} Jul 07 14:00:31.740776 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:31.740731 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" podStartSLOduration=1.046518594 podStartE2EDuration="2.740715813s" totalImagesPullingTime="1.694197219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:31.740076295 +0000 UTC m=+63.913863870" watchObservedRunningTime="2026-07-07 14:00:31.740715813 +0000 UTC m=+63.914503390" Jul 07 14:00:32.731210 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:32.731167 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerStarted","Data":"aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178"} Jul 07 14:00:32.731614 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:32.731270 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerStarted","Data":"a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6"} Jul 07 14:00:32.731614 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:32.731317 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerStarted","Data":"8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5"} Jul 07 14:00:32.731614 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:32.731359 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerStarted","Data":"dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef"} Jul 07 14:00:32.731614 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:32.731386 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerStarted","Data":"6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564"} Jul 07 14:00:32.732805 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:32.732777 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" event={"ID":"516c8155-59d9-484f-8c52-a77e6a4bf1ab","Type":"ContainerStarted","Data":"8fd3936f8eac6eff04863e3331649ec40936b697759d04989cb8f3cf7446d5ea"} Jul 07 14:00:33.211279 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:33.211260 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:33.739493 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:33.739455 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" event={"ID":"93c8b59c-8447-4518-a26a-f98869bda922","Type":"ContainerStarted","Data":"9d43dafacc7a42be3d2c176358cd336923a83c9f0fb84f69115d010df5c14a39"} Jul 07 14:00:33.740009 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:33.739537 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" event={"ID":"93c8b59c-8447-4518-a26a-f98869bda922","Type":"ContainerStarted","Data":"95a8a3fa9787eff725b77ab398f0a03a8ac4909ebaf00030fdd5b308f9c09118"} Jul 07 14:00:33.740009 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:33.739560 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" event={"ID":"93c8b59c-8447-4518-a26a-f98869bda922","Type":"ContainerStarted","Data":"423081d5ddd80f8db5f7af33c8c09f5d06c6056b68ec8cb42c32f4c207996ceb"} Jul 07 14:00:33.764261 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:33.764193 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b7dccf98b-bvj29" podStartSLOduration=1.339890445 podStartE2EDuration="3.764178899s" totalImagesPullingTime="2.424288454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:33.762870881 +0000 UTC m=+65.936658467" watchObservedRunningTime="2026-07-07 14:00:33.764178899 +0000 UTC m=+65.937966475" Jul 07 14:00:34.020107 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.020081 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:34.022794 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.022776 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:00:34.032900 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.032880 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45b31c2e-32c0-441b-a10a-2e25700bbb10-metrics-certs\") pod \"network-metrics-daemon-g7n7m\" (UID: \"45b31c2e-32c0-441b-a10a-2e25700bbb10\") " pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:34.121558 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.121529 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 14:00:34.124472 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.124456 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:00:34.134437 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.134417 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01865e08-26a6-463c-b42f-d466b8a23b34-original-pull-secret\") pod \"global-pull-secret-syncer-kkd6d\" (UID: \"01865e08-26a6-463c-b42f-d466b8a23b34\") " pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 14:00:34.221970 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.221941 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6s9\" (UniqueName: \"kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9\") pod \"network-check-target-dxr69\" (UID: \"ba39a144-c65d-4c6c-a181-68171f97f77b\") " pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:34.224696 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.224678 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:00:34.235215 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.235190 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:00:34.244169 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.244148 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9zznv\"" Jul 07 14:00:34.245991 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.245975 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf6s9\" (UniqueName: \"kubernetes.io/projected/ba39a144-c65d-4c6c-a181-68171f97f77b-kube-api-access-jf6s9\") pod \"network-check-target-dxr69\" (UID: \"ba39a144-c65d-4c6c-a181-68171f97f77b\") " pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:34.252067 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.252052 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7n7m" Jul 07 14:00:34.259130 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.259084 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkd6d" Jul 07 14:00:34.390190 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.390155 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g7n7m"] Jul 07 14:00:34.393282 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:34.393254 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b31c2e_32c0_441b_a10a_2e25700bbb10.slice/crio-710c613b1cad0b0c4db03e8bdb4f7d464aabe8ceb8dd9cabb3010fd88379a5c7 WatchSource:0}: Error finding container 710c613b1cad0b0c4db03e8bdb4f7d464aabe8ceb8dd9cabb3010fd88379a5c7: Status 404 returned error can't find the container with id 710c613b1cad0b0c4db03e8bdb4f7d464aabe8ceb8dd9cabb3010fd88379a5c7 Jul 07 14:00:34.412815 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.412795 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kkd6d"] Jul 07 14:00:34.415136 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:34.415114 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01865e08_26a6_463c_b42f_d466b8a23b34.slice/crio-f819e38e2ee745f04f454cb0933a0d1cdf863e3c264728069fa781361607e26d WatchSource:0}: Error finding container f819e38e2ee745f04f454cb0933a0d1cdf863e3c264728069fa781361607e26d: Status 404 returned error can't find the container with id f819e38e2ee745f04f454cb0933a0d1cdf863e3c264728069fa781361607e26d Jul 07 14:00:34.536515 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.536490 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rw24\"" Jul 07 14:00:34.544742 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.544726 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:34.726887 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.726860 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dxr69"] Jul 07 14:00:34.729720 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:34.729693 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba39a144_c65d_4c6c_a181_68171f97f77b.slice/crio-7126bd9f5795ce625d8b393c6df2221125558b1e3555cd95991728d805457618 WatchSource:0}: Error finding container 7126bd9f5795ce625d8b393c6df2221125558b1e3555cd95991728d805457618: Status 404 returned error can't find the container with id 7126bd9f5795ce625d8b393c6df2221125558b1e3555cd95991728d805457618 Jul 07 14:00:34.748727 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.748698 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerStarted","Data":"cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790"} Jul 07 14:00:34.750008 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.749985 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g7n7m" event={"ID":"45b31c2e-32c0-441b-a10a-2e25700bbb10","Type":"ContainerStarted","Data":"710c613b1cad0b0c4db03e8bdb4f7d464aabe8ceb8dd9cabb3010fd88379a5c7"} Jul 07 14:00:34.751056 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.751033 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dxr69" event={"ID":"ba39a144-c65d-4c6c-a181-68171f97f77b","Type":"ContainerStarted","Data":"7126bd9f5795ce625d8b393c6df2221125558b1e3555cd95991728d805457618"} Jul 07 14:00:34.752059 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.752032 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kkd6d" event={"ID":"01865e08-26a6-463c-b42f-d466b8a23b34","Type":"ContainerStarted","Data":"f819e38e2ee745f04f454cb0933a0d1cdf863e3c264728069fa781361607e26d"} Jul 07 14:00:34.813915 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.813834 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.931957317 podStartE2EDuration="8.813819244s" totalImagesPullingTime="5.859170883s" totalInitContainerRuntime="22.691044ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:34.811052872 +0000 UTC m=+66.984840470" watchObservedRunningTime="2026-07-07 14:00:34.813819244 +0000 UTC m=+66.987606819" Jul 07 14:00:34.830996 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.830752 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f7db9c44c-hs9pn"] Jul 07 14:00:34.853172 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.853150 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:34.869133 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.868798 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7db9c44c-hs9pn"] Jul 07 14:00:34.932621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.932591 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-config\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:34.932621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.932627 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-oauth-config\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:34.932854 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.932652 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-service-ca\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:34.932854 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.932743 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-trusted-ca-bundle\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:34.932854 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.932790 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-oauth-serving-cert\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:34.932983 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.932826 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4t7b\" (UniqueName: \"kubernetes.io/projected/650ddd81-ee14-44dd-92c5-d5d252bbf21f-kube-api-access-n4t7b\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:34.932983 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:34.932881 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-serving-cert\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.033881 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.033842 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-config\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.033881 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.033881 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-oauth-config\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.034113 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.033899 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-service-ca\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.034113 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.033946 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-trusted-ca-bundle\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.034113 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.033997 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-oauth-serving-cert\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.034113 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.034037 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4t7b\" (UniqueName: \"kubernetes.io/projected/650ddd81-ee14-44dd-92c5-d5d252bbf21f-kube-api-access-n4t7b\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.034113 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.034064 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-serving-cert\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.034767 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.034738 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-config\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.034919 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.034897 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-oauth-serving-cert\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.034986 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.034976 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-service-ca\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.035155 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.035133 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-trusted-ca-bundle\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.036673 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.036649 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-serving-cert\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.036821 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.036759 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-oauth-config\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.042915 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.042889 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4t7b\" (UniqueName: \"kubernetes.io/projected/650ddd81-ee14-44dd-92c5-d5d252bbf21f-kube-api-access-n4t7b\") pod \"console-5f7db9c44c-hs9pn\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.165476 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.165373 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:35.336958 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.336907 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7db9c44c-hs9pn"] Jul 07 14:00:35.339741 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:00:35.339717 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod650ddd81_ee14_44dd_92c5_d5d252bbf21f.slice/crio-a9b83267bdbcd481e54f583e162eba619a8f5c256cc3ff97dc59f1a8bf489d63 WatchSource:0}: Error finding container a9b83267bdbcd481e54f583e162eba619a8f5c256cc3ff97dc59f1a8bf489d63: Status 404 returned error can't find the container with id a9b83267bdbcd481e54f583e162eba619a8f5c256cc3ff97dc59f1a8bf489d63 Jul 07 14:00:35.636962 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.636933 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b7586867f-jj6zh" Jul 07 14:00:35.759173 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.759081 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7db9c44c-hs9pn" event={"ID":"650ddd81-ee14-44dd-92c5-d5d252bbf21f","Type":"ContainerStarted","Data":"d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d"} Jul 07 14:00:35.759173 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.759168 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7db9c44c-hs9pn" event={"ID":"650ddd81-ee14-44dd-92c5-d5d252bbf21f","Type":"ContainerStarted","Data":"a9b83267bdbcd481e54f583e162eba619a8f5c256cc3ff97dc59f1a8bf489d63"} Jul 07 14:00:35.785633 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:35.785570 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f7db9c44c-hs9pn" podStartSLOduration=1.7855519370000001 podStartE2EDuration="1.785551937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:35.784502166 +0000 UTC m=+67.958289737" watchObservedRunningTime="2026-07-07 14:00:35.785551937 +0000 UTC m=+67.959339515" Jul 07 14:00:37.770048 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:37.770011 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g7n7m" event={"ID":"45b31c2e-32c0-441b-a10a-2e25700bbb10","Type":"ContainerStarted","Data":"b4a40ae186fb4dfbf7f85122bd83fc6c241edee2315a87a6ec38e8f12956a5c7"} Jul 07 14:00:37.770510 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:37.770106 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g7n7m" event={"ID":"45b31c2e-32c0-441b-a10a-2e25700bbb10","Type":"ContainerStarted","Data":"00432fb1901daada3bf2b6831f7766a496567bccd09f53dabb015e901c9e98bd"} Jul 07 14:00:37.787148 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:37.787089 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g7n7m" podStartSLOduration=67.503799111 podStartE2EDuration="1m9.787074906s" totalImagesPullingTime="2.283275795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:37.786621225 +0000 UTC m=+69.960408800" watchObservedRunningTime="2026-07-07 14:00:37.787074906 +0000 UTC m=+69.960862479" Jul 07 14:00:39.780630 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:39.780598 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dxr69" event={"ID":"ba39a144-c65d-4c6c-a181-68171f97f77b","Type":"ContainerStarted","Data":"b7f3d0d3c780ce25b29151ada9404d2a0fbdf333ec37e54b861ad81bdc92678b"} Jul 07 14:00:39.781034 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:39.780753 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:00:39.782094 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:39.782072 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kkd6d" event={"ID":"01865e08-26a6-463c-b42f-d466b8a23b34","Type":"ContainerStarted","Data":"2878f42bacb6e5b55071c12eee2fd56cd29334ce7fb75c6a69d96b4787c0a79f"} Jul 07 14:00:39.802090 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:39.802048 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dxr69" podStartSLOduration=67.1814046 podStartE2EDuration="1m11.802036647s" totalImagesPullingTime="4.620632047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:39.801789061 +0000 UTC m=+71.975576636" watchObservedRunningTime="2026-07-07 14:00:39.802036647 +0000 UTC m=+71.975824220" Jul 07 14:00:39.821347 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:39.821301 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kkd6d" podStartSLOduration=66.885559578 podStartE2EDuration="1m11.821287744s" totalImagesPullingTime="4.935728166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:39.820647225 +0000 UTC m=+71.994434798" watchObservedRunningTime="2026-07-07 14:00:39.821287744 +0000 UTC m=+71.995075318" Jul 07 14:00:45.166170 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:45.166136 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:45.166590 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:45.166196 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:45.170918 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:45.170894 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:45.807437 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:45.807412 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:00:49.831031 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:49.830993 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:49.831738 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:49.831071 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:00:55.565467 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:55.565424 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d747c5d7-772lp" podUID="c39e645b-1045-405d-a5b4-287296f14664" containerName="console" containerID="cri-o://bce30d1be65a8619b6d518a1da6eba2b70c6813fc547abe6c9f1e27e1dde7803" gracePeriod=15 Jul 07 14:00:55.842750 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:55.842662 2583 generic.go:356] "Generic (PLEG): container finished" podID="c39e645b-1045-405d-a5b4-287296f14664" containerID="bce30d1be65a8619b6d518a1da6eba2b70c6813fc547abe6c9f1e27e1dde7803" exitCode=0 Jul 07 14:00:55.842750 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:55.842722 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d747c5d7-772lp" event={"ID":"c39e645b-1045-405d-a5b4-287296f14664","Type":"ContainerDied","Data":"bce30d1be65a8619b6d518a1da6eba2b70c6813fc547abe6c9f1e27e1dde7803"} Jul 07 14:00:56.340846 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.340819 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:56.411760 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.411731 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-trusted-ca-bundle\") pod \"c39e645b-1045-405d-a5b4-287296f14664\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " Jul 07 14:00:56.411893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.411775 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc9gc\" (UniqueName: \"kubernetes.io/projected/c39e645b-1045-405d-a5b4-287296f14664-kube-api-access-fc9gc\") pod \"c39e645b-1045-405d-a5b4-287296f14664\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " Jul 07 14:00:56.411893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.411806 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-service-ca\") pod \"c39e645b-1045-405d-a5b4-287296f14664\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " Jul 07 14:00:56.411893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.411822 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c39e645b-1045-405d-a5b4-287296f14664-console-serving-cert\") pod \"c39e645b-1045-405d-a5b4-287296f14664\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " Jul 07 14:00:56.411893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.411840 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c39e645b-1045-405d-a5b4-287296f14664-console-oauth-config\") pod \"c39e645b-1045-405d-a5b4-287296f14664\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " Jul 07 14:00:56.411893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.411857 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-oauth-serving-cert\") pod \"c39e645b-1045-405d-a5b4-287296f14664\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " Jul 07 14:00:56.411893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.411889 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-console-config\") pod \"c39e645b-1045-405d-a5b4-287296f14664\" (UID: \"c39e645b-1045-405d-a5b4-287296f14664\") " Jul 07 14:00:56.412303 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.412264 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c39e645b-1045-405d-a5b4-287296f14664" (UID: "c39e645b-1045-405d-a5b4-287296f14664"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:00:56.412417 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.412368 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-console-config" (OuterVolumeSpecName: "console-config") pod "c39e645b-1045-405d-a5b4-287296f14664" (UID: "c39e645b-1045-405d-a5b4-287296f14664"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:00:56.412417 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.412373 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-service-ca" (OuterVolumeSpecName: "service-ca") pod "c39e645b-1045-405d-a5b4-287296f14664" (UID: "c39e645b-1045-405d-a5b4-287296f14664"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:00:56.412548 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.412416 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c39e645b-1045-405d-a5b4-287296f14664" (UID: "c39e645b-1045-405d-a5b4-287296f14664"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:00:56.414127 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.414100 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c39e645b-1045-405d-a5b4-287296f14664-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c39e645b-1045-405d-a5b4-287296f14664" (UID: "c39e645b-1045-405d-a5b4-287296f14664"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:00:56.414217 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.414144 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c39e645b-1045-405d-a5b4-287296f14664-kube-api-access-fc9gc" (OuterVolumeSpecName: "kube-api-access-fc9gc") pod "c39e645b-1045-405d-a5b4-287296f14664" (UID: "c39e645b-1045-405d-a5b4-287296f14664"). InnerVolumeSpecName "kube-api-access-fc9gc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:00:56.414217 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.414173 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c39e645b-1045-405d-a5b4-287296f14664-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c39e645b-1045-405d-a5b4-287296f14664" (UID: "c39e645b-1045-405d-a5b4-287296f14664"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:00:56.513075 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.512997 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-trusted-ca-bundle\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:00:56.513075 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.513028 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc9gc\" (UniqueName: \"kubernetes.io/projected/c39e645b-1045-405d-a5b4-287296f14664-kube-api-access-fc9gc\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:00:56.513075 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.513042 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-service-ca\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:00:56.513075 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.513055 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c39e645b-1045-405d-a5b4-287296f14664-console-serving-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:00:56.513075 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.513072 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c39e645b-1045-405d-a5b4-287296f14664-console-oauth-config\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:00:56.513075 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.513081 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-oauth-serving-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:00:56.513397 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.513090 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c39e645b-1045-405d-a5b4-287296f14664-console-config\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:00:56.847476 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.847440 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d747c5d7-772lp" event={"ID":"c39e645b-1045-405d-a5b4-287296f14664","Type":"ContainerDied","Data":"3fc3e393c39b40c1ea119106ed2e5d62029eae18265f94a20c10013abb4d356a"} Jul 07 14:00:56.847476 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.847461 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d747c5d7-772lp" Jul 07 14:00:56.847940 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.847499 2583 scope.go:117] "RemoveContainer" containerID="bce30d1be65a8619b6d518a1da6eba2b70c6813fc547abe6c9f1e27e1dde7803" Jul 07 14:00:56.864372 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.864349 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d747c5d7-772lp"] Jul 07 14:00:56.870353 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:56.870334 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d747c5d7-772lp"] Jul 07 14:00:58.424995 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:00:58.424963 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c39e645b-1045-405d-a5b4-287296f14664" path="/var/lib/kubelet/pods/c39e645b-1045-405d-a5b4-287296f14664/volumes" Jul 07 14:01:09.836686 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:09.836657 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:01:09.840532 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:09.840509 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6699c57dc8-nwh6t" Jul 07 14:01:10.790821 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:10.790794 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dxr69" Jul 07 14:01:45.405754 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:45.405721 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:01:45.406207 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:45.405990 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="alertmanager" containerID="cri-o://aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178" gracePeriod=120 Jul 07 14:01:45.406207 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:45.406065 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="kube-rbac-proxy-metric" containerID="cri-o://a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6" gracePeriod=120 Jul 07 14:01:45.406207 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:45.406091 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="kube-rbac-proxy-web" containerID="cri-o://dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef" gracePeriod=120 Jul 07 14:01:45.406207 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:45.406139 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="kube-rbac-proxy" containerID="cri-o://8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5" gracePeriod=120 Jul 07 14:01:45.406207 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:45.406101 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="prom-label-proxy" containerID="cri-o://cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790" gracePeriod=120 Jul 07 14:01:45.406207 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:45.406171 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="config-reloader" containerID="cri-o://6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564" gracePeriod=120 Jul 07 14:01:46.016925 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.016892 2583 generic.go:356] "Generic (PLEG): container finished" podID="f72c3437-681b-4428-962e-cbce434bfcf6" containerID="cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790" exitCode=0 Jul 07 14:01:46.016925 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.016921 2583 generic.go:356] "Generic (PLEG): container finished" podID="f72c3437-681b-4428-962e-cbce434bfcf6" containerID="a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6" exitCode=0 Jul 07 14:01:46.016925 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.016929 2583 generic.go:356] "Generic (PLEG): container finished" podID="f72c3437-681b-4428-962e-cbce434bfcf6" containerID="8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5" exitCode=0 Jul 07 14:01:46.016925 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.016934 2583 generic.go:356] "Generic (PLEG): container finished" podID="f72c3437-681b-4428-962e-cbce434bfcf6" containerID="6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564" exitCode=0 Jul 07 14:01:46.016925 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.016940 2583 generic.go:356] "Generic (PLEG): container finished" podID="f72c3437-681b-4428-962e-cbce434bfcf6" containerID="aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178" exitCode=0 Jul 07 14:01:46.017208 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.016961 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerDied","Data":"cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790"} Jul 07 14:01:46.017208 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.017041 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerDied","Data":"a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6"} Jul 07 14:01:46.017208 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.017067 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerDied","Data":"8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5"} Jul 07 14:01:46.017208 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.017091 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerDied","Data":"6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564"} Jul 07 14:01:46.017208 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.017117 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerDied","Data":"aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178"} Jul 07 14:01:46.652470 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.652440 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:46.792023 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.791976 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f72c3437-681b-4428-962e-cbce434bfcf6-config-out\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792023 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792039 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-cluster-tls-config\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792065 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-metrics-client-ca\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792091 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bmh7\" (UniqueName: \"kubernetes.io/projected/f72c3437-681b-4428-962e-cbce434bfcf6-kube-api-access-6bmh7\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792111 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-main-tls\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792138 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-config-volume\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792171 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f72c3437-681b-4428-962e-cbce434bfcf6-tls-assets\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792198 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-main-db\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792255 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792284 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-web-config\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792311 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-trusted-ca-bundle\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792742 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792353 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792742 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792393 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy-web\") pod \"f72c3437-681b-4428-962e-cbce434bfcf6\" (UID: \"f72c3437-681b-4428-962e-cbce434bfcf6\") " Jul 07 14:01:46.792742 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792522 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:01:46.792894 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792747 2583 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-metrics-client-ca\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:46.792894 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.792778 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:01:46.793426 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.793371 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:01:46.795660 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.795629 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f72c3437-681b-4428-962e-cbce434bfcf6-kube-api-access-6bmh7" (OuterVolumeSpecName: "kube-api-access-6bmh7") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "kube-api-access-6bmh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:01:46.795876 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.795846 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:01:46.795961 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.795880 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f72c3437-681b-4428-962e-cbce434bfcf6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:01:46.795961 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.795924 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f72c3437-681b-4428-962e-cbce434bfcf6-config-out" (OuterVolumeSpecName: "config-out") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:01:46.796071 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.796015 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:01:46.796187 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.796153 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-config-volume" (OuterVolumeSpecName: "config-volume") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:01:46.796873 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.796851 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:01:46.797601 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.797576 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:01:46.799259 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.799215 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:01:46.805528 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.805505 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-web-config" (OuterVolumeSpecName: "web-config") pod "f72c3437-681b-4428-962e-cbce434bfcf6" (UID: "f72c3437-681b-4428-962e-cbce434bfcf6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:01:46.893664 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.893616 2583 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-config-volume\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:46.893664 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.893656 2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f72c3437-681b-4428-962e-cbce434bfcf6-tls-assets\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:46.893664 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.893667 2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-main-db\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:46.893664 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.893677 2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:46.893964 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.893708 2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-web-config\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:46.893964 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.893719 2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f72c3437-681b-4428-962e-cbce434bfcf6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:46.893964 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.893727 2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:46.893964 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.893736 2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:46.893964 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.893745 2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f72c3437-681b-4428-962e-cbce434bfcf6-config-out\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:46.893964 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.893752 2583 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-cluster-tls-config\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:46.893964 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.893759 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bmh7\" (UniqueName: \"kubernetes.io/projected/f72c3437-681b-4428-962e-cbce434bfcf6-kube-api-access-6bmh7\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:46.893964 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:46.893768 2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f72c3437-681b-4428-962e-cbce434bfcf6-secret-alertmanager-main-tls\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:01:47.023193 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.023157 2583 generic.go:356] "Generic (PLEG): container finished" podID="f72c3437-681b-4428-962e-cbce434bfcf6" containerID="dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef" exitCode=0 Jul 07 14:01:47.023352 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.023249 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.023352 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.023262 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerDied","Data":"dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef"} Jul 07 14:01:47.023414 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.023357 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f72c3437-681b-4428-962e-cbce434bfcf6","Type":"ContainerDied","Data":"cba20284e3732f3d5ffef0679dd678e41c9c98fff0f847913a5687cd8fba91dc"} Jul 07 14:01:47.023414 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.023391 2583 scope.go:117] "RemoveContainer" containerID="cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790" Jul 07 14:01:47.030898 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.030772 2583 scope.go:117] "RemoveContainer" containerID="a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6" Jul 07 14:01:47.038097 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.038080 2583 scope.go:117] "RemoveContainer" containerID="8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5" Jul 07 14:01:47.044660 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.044640 2583 scope.go:117] "RemoveContainer" containerID="dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef" Jul 07 14:01:47.051349 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.051325 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:01:47.051775 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.051759 2583 scope.go:117] "RemoveContainer" containerID="6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564" Jul 07 14:01:47.058424 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.058405 2583 scope.go:117] "RemoveContainer" containerID="aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178" Jul 07 14:01:47.062637 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.062610 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:01:47.065709 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.065690 2583 scope.go:117] "RemoveContainer" containerID="8052ce2943615f2c9c8ecaa915fcf122549cb04201170363888d42ffd02a57b1" Jul 07 14:01:47.072169 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.072153 2583 scope.go:117] "RemoveContainer" containerID="cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790" Jul 07 14:01:47.072458 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:01:47.072438 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790\": container with ID starting with cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790 not found: ID does not exist" containerID="cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790" Jul 07 14:01:47.072506 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.072469 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790"} err="failed to get container status \"cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790\": rpc error: code = NotFound desc = could not find container \"cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790\": container with ID starting with cce9ad758ea192ca1c306b027f03ec3e0cda2435d29e0148ff1ec83c7fa48790 not found: ID does not exist" Jul 07 14:01:47.072506 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.072502 2583 scope.go:117] "RemoveContainer" containerID="a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6" Jul 07 14:01:47.072720 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:01:47.072701 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6\": container with ID starting with a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6 not found: ID does not exist" containerID="a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6" Jul 07 14:01:47.072783 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.072729 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6"} err="failed to get container status \"a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6\": rpc error: code = NotFound desc = could not find container \"a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6\": container with ID starting with a317251f9391dd0dbc33c4353882177c57c7038f7cb889942bdfebe7375df7e6 not found: ID does not exist" Jul 07 14:01:47.072783 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.072753 2583 scope.go:117] "RemoveContainer" containerID="8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5" Jul 07 14:01:47.072981 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:01:47.072965 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5\": container with ID starting with 8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5 not found: ID does not exist" containerID="8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5" Jul 07 14:01:47.073017 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.072985 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5"} err="failed to get container status \"8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5\": rpc error: code = NotFound desc = could not find container \"8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5\": container with ID starting with 8b1c168368213d1343dd467ccab94359936e36d623feccaebc2a779c7beea6a5 not found: ID does not exist" Jul 07 14:01:47.073017 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.073000 2583 scope.go:117] "RemoveContainer" containerID="dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef" Jul 07 14:01:47.073196 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:01:47.073180 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef\": container with ID starting with dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef not found: ID does not exist" containerID="dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef" Jul 07 14:01:47.073260 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.073201 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef"} err="failed to get container status \"dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef\": rpc error: code = NotFound desc = could not find container \"dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef\": container with ID starting with dd379076dbdef78343311edb84183c10c0d54d25aaae39c39674f081f2a441ef not found: ID does not exist" Jul 07 14:01:47.073260 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.073216 2583 scope.go:117] "RemoveContainer" containerID="6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564" Jul 07 14:01:47.073472 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:01:47.073455 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564\": container with ID starting with 6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564 not found: ID does not exist" containerID="6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564" Jul 07 14:01:47.073539 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.073480 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564"} err="failed to get container status \"6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564\": rpc error: code = NotFound desc = could not find container \"6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564\": container with ID starting with 6a24272b30a53d5bd20f9e28303b46e5e0b276991ea9d4e3f89398ae7363d564 not found: ID does not exist" Jul 07 14:01:47.073539 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.073499 2583 scope.go:117] "RemoveContainer" containerID="aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178" Jul 07 14:01:47.073745 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:01:47.073728 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178\": container with ID starting with aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178 not found: ID does not exist" containerID="aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178" Jul 07 14:01:47.073785 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.073751 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178"} err="failed to get container status \"aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178\": rpc error: code = NotFound desc = could not find container \"aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178\": container with ID starting with aeddb95f9a10f8f2bf8cf5fa04b04a13bd0829bd73aa18e47865bc10883bb178 not found: ID does not exist" Jul 07 14:01:47.073785 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.073765 2583 scope.go:117] "RemoveContainer" containerID="8052ce2943615f2c9c8ecaa915fcf122549cb04201170363888d42ffd02a57b1" Jul 07 14:01:47.073988 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:01:47.073972 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8052ce2943615f2c9c8ecaa915fcf122549cb04201170363888d42ffd02a57b1\": container with ID starting with 8052ce2943615f2c9c8ecaa915fcf122549cb04201170363888d42ffd02a57b1 not found: ID does not exist" containerID="8052ce2943615f2c9c8ecaa915fcf122549cb04201170363888d42ffd02a57b1" Jul 07 14:01:47.074038 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.073993 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8052ce2943615f2c9c8ecaa915fcf122549cb04201170363888d42ffd02a57b1"} err="failed to get container status \"8052ce2943615f2c9c8ecaa915fcf122549cb04201170363888d42ffd02a57b1\": rpc error: code = NotFound desc = could not find container \"8052ce2943615f2c9c8ecaa915fcf122549cb04201170363888d42ffd02a57b1\": container with ID starting with 8052ce2943615f2c9c8ecaa915fcf122549cb04201170363888d42ffd02a57b1 not found: ID does not exist" Jul 07 14:01:47.094040 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094003 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:01:47.094303 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094291 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c39e645b-1045-405d-a5b4-287296f14664" containerName="console" Jul 07 14:01:47.094347 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094305 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c39e645b-1045-405d-a5b4-287296f14664" containerName="console" Jul 07 14:01:47.094347 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094314 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="config-reloader" Jul 07 14:01:47.094347 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094319 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="config-reloader" Jul 07 14:01:47.094347 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094333 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="alertmanager" Jul 07 14:01:47.094347 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094338 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="alertmanager" Jul 07 14:01:47.094347 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094346 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="kube-rbac-proxy-metric" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094351 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="kube-rbac-proxy-metric" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094362 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="init-config-reloader" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094367 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="init-config-reloader" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094374 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="kube-rbac-proxy" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094381 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="kube-rbac-proxy" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094386 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="prom-label-proxy" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094391 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="prom-label-proxy" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094400 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="kube-rbac-proxy-web" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094405 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="kube-rbac-proxy-web" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094446 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="config-reloader" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094454 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="kube-rbac-proxy-web" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094460 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c39e645b-1045-405d-a5b4-287296f14664" containerName="console" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094465 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="kube-rbac-proxy-metric" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094470 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="alertmanager" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094475 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="prom-label-proxy" Jul 07 14:01:47.094514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.094480 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" containerName="kube-rbac-proxy" Jul 07 14:01:47.097688 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.097672 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.100935 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.100905 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 14:01:47.101616 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.101593 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 14:01:47.101616 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.101611 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 14:01:47.101791 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.101670 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 14:01:47.101791 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.101593 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 14:01:47.101791 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.101599 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 14:01:47.101791 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.101730 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5sp5p\"" Jul 07 14:01:47.101964 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.101790 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 14:01:47.102063 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.102049 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 14:01:47.110255 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.110217 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 14:01:47.122041 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.122009 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:01:47.195967 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.195929 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2bpm\" (UniqueName: \"kubernetes.io/projected/a0f18304-c567-435d-bbb6-6ba3a56b6c66-kube-api-access-j2bpm\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.196133 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.195973 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.196133 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.196034 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.196133 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.196083 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.196133 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.196101 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.196133 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.196121 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0f18304-c567-435d-bbb6-6ba3a56b6c66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.196318 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.196139 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a0f18304-c567-435d-bbb6-6ba3a56b6c66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.196318 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.196204 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0f18304-c567-435d-bbb6-6ba3a56b6c66-config-out\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.196318 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.196244 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0f18304-c567-435d-bbb6-6ba3a56b6c66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.196318 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.196299 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-config-volume\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.196318 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.196317 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.196459 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.196332 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-web-config\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.196459 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.196352 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0f18304-c567-435d-bbb6-6ba3a56b6c66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.296941 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.296852 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.296941 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.296891 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.296941 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.296917 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0f18304-c567-435d-bbb6-6ba3a56b6c66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.297418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.296946 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a0f18304-c567-435d-bbb6-6ba3a56b6c66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.297418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.296972 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0f18304-c567-435d-bbb6-6ba3a56b6c66-config-out\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.297418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.296994 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0f18304-c567-435d-bbb6-6ba3a56b6c66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.297418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.297025 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-config-volume\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.297418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.297053 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.297418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.297076 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-web-config\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.297418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.297095 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0f18304-c567-435d-bbb6-6ba3a56b6c66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.297418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.297128 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2bpm\" (UniqueName: \"kubernetes.io/projected/a0f18304-c567-435d-bbb6-6ba3a56b6c66-kube-api-access-j2bpm\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.297418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.297160 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.297418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.297194 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.297895 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.297465 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a0f18304-c567-435d-bbb6-6ba3a56b6c66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.298016 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.297988 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0f18304-c567-435d-bbb6-6ba3a56b6c66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.298140 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.298116 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0f18304-c567-435d-bbb6-6ba3a56b6c66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.300068 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.300037 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.300190 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.300100 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.300275 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.300182 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-config-volume\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.300275 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.300195 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0f18304-c567-435d-bbb6-6ba3a56b6c66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.300387 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.300300 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.300585 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.300559 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.300701 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.300625 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0f18304-c567-435d-bbb6-6ba3a56b6c66-config-out\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.300764 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.300707 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-web-config\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.302042 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.302022 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0f18304-c567-435d-bbb6-6ba3a56b6c66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.309103 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.309086 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2bpm\" (UniqueName: \"kubernetes.io/projected/a0f18304-c567-435d-bbb6-6ba3a56b6c66-kube-api-access-j2bpm\") pod \"alertmanager-main-0\" (UID: \"a0f18304-c567-435d-bbb6-6ba3a56b6c66\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.407547 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.407487 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:01:47.546396 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:47.546361 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:01:47.549844 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:01:47.549817 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f18304_c567_435d_bbb6_6ba3a56b6c66.slice/crio-199409e09fad4f6d39975cf460bf17daad6a8cf8158a531e2fb59a4c1fb2c9ee WatchSource:0}: Error finding container 199409e09fad4f6d39975cf460bf17daad6a8cf8158a531e2fb59a4c1fb2c9ee: Status 404 returned error can't find the container with id 199409e09fad4f6d39975cf460bf17daad6a8cf8158a531e2fb59a4c1fb2c9ee Jul 07 14:01:48.028647 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:48.028606 2583 generic.go:356] "Generic (PLEG): container finished" podID="a0f18304-c567-435d-bbb6-6ba3a56b6c66" containerID="1d4c15becc8749da70aadaa6062ba9f2bcf8046c5a72ebdcbe2b4c2df5923dcf" exitCode=0 Jul 07 14:01:48.029102 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:48.028649 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0f18304-c567-435d-bbb6-6ba3a56b6c66","Type":"ContainerDied","Data":"1d4c15becc8749da70aadaa6062ba9f2bcf8046c5a72ebdcbe2b4c2df5923dcf"} Jul 07 14:01:48.029102 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:48.028736 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0f18304-c567-435d-bbb6-6ba3a56b6c66","Type":"ContainerStarted","Data":"199409e09fad4f6d39975cf460bf17daad6a8cf8158a531e2fb59a4c1fb2c9ee"} Jul 07 14:01:48.425307 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:48.425274 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f72c3437-681b-4428-962e-cbce434bfcf6" path="/var/lib/kubelet/pods/f72c3437-681b-4428-962e-cbce434bfcf6/volumes" Jul 07 14:01:49.035330 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:49.035293 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0f18304-c567-435d-bbb6-6ba3a56b6c66","Type":"ContainerStarted","Data":"e982018800e1682b3508fba826ad50eac9ede689245b2669f4e7e49f692c1c83"} Jul 07 14:01:49.035698 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:49.035363 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0f18304-c567-435d-bbb6-6ba3a56b6c66","Type":"ContainerStarted","Data":"95610dd2cf81fe7185595f5b262fa328d04f5773eaf0def6604ef0b74dbb143d"} Jul 07 14:01:49.035698 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:49.035397 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0f18304-c567-435d-bbb6-6ba3a56b6c66","Type":"ContainerStarted","Data":"a4e284ee2d10d1a1d4e1af2c03fedb9420509052fadd4d356c7ed3c819b0a34c"} Jul 07 14:01:49.035698 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:49.035422 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0f18304-c567-435d-bbb6-6ba3a56b6c66","Type":"ContainerStarted","Data":"0b2b6383a686bd72318562dea59324c57b603d729a82a7c2692b4eaf8ca3f66c"} Jul 07 14:01:49.035698 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:49.035445 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0f18304-c567-435d-bbb6-6ba3a56b6c66","Type":"ContainerStarted","Data":"0975d6b8a141cc34fd8b688214119961ff5904acecefe059979ca22f4c29ab29"} Jul 07 14:01:49.035698 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:49.035468 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0f18304-c567-435d-bbb6-6ba3a56b6c66","Type":"ContainerStarted","Data":"06dfe8689e7f815d2f82ff5254c8e80e2f11169a5229c1bfcebfa6c435834c2f"} Jul 07 14:01:49.064642 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:49.064590 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.048776564 podStartE2EDuration="2.064575153s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.798589ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:01:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:01:49.063901176 +0000 UTC m=+141.237688764" watchObservedRunningTime="2026-07-07 14:01:49.064575153 +0000 UTC m=+141.238362750" Jul 07 14:01:59.208152 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.208114 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9f68bcc99-7xtpg"] Jul 07 14:01:59.211085 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.211062 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.229242 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.229201 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9f68bcc99-7xtpg"] Jul 07 14:01:59.290297 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.290263 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-console-config\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.290467 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.290309 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-service-ca\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.290467 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.290331 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6575940e-e5e5-4227-b993-fb4c3e458f99-console-oauth-config\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.290467 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.290414 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6575940e-e5e5-4227-b993-fb4c3e458f99-console-serving-cert\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.290467 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.290451 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-trusted-ca-bundle\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.290602 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.290469 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-oauth-serving-cert\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.290602 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.290529 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9hbk\" (UniqueName: \"kubernetes.io/projected/6575940e-e5e5-4227-b993-fb4c3e458f99-kube-api-access-f9hbk\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.391528 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.391495 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-console-config\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.391729 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.391543 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-service-ca\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.391729 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.391568 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6575940e-e5e5-4227-b993-fb4c3e458f99-console-oauth-config\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.391729 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.391609 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6575940e-e5e5-4227-b993-fb4c3e458f99-console-serving-cert\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.391729 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.391626 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-trusted-ca-bundle\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.391729 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.391640 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-oauth-serving-cert\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.391729 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.391707 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9hbk\" (UniqueName: \"kubernetes.io/projected/6575940e-e5e5-4227-b993-fb4c3e458f99-kube-api-access-f9hbk\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.392587 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.392556 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-console-config\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.392587 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.392585 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-oauth-serving-cert\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.392865 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.392841 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-service-ca\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.392937 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.392841 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-trusted-ca-bundle\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.394405 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.394373 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6575940e-e5e5-4227-b993-fb4c3e458f99-console-oauth-config\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.394592 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.394572 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6575940e-e5e5-4227-b993-fb4c3e458f99-console-serving-cert\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.400869 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.400848 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9hbk\" (UniqueName: \"kubernetes.io/projected/6575940e-e5e5-4227-b993-fb4c3e458f99-kube-api-access-f9hbk\") pod \"console-9f68bcc99-7xtpg\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.521456 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.521420 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:01:59.650878 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:01:59.650849 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9f68bcc99-7xtpg"] Jul 07 14:01:59.654403 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:01:59.654377 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6575940e_e5e5_4227_b993_fb4c3e458f99.slice/crio-dca2ac922a72bc3eb274bc8942f35b3a3247e53caf54ed9713832d82d03245b7 WatchSource:0}: Error finding container dca2ac922a72bc3eb274bc8942f35b3a3247e53caf54ed9713832d82d03245b7: Status 404 returned error can't find the container with id dca2ac922a72bc3eb274bc8942f35b3a3247e53caf54ed9713832d82d03245b7 Jul 07 14:02:00.077364 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:00.077325 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f68bcc99-7xtpg" event={"ID":"6575940e-e5e5-4227-b993-fb4c3e458f99","Type":"ContainerStarted","Data":"5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9"} Jul 07 14:02:00.077364 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:00.077372 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f68bcc99-7xtpg" event={"ID":"6575940e-e5e5-4227-b993-fb4c3e458f99","Type":"ContainerStarted","Data":"dca2ac922a72bc3eb274bc8942f35b3a3247e53caf54ed9713832d82d03245b7"} Jul 07 14:02:00.099571 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:00.099518 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9f68bcc99-7xtpg" podStartSLOduration=1.0995011670000001 podStartE2EDuration="1.099501167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:01:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:00.099013041 +0000 UTC m=+152.272800636" watchObservedRunningTime="2026-07-07 14:02:00.099501167 +0000 UTC m=+152.273288741" Jul 07 14:02:09.521557 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:09.521517 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:02:09.521945 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:09.521585 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:02:09.526125 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:09.526103 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:02:10.117053 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:10.117023 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:02:10.157238 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:10.157185 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7db9c44c-hs9pn"] Jul 07 14:02:35.183710 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.183640 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f7db9c44c-hs9pn" podUID="650ddd81-ee14-44dd-92c5-d5d252bbf21f" containerName="console" containerID="cri-o://d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d" gracePeriod=15 Jul 07 14:02:35.420585 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.420560 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:02:35.470661 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.470588 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-config\") pod \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " Jul 07 14:02:35.470661 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.470640 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-oauth-config\") pod \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " Jul 07 14:02:35.470849 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.470667 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-serving-cert\") pod \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " Jul 07 14:02:35.470849 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.470692 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-trusted-ca-bundle\") pod \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " Jul 07 14:02:35.470849 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.470748 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-service-ca\") pod \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " Jul 07 14:02:35.470849 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.470781 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-oauth-serving-cert\") pod \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " Jul 07 14:02:35.470849 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.470833 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4t7b\" (UniqueName: \"kubernetes.io/projected/650ddd81-ee14-44dd-92c5-d5d252bbf21f-kube-api-access-n4t7b\") pod \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\" (UID: \"650ddd81-ee14-44dd-92c5-d5d252bbf21f\") " Jul 07 14:02:35.471153 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.471003 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-config" (OuterVolumeSpecName: "console-config") pod "650ddd81-ee14-44dd-92c5-d5d252bbf21f" (UID: "650ddd81-ee14-44dd-92c5-d5d252bbf21f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:02:35.471209 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.471177 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "650ddd81-ee14-44dd-92c5-d5d252bbf21f" (UID: "650ddd81-ee14-44dd-92c5-d5d252bbf21f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:02:35.471209 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.471188 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-service-ca" (OuterVolumeSpecName: "service-ca") pod "650ddd81-ee14-44dd-92c5-d5d252bbf21f" (UID: "650ddd81-ee14-44dd-92c5-d5d252bbf21f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:02:35.471317 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.471207 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "650ddd81-ee14-44dd-92c5-d5d252bbf21f" (UID: "650ddd81-ee14-44dd-92c5-d5d252bbf21f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:02:35.472905 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.472868 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "650ddd81-ee14-44dd-92c5-d5d252bbf21f" (UID: "650ddd81-ee14-44dd-92c5-d5d252bbf21f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:02:35.473006 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.472947 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/650ddd81-ee14-44dd-92c5-d5d252bbf21f-kube-api-access-n4t7b" (OuterVolumeSpecName: "kube-api-access-n4t7b") pod "650ddd81-ee14-44dd-92c5-d5d252bbf21f" (UID: "650ddd81-ee14-44dd-92c5-d5d252bbf21f"). InnerVolumeSpecName "kube-api-access-n4t7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:02:35.473006 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.472967 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "650ddd81-ee14-44dd-92c5-d5d252bbf21f" (UID: "650ddd81-ee14-44dd-92c5-d5d252bbf21f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:02:35.571522 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.571473 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-oauth-config\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:02:35.571522 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.571516 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-serving-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:02:35.571522 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.571525 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-trusted-ca-bundle\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:02:35.571522 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.571534 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-service-ca\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:02:35.571772 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.571543 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-oauth-serving-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:02:35.571772 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.571551 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4t7b\" (UniqueName: \"kubernetes.io/projected/650ddd81-ee14-44dd-92c5-d5d252bbf21f-kube-api-access-n4t7b\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:02:35.571772 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:35.571559 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/650ddd81-ee14-44dd-92c5-d5d252bbf21f-console-config\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:02:36.207184 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:36.207150 2583 generic.go:356] "Generic (PLEG): container finished" podID="650ddd81-ee14-44dd-92c5-d5d252bbf21f" containerID="d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d" exitCode=0 Jul 07 14:02:36.207578 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:36.207195 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7db9c44c-hs9pn" Jul 07 14:02:36.207578 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:36.207236 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7db9c44c-hs9pn" event={"ID":"650ddd81-ee14-44dd-92c5-d5d252bbf21f","Type":"ContainerDied","Data":"d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d"} Jul 07 14:02:36.207578 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:36.207285 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7db9c44c-hs9pn" event={"ID":"650ddd81-ee14-44dd-92c5-d5d252bbf21f","Type":"ContainerDied","Data":"a9b83267bdbcd481e54f583e162eba619a8f5c256cc3ff97dc59f1a8bf489d63"} Jul 07 14:02:36.207578 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:36.207305 2583 scope.go:117] "RemoveContainer" containerID="d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d" Jul 07 14:02:36.215702 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:36.215684 2583 scope.go:117] "RemoveContainer" containerID="d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d" Jul 07 14:02:36.215957 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:02:36.215940 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d\": container with ID starting with d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d not found: ID does not exist" containerID="d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d" Jul 07 14:02:36.216019 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:36.215969 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d"} err="failed to get container status \"d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d\": rpc error: code = NotFound desc = could not find container \"d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d\": container with ID starting with d5c5e4852a3e07b4842605f1945328fc28c513d64954670449592b04443d780d not found: ID does not exist" Jul 07 14:02:36.228061 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:36.228031 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7db9c44c-hs9pn"] Jul 07 14:02:36.232072 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:36.232051 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f7db9c44c-hs9pn"] Jul 07 14:02:36.425026 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:02:36.424996 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="650ddd81-ee14-44dd-92c5-d5d252bbf21f" path="/var/lib/kubelet/pods/650ddd81-ee14-44dd-92c5-d5d252bbf21f/volumes" Jul 07 14:03:19.945795 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:19.945762 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h"] Jul 07 14:03:19.946249 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:19.946041 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="650ddd81-ee14-44dd-92c5-d5d252bbf21f" containerName="console" Jul 07 14:03:19.946249 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:19.946053 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="650ddd81-ee14-44dd-92c5-d5d252bbf21f" containerName="console" Jul 07 14:03:19.946249 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:19.946112 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="650ddd81-ee14-44dd-92c5-d5d252bbf21f" containerName="console" Jul 07 14:03:19.948799 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:19.948783 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:19.964331 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:19.964308 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h"] Jul 07 14:03:19.964999 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:19.964976 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cd52c\"" Jul 07 14:03:19.965091 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:19.965041 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 14:03:19.965091 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:19.965052 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 14:03:20.013701 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:20.013677 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h\" (UID: \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:20.013818 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:20.013719 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z47gf\" (UniqueName: \"kubernetes.io/projected/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-kube-api-access-z47gf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h\" (UID: \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:20.013818 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:20.013765 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h\" (UID: \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:20.114102 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:20.114070 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h\" (UID: \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:20.114247 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:20.114122 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z47gf\" (UniqueName: \"kubernetes.io/projected/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-kube-api-access-z47gf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h\" (UID: \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:20.114247 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:20.114168 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h\" (UID: \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:20.114454 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:20.114434 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h\" (UID: \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:20.114521 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:20.114505 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h\" (UID: \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:20.122435 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:20.122415 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z47gf\" (UniqueName: \"kubernetes.io/projected/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-kube-api-access-z47gf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h\" (UID: \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:20.258931 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:20.258882 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:20.378397 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:20.378367 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h"] Jul 07 14:03:20.381918 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:03:20.381889 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda260b15_2f14_4eb3_b04e_f3cfd2ca1c5b.slice/crio-9ef6cd184c915cd3af746a2ee013992d1a698e0ede0b449ad0ecd79b2f37faec WatchSource:0}: Error finding container 9ef6cd184c915cd3af746a2ee013992d1a698e0ede0b449ad0ecd79b2f37faec: Status 404 returned error can't find the container with id 9ef6cd184c915cd3af746a2ee013992d1a698e0ede0b449ad0ecd79b2f37faec Jul 07 14:03:21.367304 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:21.367267 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" event={"ID":"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b","Type":"ContainerStarted","Data":"9ef6cd184c915cd3af746a2ee013992d1a698e0ede0b449ad0ecd79b2f37faec"} Jul 07 14:03:27.391873 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:27.391833 2583 generic.go:356] "Generic (PLEG): container finished" podID="da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" containerID="ce09cc5c8e809747a3a294cc4383e4cc294eeaa705eec9569fb9b2b33dc8330a" exitCode=0 Jul 07 14:03:27.392283 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:27.391906 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" event={"ID":"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b","Type":"ContainerDied","Data":"ce09cc5c8e809747a3a294cc4383e4cc294eeaa705eec9569fb9b2b33dc8330a"} Jul 07 14:03:30.403674 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:30.403640 2583 generic.go:356] "Generic (PLEG): container finished" podID="da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" containerID="1c3046d4fdc5eb6632d91e34375b954dfd6023a41158fbf1d301dbfbf2933406" exitCode=0 Jul 07 14:03:30.404019 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:30.403684 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" event={"ID":"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b","Type":"ContainerDied","Data":"1c3046d4fdc5eb6632d91e34375b954dfd6023a41158fbf1d301dbfbf2933406"} Jul 07 14:03:40.441445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:40.441407 2583 generic.go:356] "Generic (PLEG): container finished" podID="da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" containerID="dd1d538d3d00ab7b55fe9286479ab0f4d9360e08e90cfc47bb4fc2d401249296" exitCode=0 Jul 07 14:03:40.441780 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:40.441500 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" event={"ID":"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b","Type":"ContainerDied","Data":"dd1d538d3d00ab7b55fe9286479ab0f4d9360e08e90cfc47bb4fc2d401249296"} Jul 07 14:03:41.609240 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:41.609202 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:41.690919 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:41.690896 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z47gf\" (UniqueName: \"kubernetes.io/projected/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-kube-api-access-z47gf\") pod \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\" (UID: \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\") " Jul 07 14:03:41.691066 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:41.690999 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-bundle\") pod \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\" (UID: \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\") " Jul 07 14:03:41.691135 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:41.691069 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-util\") pod \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\" (UID: \"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b\") " Jul 07 14:03:41.691642 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:41.691616 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-bundle" (OuterVolumeSpecName: "bundle") pod "da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" (UID: "da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:03:41.692839 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:41.692819 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-kube-api-access-z47gf" (OuterVolumeSpecName: "kube-api-access-z47gf") pod "da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" (UID: "da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b"). InnerVolumeSpecName "kube-api-access-z47gf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:03:41.695634 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:41.695593 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-util" (OuterVolumeSpecName: "util") pod "da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" (UID: "da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:03:41.791916 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:41.791891 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-bundle\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:03:41.791916 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:41.791912 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-util\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:03:41.792033 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:41.791927 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z47gf\" (UniqueName: \"kubernetes.io/projected/da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b-kube-api-access-z47gf\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:03:42.450170 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:42.450135 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" event={"ID":"da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b","Type":"ContainerDied","Data":"9ef6cd184c915cd3af746a2ee013992d1a698e0ede0b449ad0ecd79b2f37faec"} Jul 07 14:03:42.450306 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:42.450187 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ef6cd184c915cd3af746a2ee013992d1a698e0ede0b449ad0ecd79b2f37faec" Jul 07 14:03:42.450306 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:42.450152 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540j877h" Jul 07 14:03:48.257965 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.257914 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv"] Jul 07 14:03:48.258439 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.258202 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" containerName="pull" Jul 07 14:03:48.258439 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.258215 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" containerName="pull" Jul 07 14:03:48.258439 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.258238 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" containerName="util" Jul 07 14:03:48.258439 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.258246 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" containerName="util" Jul 07 14:03:48.258439 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.258256 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" containerName="extract" Jul 07 14:03:48.258439 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.258264 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" containerName="extract" Jul 07 14:03:48.258439 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.258339 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="da260b15-2f14-4eb3-b04e-f3cfd2ca1c5b" containerName="extract" Jul 07 14:03:48.260106 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.260090 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv" Jul 07 14:03:48.262965 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.262942 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:03:48.263087 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.262942 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 14:03:48.263087 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.262987 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lw9vg\"" Jul 07 14:03:48.277971 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.277948 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv"] Jul 07 14:03:48.340994 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.340969 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lmpr\" (UniqueName: \"kubernetes.io/projected/2fad2fc5-8d2c-4c45-81dd-219cd544bf32-kube-api-access-7lmpr\") pod \"cert-manager-operator-controller-manager-55c444bf86-f7bkv\" (UID: \"2fad2fc5-8d2c-4c45-81dd-219cd544bf32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv" Jul 07 14:03:48.341172 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.341021 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fad2fc5-8d2c-4c45-81dd-219cd544bf32-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f7bkv\" (UID: \"2fad2fc5-8d2c-4c45-81dd-219cd544bf32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv" Jul 07 14:03:48.441781 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.441749 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lmpr\" (UniqueName: \"kubernetes.io/projected/2fad2fc5-8d2c-4c45-81dd-219cd544bf32-kube-api-access-7lmpr\") pod \"cert-manager-operator-controller-manager-55c444bf86-f7bkv\" (UID: \"2fad2fc5-8d2c-4c45-81dd-219cd544bf32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv" Jul 07 14:03:48.441949 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.441817 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fad2fc5-8d2c-4c45-81dd-219cd544bf32-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f7bkv\" (UID: \"2fad2fc5-8d2c-4c45-81dd-219cd544bf32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv" Jul 07 14:03:48.442200 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.442183 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fad2fc5-8d2c-4c45-81dd-219cd544bf32-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f7bkv\" (UID: \"2fad2fc5-8d2c-4c45-81dd-219cd544bf32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv" Jul 07 14:03:48.453444 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.453415 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lmpr\" (UniqueName: \"kubernetes.io/projected/2fad2fc5-8d2c-4c45-81dd-219cd544bf32-kube-api-access-7lmpr\") pod \"cert-manager-operator-controller-manager-55c444bf86-f7bkv\" (UID: \"2fad2fc5-8d2c-4c45-81dd-219cd544bf32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv" Jul 07 14:03:48.569157 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.569100 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv" Jul 07 14:03:48.699203 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:48.699178 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv"] Jul 07 14:03:48.701385 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:03:48.701358 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fad2fc5_8d2c_4c45_81dd_219cd544bf32.slice/crio-54dd669551fac92be01eeccb4990f987a2022bf2fc0ef62a4d29bda0823ebfcb WatchSource:0}: Error finding container 54dd669551fac92be01eeccb4990f987a2022bf2fc0ef62a4d29bda0823ebfcb: Status 404 returned error can't find the container with id 54dd669551fac92be01eeccb4990f987a2022bf2fc0ef62a4d29bda0823ebfcb Jul 07 14:03:49.476779 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:49.476744 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv" event={"ID":"2fad2fc5-8d2c-4c45-81dd-219cd544bf32","Type":"ContainerStarted","Data":"54dd669551fac92be01eeccb4990f987a2022bf2fc0ef62a4d29bda0823ebfcb"} Jul 07 14:03:50.482290 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:50.482180 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv" event={"ID":"2fad2fc5-8d2c-4c45-81dd-219cd544bf32","Type":"ContainerStarted","Data":"30ba71619233dc5b32349d0d296e674890337671876b725d2c5c6b65af898aa8"} Jul 07 14:03:51.665236 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.665177 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f7bkv" podStartSLOduration=2.287342759 podStartE2EDuration="3.66515825s" totalImagesPullingTime="1.377815491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:50.506627493 +0000 UTC m=+262.680415067" watchObservedRunningTime="2026-07-07 14:03:51.66515825 +0000 UTC m=+263.838945826" Jul 07 14:03:51.665746 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.665496 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh"] Jul 07 14:03:51.667832 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.667812 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:51.670567 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.670546 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 14:03:51.670661 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.670581 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cd52c\"" Jul 07 14:03:51.671770 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.671752 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 14:03:51.679834 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.679807 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh"] Jul 07 14:03:51.774331 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.774293 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh\" (UID: \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:51.774485 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.774334 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g2qz\" (UniqueName: \"kubernetes.io/projected/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-kube-api-access-6g2qz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh\" (UID: \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:51.774485 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.774428 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh\" (UID: \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:51.875291 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.875251 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh\" (UID: \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:51.875291 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.875294 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g2qz\" (UniqueName: \"kubernetes.io/projected/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-kube-api-access-6g2qz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh\" (UID: \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:51.875538 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.875342 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh\" (UID: \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:51.875700 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.875676 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh\" (UID: \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:51.875759 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.875699 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh\" (UID: \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:51.885870 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.885840 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g2qz\" (UniqueName: \"kubernetes.io/projected/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-kube-api-access-6g2qz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh\" (UID: \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:51.976093 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:51.976014 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:52.110750 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.110726 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh"] Jul 07 14:03:52.113256 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:03:52.113208 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a872cd6_468d_4a2d_acf2_ebbb1f0b8c56.slice/crio-57d547fcd27e3e83f74d81ffaae502772f3effcf83bfd6fc695a5f42aea14331 WatchSource:0}: Error finding container 57d547fcd27e3e83f74d81ffaae502772f3effcf83bfd6fc695a5f42aea14331: Status 404 returned error can't find the container with id 57d547fcd27e3e83f74d81ffaae502772f3effcf83bfd6fc695a5f42aea14331 Jul 07 14:03:52.167745 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.167722 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-95bfv"] Jul 07 14:03:52.169725 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.169708 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" Jul 07 14:03:52.173079 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.173054 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 14:03:52.173179 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.173159 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 14:03:52.173303 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.173286 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ngkdt\"" Jul 07 14:03:52.183478 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.183458 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-95bfv"] Jul 07 14:03:52.279344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.279310 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnmxx\" (UniqueName: \"kubernetes.io/projected/e298a3a5-4864-490e-806b-773757f5c98c-kube-api-access-tnmxx\") pod \"cert-manager-webhook-6486ffd997-95bfv\" (UID: \"e298a3a5-4864-490e-806b-773757f5c98c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" Jul 07 14:03:52.279476 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.279392 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e298a3a5-4864-490e-806b-773757f5c98c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-95bfv\" (UID: \"e298a3a5-4864-490e-806b-773757f5c98c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" Jul 07 14:03:52.380281 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.380250 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e298a3a5-4864-490e-806b-773757f5c98c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-95bfv\" (UID: \"e298a3a5-4864-490e-806b-773757f5c98c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" Jul 07 14:03:52.380444 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.380307 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnmxx\" (UniqueName: \"kubernetes.io/projected/e298a3a5-4864-490e-806b-773757f5c98c-kube-api-access-tnmxx\") pod \"cert-manager-webhook-6486ffd997-95bfv\" (UID: \"e298a3a5-4864-490e-806b-773757f5c98c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" Jul 07 14:03:52.389201 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.389168 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e298a3a5-4864-490e-806b-773757f5c98c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-95bfv\" (UID: \"e298a3a5-4864-490e-806b-773757f5c98c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" Jul 07 14:03:52.389485 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.389305 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnmxx\" (UniqueName: \"kubernetes.io/projected/e298a3a5-4864-490e-806b-773757f5c98c-kube-api-access-tnmxx\") pod \"cert-manager-webhook-6486ffd997-95bfv\" (UID: \"e298a3a5-4864-490e-806b-773757f5c98c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" Jul 07 14:03:52.486420 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.486389 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" Jul 07 14:03:52.491475 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.491440 2583 generic.go:356] "Generic (PLEG): container finished" podID="2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" containerID="b49069f38a12162b744451205ddb5671033a3dfbc8f08818d33411ed01fe0920" exitCode=0 Jul 07 14:03:52.491563 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.491495 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" event={"ID":"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56","Type":"ContainerDied","Data":"b49069f38a12162b744451205ddb5671033a3dfbc8f08818d33411ed01fe0920"} Jul 07 14:03:52.491620 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.491565 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" event={"ID":"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56","Type":"ContainerStarted","Data":"57d547fcd27e3e83f74d81ffaae502772f3effcf83bfd6fc695a5f42aea14331"} Jul 07 14:03:52.613627 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:52.613514 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-95bfv"] Jul 07 14:03:52.615937 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:03:52.615916 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode298a3a5_4864_490e_806b_773757f5c98c.slice/crio-c61f4af75d8d56b50f5bb961e0a9986e117f586ad55f90c71c6269f41e17f5a4 WatchSource:0}: Error finding container c61f4af75d8d56b50f5bb961e0a9986e117f586ad55f90c71c6269f41e17f5a4: Status 404 returned error can't find the container with id c61f4af75d8d56b50f5bb961e0a9986e117f586ad55f90c71c6269f41e17f5a4 Jul 07 14:03:53.497450 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:53.497401 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" event={"ID":"e298a3a5-4864-490e-806b-773757f5c98c","Type":"ContainerStarted","Data":"c61f4af75d8d56b50f5bb961e0a9986e117f586ad55f90c71c6269f41e17f5a4"} Jul 07 14:03:55.507640 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:55.507599 2583 generic.go:356] "Generic (PLEG): container finished" podID="2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" containerID="15486a2963a830451f6dbf23065916834951835366cb99e6b3db2644219ca3fa" exitCode=0 Jul 07 14:03:55.508066 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:55.507671 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" event={"ID":"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56","Type":"ContainerDied","Data":"15486a2963a830451f6dbf23065916834951835366cb99e6b3db2644219ca3fa"} Jul 07 14:03:56.514558 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:56.514519 2583 generic.go:356] "Generic (PLEG): container finished" podID="2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" containerID="b18456a84ea6f85299e927b4c8dd37e4fb6bd55bf7335cb0fc5fd22615c39aa6" exitCode=0 Jul 07 14:03:56.514915 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:56.514559 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" event={"ID":"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56","Type":"ContainerDied","Data":"b18456a84ea6f85299e927b4c8dd37e4fb6bd55bf7335cb0fc5fd22615c39aa6"} Jul 07 14:03:57.520162 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.520130 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" event={"ID":"e298a3a5-4864-490e-806b-773757f5c98c","Type":"ContainerStarted","Data":"8ea3a6afe7d972d7d5de5ecf48734b9a0a84fa346998e87b9f16d50241a6e776"} Jul 07 14:03:57.520518 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.520170 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" Jul 07 14:03:57.540166 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.540119 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" podStartSLOduration=1.419900384 podStartE2EDuration="5.540104499s" totalImagesPullingTime="4.120204115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:57.537936844 +0000 UTC m=+269.711724415" watchObservedRunningTime="2026-07-07 14:03:57.540104499 +0000 UTC m=+269.713892070" Jul 07 14:03:57.640820 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.640796 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:57.726037 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.726010 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g2qz\" (UniqueName: \"kubernetes.io/projected/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-kube-api-access-6g2qz\") pod \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\" (UID: \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\") " Jul 07 14:03:57.726160 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.726063 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-bundle\") pod \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\" (UID: \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\") " Jul 07 14:03:57.726160 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.726081 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-util\") pod \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\" (UID: \"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56\") " Jul 07 14:03:57.726421 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.726397 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-bundle" (OuterVolumeSpecName: "bundle") pod "2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" (UID: "2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:03:57.727980 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.727961 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-kube-api-access-6g2qz" (OuterVolumeSpecName: "kube-api-access-6g2qz") pod "2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" (UID: "2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56"). InnerVolumeSpecName "kube-api-access-6g2qz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:03:57.768484 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.768460 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-util" (OuterVolumeSpecName: "util") pod "2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" (UID: "2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:03:57.827517 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.827470 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-util\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:03:57.827517 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.827489 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g2qz\" (UniqueName: \"kubernetes.io/projected/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-kube-api-access-6g2qz\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:03:57.827517 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:57.827499 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56-bundle\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:03:58.525206 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:58.525180 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" Jul 07 14:03:58.525639 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:58.525200 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs5grh" event={"ID":"2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56","Type":"ContainerDied","Data":"57d547fcd27e3e83f74d81ffaae502772f3effcf83bfd6fc695a5f42aea14331"} Jul 07 14:03:58.525639 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:58.525259 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57d547fcd27e3e83f74d81ffaae502772f3effcf83bfd6fc695a5f42aea14331" Jul 07 14:03:59.945218 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:59.945185 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-99fmz"] Jul 07 14:03:59.945565 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:59.945448 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" containerName="extract" Jul 07 14:03:59.945565 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:59.945458 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" containerName="extract" Jul 07 14:03:59.945565 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:59.945473 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" containerName="util" Jul 07 14:03:59.945565 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:59.945478 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" containerName="util" Jul 07 14:03:59.945565 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:59.945489 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" containerName="pull" Jul 07 14:03:59.945565 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:59.945494 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" containerName="pull" Jul 07 14:03:59.945565 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:59.945539 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a872cd6-468d-4a2d-acf2-ebbb1f0b8c56" containerName="extract" Jul 07 14:03:59.948935 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:59.948919 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-99fmz" Jul 07 14:03:59.951530 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:59.951512 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-sw5n2\"" Jul 07 14:03:59.958043 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:03:59.958022 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-99fmz"] Jul 07 14:04:00.043944 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:00.043921 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d263cb7-c280-4272-ba1e-2b294f7027c7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-99fmz\" (UID: \"6d263cb7-c280-4272-ba1e-2b294f7027c7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-99fmz" Jul 07 14:04:00.044026 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:00.043951 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw6l4\" (UniqueName: \"kubernetes.io/projected/6d263cb7-c280-4272-ba1e-2b294f7027c7-kube-api-access-hw6l4\") pod \"cert-manager-cainjector-559cdd8c87-99fmz\" (UID: \"6d263cb7-c280-4272-ba1e-2b294f7027c7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-99fmz" Jul 07 14:04:00.144284 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:00.144260 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d263cb7-c280-4272-ba1e-2b294f7027c7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-99fmz\" (UID: \"6d263cb7-c280-4272-ba1e-2b294f7027c7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-99fmz" Jul 07 14:04:00.144368 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:00.144292 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw6l4\" (UniqueName: \"kubernetes.io/projected/6d263cb7-c280-4272-ba1e-2b294f7027c7-kube-api-access-hw6l4\") pod \"cert-manager-cainjector-559cdd8c87-99fmz\" (UID: \"6d263cb7-c280-4272-ba1e-2b294f7027c7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-99fmz" Jul 07 14:04:00.152385 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:00.152359 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d263cb7-c280-4272-ba1e-2b294f7027c7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-99fmz\" (UID: \"6d263cb7-c280-4272-ba1e-2b294f7027c7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-99fmz" Jul 07 14:04:00.152473 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:00.152457 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw6l4\" (UniqueName: \"kubernetes.io/projected/6d263cb7-c280-4272-ba1e-2b294f7027c7-kube-api-access-hw6l4\") pod \"cert-manager-cainjector-559cdd8c87-99fmz\" (UID: \"6d263cb7-c280-4272-ba1e-2b294f7027c7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-99fmz" Jul 07 14:04:00.257570 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:00.257515 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-99fmz" Jul 07 14:04:00.375921 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:00.375899 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-99fmz"] Jul 07 14:04:00.378239 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:04:00.378196 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d263cb7_c280_4272_ba1e_2b294f7027c7.slice/crio-2980adb0bea41b096c824235722977429a64ff38caf71a42b7bb37e4af624188 WatchSource:0}: Error finding container 2980adb0bea41b096c824235722977429a64ff38caf71a42b7bb37e4af624188: Status 404 returned error can't find the container with id 2980adb0bea41b096c824235722977429a64ff38caf71a42b7bb37e4af624188 Jul 07 14:04:00.533960 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:00.533925 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-99fmz" event={"ID":"6d263cb7-c280-4272-ba1e-2b294f7027c7","Type":"ContainerStarted","Data":"e700d3bb02335d470d290fb149ec0358408fab7e5a72a99b38027a5c81baf4ed"} Jul 07 14:04:00.534098 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:00.533975 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-99fmz" event={"ID":"6d263cb7-c280-4272-ba1e-2b294f7027c7","Type":"ContainerStarted","Data":"2980adb0bea41b096c824235722977429a64ff38caf71a42b7bb37e4af624188"} Jul 07 14:04:00.551613 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:00.551563 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-99fmz" podStartSLOduration=1.551544936 podStartE2EDuration="1.551544936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:03:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:00.550257439 +0000 UTC m=+272.724045017" watchObservedRunningTime="2026-07-07 14:04:00.551544936 +0000 UTC m=+272.725332511" Jul 07 14:04:03.477977 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.477944 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht"] Jul 07 14:04:03.481434 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.481417 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht" Jul 07 14:04:03.484052 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.484035 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 14:04:03.485136 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.485121 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nrlrz\"" Jul 07 14:04:03.485247 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.485133 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:04:03.491927 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.491911 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht"] Jul 07 14:04:03.527245 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.527198 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-95bfv" Jul 07 14:04:03.574084 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.574055 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a1e4a2e-c357-4385-88fe-c93e83990c7b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8kxht\" (UID: \"9a1e4a2e-c357-4385-88fe-c93e83990c7b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht" Jul 07 14:04:03.574264 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.574148 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x87c6\" (UniqueName: \"kubernetes.io/projected/9a1e4a2e-c357-4385-88fe-c93e83990c7b-kube-api-access-x87c6\") pod \"openshift-lws-operator-fd8ccff4c-8kxht\" (UID: \"9a1e4a2e-c357-4385-88fe-c93e83990c7b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht" Jul 07 14:04:03.674896 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.674859 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x87c6\" (UniqueName: \"kubernetes.io/projected/9a1e4a2e-c357-4385-88fe-c93e83990c7b-kube-api-access-x87c6\") pod \"openshift-lws-operator-fd8ccff4c-8kxht\" (UID: \"9a1e4a2e-c357-4385-88fe-c93e83990c7b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht" Jul 07 14:04:03.675048 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.674944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a1e4a2e-c357-4385-88fe-c93e83990c7b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8kxht\" (UID: \"9a1e4a2e-c357-4385-88fe-c93e83990c7b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht" Jul 07 14:04:03.675275 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.675259 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a1e4a2e-c357-4385-88fe-c93e83990c7b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8kxht\" (UID: \"9a1e4a2e-c357-4385-88fe-c93e83990c7b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht" Jul 07 14:04:03.684676 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.684643 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x87c6\" (UniqueName: \"kubernetes.io/projected/9a1e4a2e-c357-4385-88fe-c93e83990c7b-kube-api-access-x87c6\") pod \"openshift-lws-operator-fd8ccff4c-8kxht\" (UID: \"9a1e4a2e-c357-4385-88fe-c93e83990c7b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht" Jul 07 14:04:03.790544 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.790509 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht" Jul 07 14:04:03.915200 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:03.915176 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht"] Jul 07 14:04:03.916666 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:04:03.916643 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a1e4a2e_c357_4385_88fe_c93e83990c7b.slice/crio-e0bc6b37c4f221ae490c52d128acd39330f89654b1b8e01c74d32b79dc9e49d4 WatchSource:0}: Error finding container e0bc6b37c4f221ae490c52d128acd39330f89654b1b8e01c74d32b79dc9e49d4: Status 404 returned error can't find the container with id e0bc6b37c4f221ae490c52d128acd39330f89654b1b8e01c74d32b79dc9e49d4 Jul 07 14:04:04.554405 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:04.554367 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht" event={"ID":"9a1e4a2e-c357-4385-88fe-c93e83990c7b","Type":"ContainerStarted","Data":"e0bc6b37c4f221ae490c52d128acd39330f89654b1b8e01c74d32b79dc9e49d4"} Jul 07 14:04:06.565424 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:06.565386 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht" event={"ID":"9a1e4a2e-c357-4385-88fe-c93e83990c7b","Type":"ContainerStarted","Data":"d795d96454bd60aba414eef3da0dc39529356ba5b23bf3109b8d63d82b4b0d50"} Jul 07 14:04:06.582407 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:06.582355 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8kxht" podStartSLOduration=1.304333679 podStartE2EDuration="3.58233863s" totalImagesPullingTime="2.278004951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:06.581536929 +0000 UTC m=+278.755324522" watchObservedRunningTime="2026-07-07 14:04:06.58233863 +0000 UTC m=+278.756126204" Jul 07 14:04:09.553073 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.553017 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9"] Jul 07 14:04:09.565625 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.565601 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9"] Jul 07 14:04:09.565767 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.565695 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:09.568549 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.568522 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 14:04:09.569711 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.569690 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 14:04:09.569906 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.569892 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cd52c\"" Jul 07 14:04:09.621089 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.621054 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6e72296-03a5-4afe-9662-973a6e5e9619-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9\" (UID: \"b6e72296-03a5-4afe-9662-973a6e5e9619\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:09.621089 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.621092 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6e72296-03a5-4afe-9662-973a6e5e9619-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9\" (UID: \"b6e72296-03a5-4afe-9662-973a6e5e9619\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:09.621336 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.621174 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6sr6\" (UniqueName: \"kubernetes.io/projected/b6e72296-03a5-4afe-9662-973a6e5e9619-kube-api-access-r6sr6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9\" (UID: \"b6e72296-03a5-4afe-9662-973a6e5e9619\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:09.722114 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.722080 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6e72296-03a5-4afe-9662-973a6e5e9619-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9\" (UID: \"b6e72296-03a5-4afe-9662-973a6e5e9619\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:09.722294 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.722121 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6e72296-03a5-4afe-9662-973a6e5e9619-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9\" (UID: \"b6e72296-03a5-4afe-9662-973a6e5e9619\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:09.722294 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.722165 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6sr6\" (UniqueName: \"kubernetes.io/projected/b6e72296-03a5-4afe-9662-973a6e5e9619-kube-api-access-r6sr6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9\" (UID: \"b6e72296-03a5-4afe-9662-973a6e5e9619\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:09.722506 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.722483 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6e72296-03a5-4afe-9662-973a6e5e9619-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9\" (UID: \"b6e72296-03a5-4afe-9662-973a6e5e9619\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:09.722542 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.722502 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6e72296-03a5-4afe-9662-973a6e5e9619-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9\" (UID: \"b6e72296-03a5-4afe-9662-973a6e5e9619\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:09.730412 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.730389 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6sr6\" (UniqueName: \"kubernetes.io/projected/b6e72296-03a5-4afe-9662-973a6e5e9619-kube-api-access-r6sr6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9\" (UID: \"b6e72296-03a5-4afe-9662-973a6e5e9619\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:09.875499 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:09.875420 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:10.020906 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:10.020883 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9"] Jul 07 14:04:10.023305 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:04:10.023277 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e72296_03a5_4afe_9662_973a6e5e9619.slice/crio-4e2321d483d1fa8089e137c8fbc6af2b8c5fb7544897fcb735fbe22e31894e7c WatchSource:0}: Error finding container 4e2321d483d1fa8089e137c8fbc6af2b8c5fb7544897fcb735fbe22e31894e7c: Status 404 returned error can't find the container with id 4e2321d483d1fa8089e137c8fbc6af2b8c5fb7544897fcb735fbe22e31894e7c Jul 07 14:04:10.584004 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:10.583971 2583 generic.go:356] "Generic (PLEG): container finished" podID="b6e72296-03a5-4afe-9662-973a6e5e9619" containerID="cb24ef94baf383f1fa6041d4558d9bff0cc46bde3b5680453dec40d3932d45ef" exitCode=0 Jul 07 14:04:10.584394 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:10.584021 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" event={"ID":"b6e72296-03a5-4afe-9662-973a6e5e9619","Type":"ContainerDied","Data":"cb24ef94baf383f1fa6041d4558d9bff0cc46bde3b5680453dec40d3932d45ef"} Jul 07 14:04:10.584394 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:10.584065 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" event={"ID":"b6e72296-03a5-4afe-9662-973a6e5e9619","Type":"ContainerStarted","Data":"4e2321d483d1fa8089e137c8fbc6af2b8c5fb7544897fcb735fbe22e31894e7c"} Jul 07 14:04:11.590100 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:11.590021 2583 generic.go:356] "Generic (PLEG): container finished" podID="b6e72296-03a5-4afe-9662-973a6e5e9619" containerID="a69eb99a4f622ecd0fb31e23b3087ebf913ea42da8be8bb28a2f9d76a6062bc0" exitCode=0 Jul 07 14:04:11.590475 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:11.590111 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" event={"ID":"b6e72296-03a5-4afe-9662-973a6e5e9619","Type":"ContainerDied","Data":"a69eb99a4f622ecd0fb31e23b3087ebf913ea42da8be8bb28a2f9d76a6062bc0"} Jul 07 14:04:12.596742 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:12.596705 2583 generic.go:356] "Generic (PLEG): container finished" podID="b6e72296-03a5-4afe-9662-973a6e5e9619" containerID="6acd442e5e37001b6b7872eb941694b150ae9880dea48ce5793dbf6017812353" exitCode=0 Jul 07 14:04:12.597172 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:12.596771 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" event={"ID":"b6e72296-03a5-4afe-9662-973a6e5e9619","Type":"ContainerDied","Data":"6acd442e5e37001b6b7872eb941694b150ae9880dea48ce5793dbf6017812353"} Jul 07 14:04:13.728716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:13.728693 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:13.752460 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:13.752432 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6e72296-03a5-4afe-9662-973a6e5e9619-util\") pod \"b6e72296-03a5-4afe-9662-973a6e5e9619\" (UID: \"b6e72296-03a5-4afe-9662-973a6e5e9619\") " Jul 07 14:04:13.752590 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:13.752532 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6e72296-03a5-4afe-9662-973a6e5e9619-bundle\") pod \"b6e72296-03a5-4afe-9662-973a6e5e9619\" (UID: \"b6e72296-03a5-4afe-9662-973a6e5e9619\") " Jul 07 14:04:13.752590 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:13.752560 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6sr6\" (UniqueName: \"kubernetes.io/projected/b6e72296-03a5-4afe-9662-973a6e5e9619-kube-api-access-r6sr6\") pod \"b6e72296-03a5-4afe-9662-973a6e5e9619\" (UID: \"b6e72296-03a5-4afe-9662-973a6e5e9619\") " Jul 07 14:04:13.753242 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:13.753198 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6e72296-03a5-4afe-9662-973a6e5e9619-bundle" (OuterVolumeSpecName: "bundle") pod "b6e72296-03a5-4afe-9662-973a6e5e9619" (UID: "b6e72296-03a5-4afe-9662-973a6e5e9619"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:04:13.754769 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:13.754741 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6e72296-03a5-4afe-9662-973a6e5e9619-kube-api-access-r6sr6" (OuterVolumeSpecName: "kube-api-access-r6sr6") pod "b6e72296-03a5-4afe-9662-973a6e5e9619" (UID: "b6e72296-03a5-4afe-9662-973a6e5e9619"). InnerVolumeSpecName "kube-api-access-r6sr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:04:13.758205 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:13.758178 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6e72296-03a5-4afe-9662-973a6e5e9619-util" (OuterVolumeSpecName: "util") pod "b6e72296-03a5-4afe-9662-973a6e5e9619" (UID: "b6e72296-03a5-4afe-9662-973a6e5e9619"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:04:13.853524 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:13.853440 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6e72296-03a5-4afe-9662-973a6e5e9619-bundle\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:04:13.853524 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:13.853478 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6sr6\" (UniqueName: \"kubernetes.io/projected/b6e72296-03a5-4afe-9662-973a6e5e9619-kube-api-access-r6sr6\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:04:13.853524 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:13.853488 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6e72296-03a5-4afe-9662-973a6e5e9619-util\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:04:14.606483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:14.606447 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" event={"ID":"b6e72296-03a5-4afe-9662-973a6e5e9619","Type":"ContainerDied","Data":"4e2321d483d1fa8089e137c8fbc6af2b8c5fb7544897fcb735fbe22e31894e7c"} Jul 07 14:04:14.606625 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:14.606520 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e2321d483d1fa8089e137c8fbc6af2b8c5fb7544897fcb735fbe22e31894e7c" Jul 07 14:04:14.606625 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:14.606459 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk5ff9" Jul 07 14:04:23.519962 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.519926 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg"] Jul 07 14:04:23.520451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.520235 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e72296-03a5-4afe-9662-973a6e5e9619" containerName="pull" Jul 07 14:04:23.520451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.520247 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e72296-03a5-4afe-9662-973a6e5e9619" containerName="pull" Jul 07 14:04:23.520451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.520263 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e72296-03a5-4afe-9662-973a6e5e9619" containerName="util" Jul 07 14:04:23.520451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.520269 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e72296-03a5-4afe-9662-973a6e5e9619" containerName="util" Jul 07 14:04:23.520451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.520278 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e72296-03a5-4afe-9662-973a6e5e9619" containerName="extract" Jul 07 14:04:23.520451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.520287 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e72296-03a5-4afe-9662-973a6e5e9619" containerName="extract" Jul 07 14:04:23.520451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.520336 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6e72296-03a5-4afe-9662-973a6e5e9619" containerName="extract" Jul 07 14:04:23.522291 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.522275 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.525136 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.525095 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 14:04:23.525340 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.525145 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 14:04:23.525532 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.525513 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 14:04:23.525669 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.525651 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 14:04:23.525742 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.525597 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6r6n2\"" Jul 07 14:04:23.534853 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.534831 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg"] Jul 07 14:04:23.636151 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.636118 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-tmp\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.636344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.636166 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.636344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.636190 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxnhj\" (UniqueName: \"kubernetes.io/projected/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-kube-api-access-xxnhj\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.636344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.636278 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.636344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.636322 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-manifests\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.736703 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.736671 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxnhj\" (UniqueName: \"kubernetes.io/projected/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-kube-api-access-xxnhj\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.736893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.736709 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.736893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.736735 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-manifests\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.736893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.736766 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-tmp\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.736893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.736797 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.737212 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.737179 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-manifests\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.739033 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.739010 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-tmp\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.739259 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.739220 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.739259 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.739251 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.745722 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.745687 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxnhj\" (UniqueName: \"kubernetes.io/projected/8d60e77a-5d16-452c-aa5e-6adb2d68ff3c-kube-api-access-xxnhj\") pod \"opendatahub-operator-controller-manager-66d498b796-q9vkg\" (UID: \"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.833055 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.832982 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:23.975219 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:23.975121 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg"] Jul 07 14:04:23.977996 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:04:23.977962 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d60e77a_5d16_452c_aa5e_6adb2d68ff3c.slice/crio-e4e19a73b537010f97d7465990c2863618e83c6042843b823bd209de0c8b02eb WatchSource:0}: Error finding container e4e19a73b537010f97d7465990c2863618e83c6042843b823bd209de0c8b02eb: Status 404 returned error can't find the container with id e4e19a73b537010f97d7465990c2863618e83c6042843b823bd209de0c8b02eb Jul 07 14:04:24.648515 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:24.648483 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" event={"ID":"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c","Type":"ContainerStarted","Data":"e4e19a73b537010f97d7465990c2863618e83c6042843b823bd209de0c8b02eb"} Jul 07 14:04:27.669841 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:27.669806 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" event={"ID":"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c","Type":"ContainerStarted","Data":"ee88e4df25bb1a01ea38d95e35baa5a9b80ea951c0b0a7043f88c34b348285c3"} Jul 07 14:04:28.201164 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:28.201134 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 14:04:28.676240 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:28.676192 2583 generic.go:356] "Generic (PLEG): container finished" podID="8d60e77a-5d16-452c-aa5e-6adb2d68ff3c" containerID="ee88e4df25bb1a01ea38d95e35baa5a9b80ea951c0b0a7043f88c34b348285c3" exitCode=0 Jul 07 14:04:28.676610 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:28.676299 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" event={"ID":"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c","Type":"ContainerDied","Data":"ee88e4df25bb1a01ea38d95e35baa5a9b80ea951c0b0a7043f88c34b348285c3"} Jul 07 14:04:29.683030 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:29.682941 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" event={"ID":"8d60e77a-5d16-452c-aa5e-6adb2d68ff3c","Type":"ContainerStarted","Data":"91d7e7498c4670dedc2493ff6eb1cd35ed2f8dd78526ba676a60fbbb00c9ea7d"} Jul 07 14:04:29.683384 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:29.683040 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:29.716691 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:29.716642 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" podStartSLOduration=1.456770376 podStartE2EDuration="6.716628089s" totalImagesPullingTime="4.163168595s" totalInitContainerRuntime="1.096689118s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:29.71416109 +0000 UTC m=+301.887948682" watchObservedRunningTime="2026-07-07 14:04:29.716628089 +0000 UTC m=+301.890415660" Jul 07 14:04:40.689282 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:40.689252 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-q9vkg" Jul 07 14:04:42.823761 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:42.823725 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc"] Jul 07 14:04:42.828979 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:42.828949 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:42.831895 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:42.831872 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 14:04:42.833267 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:42.833214 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6nkln\"" Jul 07 14:04:42.833328 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:42.833266 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 14:04:42.833328 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:42.833293 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 14:04:42.843264 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:42.843218 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc"] Jul 07 14:04:42.901403 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:42.901364 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/697a56e9-b0fe-434a-b89f-6b7b4dc90de6-cert\") pod \"lws-controller-manager-c9dfbb547-mznpc\" (UID: \"697a56e9-b0fe-434a-b89f-6b7b4dc90de6\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:42.901581 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:42.901451 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfvff\" (UniqueName: \"kubernetes.io/projected/697a56e9-b0fe-434a-b89f-6b7b4dc90de6-kube-api-access-sfvff\") pod \"lws-controller-manager-c9dfbb547-mznpc\" (UID: \"697a56e9-b0fe-434a-b89f-6b7b4dc90de6\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:42.901581 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:42.901475 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/697a56e9-b0fe-434a-b89f-6b7b4dc90de6-metrics-cert\") pod \"lws-controller-manager-c9dfbb547-mznpc\" (UID: \"697a56e9-b0fe-434a-b89f-6b7b4dc90de6\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:42.901581 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:42.901527 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/697a56e9-b0fe-434a-b89f-6b7b4dc90de6-manager-config\") pod \"lws-controller-manager-c9dfbb547-mznpc\" (UID: \"697a56e9-b0fe-434a-b89f-6b7b4dc90de6\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:43.002291 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:43.002220 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/697a56e9-b0fe-434a-b89f-6b7b4dc90de6-manager-config\") pod \"lws-controller-manager-c9dfbb547-mznpc\" (UID: \"697a56e9-b0fe-434a-b89f-6b7b4dc90de6\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:43.002291 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:43.002298 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/697a56e9-b0fe-434a-b89f-6b7b4dc90de6-cert\") pod \"lws-controller-manager-c9dfbb547-mznpc\" (UID: \"697a56e9-b0fe-434a-b89f-6b7b4dc90de6\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:43.002562 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:43.002376 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfvff\" (UniqueName: \"kubernetes.io/projected/697a56e9-b0fe-434a-b89f-6b7b4dc90de6-kube-api-access-sfvff\") pod \"lws-controller-manager-c9dfbb547-mznpc\" (UID: \"697a56e9-b0fe-434a-b89f-6b7b4dc90de6\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:43.002562 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:43.002421 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/697a56e9-b0fe-434a-b89f-6b7b4dc90de6-metrics-cert\") pod \"lws-controller-manager-c9dfbb547-mznpc\" (UID: \"697a56e9-b0fe-434a-b89f-6b7b4dc90de6\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:43.003023 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:43.002999 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/697a56e9-b0fe-434a-b89f-6b7b4dc90de6-manager-config\") pod \"lws-controller-manager-c9dfbb547-mznpc\" (UID: \"697a56e9-b0fe-434a-b89f-6b7b4dc90de6\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:43.004712 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:43.004689 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/697a56e9-b0fe-434a-b89f-6b7b4dc90de6-metrics-cert\") pod \"lws-controller-manager-c9dfbb547-mznpc\" (UID: \"697a56e9-b0fe-434a-b89f-6b7b4dc90de6\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:43.004821 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:43.004798 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/697a56e9-b0fe-434a-b89f-6b7b4dc90de6-cert\") pod \"lws-controller-manager-c9dfbb547-mznpc\" (UID: \"697a56e9-b0fe-434a-b89f-6b7b4dc90de6\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:43.013863 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:43.013825 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfvff\" (UniqueName: \"kubernetes.io/projected/697a56e9-b0fe-434a-b89f-6b7b4dc90de6-kube-api-access-sfvff\") pod \"lws-controller-manager-c9dfbb547-mznpc\" (UID: \"697a56e9-b0fe-434a-b89f-6b7b4dc90de6\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:43.137974 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:43.137878 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:43.269462 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:43.269437 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc"] Jul 07 14:04:43.271732 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:04:43.271707 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697a56e9_b0fe_434a_b89f_6b7b4dc90de6.slice/crio-86daf63f5187e7e2d777ce07b76282c7345e179a645990a9b831199dc79649e7 WatchSource:0}: Error finding container 86daf63f5187e7e2d777ce07b76282c7345e179a645990a9b831199dc79649e7: Status 404 returned error can't find the container with id 86daf63f5187e7e2d777ce07b76282c7345e179a645990a9b831199dc79649e7 Jul 07 14:04:43.273652 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:43.273631 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:04:43.746971 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:43.746936 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" event={"ID":"697a56e9-b0fe-434a-b89f-6b7b4dc90de6","Type":"ContainerStarted","Data":"86daf63f5187e7e2d777ce07b76282c7345e179a645990a9b831199dc79649e7"} Jul 07 14:04:44.752534 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:44.752497 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" event={"ID":"697a56e9-b0fe-434a-b89f-6b7b4dc90de6","Type":"ContainerStarted","Data":"3de7115ae992ae108df920ad7a6dfde74c944e7f85b8992e16654dbea53ad894"} Jul 07 14:04:44.752938 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:44.752629 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:44.781895 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:44.781846 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" podStartSLOduration=1.449407505 podStartE2EDuration="2.78182807s" totalImagesPullingTime="1.332420565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:44.780025929 +0000 UTC m=+316.953813513" watchObservedRunningTime="2026-07-07 14:04:44.78182807 +0000 UTC m=+316.955615645" Jul 07 14:04:54.674493 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.674443 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6"] Jul 07 14:04:54.677344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.677326 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.680809 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.680784 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 14:04:54.681128 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.681107 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 14:04:54.681609 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.681593 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 14:04:54.681944 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.681929 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qq8lj\"" Jul 07 14:04:54.689909 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.689887 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6"] Jul 07 14:04:54.802661 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.802629 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxfm7\" (UniqueName: \"kubernetes.io/projected/092f4611-6943-4d62-b7e0-7e18ea270d57-kube-api-access-mxfm7\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.802840 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.802676 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092f4611-6943-4d62-b7e0-7e18ea270d57-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.802840 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.802705 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.802840 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.802763 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092f4611-6943-4d62-b7e0-7e18ea270d57-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.802840 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.802787 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.803045 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.802840 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.803045 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.802895 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.803045 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.802926 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092f4611-6943-4d62-b7e0-7e18ea270d57-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.803045 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.802956 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.903969 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.903939 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092f4611-6943-4d62-b7e0-7e18ea270d57-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.903969 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.903974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.904201 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.904006 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092f4611-6943-4d62-b7e0-7e18ea270d57-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.904201 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.904032 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.904201 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.904069 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.904201 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.904117 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.904201 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.904146 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092f4611-6943-4d62-b7e0-7e18ea270d57-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.904201 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.904178 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.904538 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.904209 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxfm7\" (UniqueName: \"kubernetes.io/projected/092f4611-6943-4d62-b7e0-7e18ea270d57-kube-api-access-mxfm7\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.904538 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.904459 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.904538 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.904494 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.904699 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.904620 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.904758 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.904706 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.904990 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.904967 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092f4611-6943-4d62-b7e0-7e18ea270d57-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.906346 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.906318 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092f4611-6943-4d62-b7e0-7e18ea270d57-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.906531 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.906513 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092f4611-6943-4d62-b7e0-7e18ea270d57-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.917478 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.917450 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092f4611-6943-4d62-b7e0-7e18ea270d57-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.930311 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.930257 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxfm7\" (UniqueName: \"kubernetes.io/projected/092f4611-6943-4d62-b7e0-7e18ea270d57-kube-api-access-mxfm7\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zmqr6\" (UID: \"092f4611-6943-4d62-b7e0-7e18ea270d57\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:54.987321 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:54.987282 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:04:55.132724 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.132689 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6"] Jul 07 14:04:55.136107 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:04:55.136076 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092f4611_6943_4d62_b7e0_7e18ea270d57.slice/crio-14b8c6a86ca23add36b1501c1f8ea71f0f72b997452645d2e5febec81e79d942 WatchSource:0}: Error finding container 14b8c6a86ca23add36b1501c1f8ea71f0f72b997452645d2e5febec81e79d942: Status 404 returned error can't find the container with id 14b8c6a86ca23add36b1501c1f8ea71f0f72b997452645d2e5febec81e79d942 Jul 07 14:04:55.317267 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.317221 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94"] Jul 07 14:04:55.320187 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.320162 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.323857 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.323836 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 14:04:55.323981 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.323837 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 14:04:55.323981 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.323894 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-84xkh\"" Jul 07 14:04:55.323981 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.323837 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 14:04:55.340449 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.340430 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94"] Jul 07 14:04:55.408126 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.408104 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b483707a-b864-41c1-b8dc-d651806901a7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.408259 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.408158 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b483707a-b864-41c1-b8dc-d651806901a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.408305 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.408277 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b483707a-b864-41c1-b8dc-d651806901a7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.408305 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.408301 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b483707a-b864-41c1-b8dc-d651806901a7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.408370 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.408318 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vvf5\" (UniqueName: \"kubernetes.io/projected/b483707a-b864-41c1-b8dc-d651806901a7-kube-api-access-4vvf5\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.408370 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.408342 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b483707a-b864-41c1-b8dc-d651806901a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.408370 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.408365 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b483707a-b864-41c1-b8dc-d651806901a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.509158 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.509124 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b483707a-b864-41c1-b8dc-d651806901a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.509319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.509189 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b483707a-b864-41c1-b8dc-d651806901a7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.509319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.509288 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b483707a-b864-41c1-b8dc-d651806901a7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.509319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.509313 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vvf5\" (UniqueName: \"kubernetes.io/projected/b483707a-b864-41c1-b8dc-d651806901a7-kube-api-access-4vvf5\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.509486 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.509345 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b483707a-b864-41c1-b8dc-d651806901a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.509486 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.509398 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b483707a-b864-41c1-b8dc-d651806901a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.509486 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.509440 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b483707a-b864-41c1-b8dc-d651806901a7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.509994 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.509970 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b483707a-b864-41c1-b8dc-d651806901a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.511679 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.511649 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b483707a-b864-41c1-b8dc-d651806901a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.511679 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.511661 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b483707a-b864-41c1-b8dc-d651806901a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.511802 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.511649 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b483707a-b864-41c1-b8dc-d651806901a7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.511802 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.511684 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b483707a-b864-41c1-b8dc-d651806901a7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.517762 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.517740 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b483707a-b864-41c1-b8dc-d651806901a7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.518062 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.518046 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vvf5\" (UniqueName: \"kubernetes.io/projected/b483707a-b864-41c1-b8dc-d651806901a7-kube-api-access-4vvf5\") pod \"istiod-openshift-gateway-94bb8fbfd-szr94\" (UID: \"b483707a-b864-41c1-b8dc-d651806901a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.629422 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.629353 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:55.759114 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.759088 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-mznpc" Jul 07 14:04:55.769272 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.769173 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94"] Jul 07 14:04:55.771719 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:04:55.771700 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb483707a_b864_41c1_b8dc_d651806901a7.slice/crio-ba31ad2fc9bacc7bcbf51c531c6388d69569d24141288924313555617b481e23 WatchSource:0}: Error finding container ba31ad2fc9bacc7bcbf51c531c6388d69569d24141288924313555617b481e23: Status 404 returned error can't find the container with id ba31ad2fc9bacc7bcbf51c531c6388d69569d24141288924313555617b481e23 Jul 07 14:04:55.811757 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.811625 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" event={"ID":"b483707a-b864-41c1-b8dc-d651806901a7","Type":"ContainerStarted","Data":"ba31ad2fc9bacc7bcbf51c531c6388d69569d24141288924313555617b481e23"} Jul 07 14:04:55.813333 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:55.813302 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" event={"ID":"092f4611-6943-4d62-b7e0-7e18ea270d57","Type":"ContainerStarted","Data":"14b8c6a86ca23add36b1501c1f8ea71f0f72b997452645d2e5febec81e79d942"} Jul 07 14:04:59.377510 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:59.377465 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:04:59.377864 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:59.377542 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:04:59.378609 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:59.378583 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:04:59.378708 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:59.378653 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:04:59.378708 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:59.378697 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:04:59.840714 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:59.840677 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" event={"ID":"b483707a-b864-41c1-b8dc-d651806901a7","Type":"ContainerStarted","Data":"1ee86eb2d9dadb2623549331153a429cd2ea377721a7c038d807ba8cdffd1797"} Jul 07 14:04:59.840905 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:59.840870 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:04:59.842181 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:59.842152 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" event={"ID":"092f4611-6943-4d62-b7e0-7e18ea270d57","Type":"ContainerStarted","Data":"6dd35002be5a5c41e7b236e07ca547db5df98b022339b1037efe7a001ec56f49"} Jul 07 14:04:59.878603 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:59.878553 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" podStartSLOduration=1.275044582 podStartE2EDuration="4.878538219s" totalImagesPullingTime="3.603493637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:59.871810766 +0000 UTC m=+332.045598380" watchObservedRunningTime="2026-07-07 14:04:59.878538219 +0000 UTC m=+332.052325792" Jul 07 14:04:59.923205 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:59.923142 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" podStartSLOduration=1.683393788 podStartE2EDuration="5.923120189s" totalImagesPullingTime="4.239726401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:59.922002069 +0000 UTC m=+332.095789644" watchObservedRunningTime="2026-07-07 14:04:59.923120189 +0000 UTC m=+332.096907764" Jul 07 14:04:59.988582 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:04:59.988551 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:05:00.848943 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:05:00.848914 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-szr94" Jul 07 14:05:00.992142 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:05:00.992106 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:05:01.852107 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:05:01.852072 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:05:01.852919 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:05:01.852902 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zmqr6" Jul 07 14:05:46.901192 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:05:46.901155 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9f68bcc99-7xtpg"] Jul 07 14:06:01.783471 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.783433 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8"] Jul 07 14:06:01.786155 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.786132 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:01.788928 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.788900 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 14:06:01.790067 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.790044 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fzwnx\"" Jul 07 14:06:01.790067 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.790059 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 14:06:01.795493 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.795467 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8"] Jul 07 14:06:01.882033 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.881992 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8\" (UID: \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:01.882033 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.882034 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mvss\" (UniqueName: \"kubernetes.io/projected/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-kube-api-access-2mvss\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8\" (UID: \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:01.882289 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.882064 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8\" (UID: \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:01.982747 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.982707 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8\" (UID: \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:01.982944 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.982835 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8\" (UID: \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:01.982944 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.982869 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mvss\" (UniqueName: \"kubernetes.io/projected/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-kube-api-access-2mvss\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8\" (UID: \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:01.983093 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.983074 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8\" (UID: \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:01.983164 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.983148 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8\" (UID: \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:01.991559 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:01.991529 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mvss\" (UniqueName: \"kubernetes.io/projected/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-kube-api-access-2mvss\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8\" (UID: \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:02.096828 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.096717 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:02.185796 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.185762 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts"] Jul 07 14:06:02.188293 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.188275 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:02.199584 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.199562 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts"] Jul 07 14:06:02.257435 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.257409 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8"] Jul 07 14:06:02.259176 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:06:02.259149 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38bfcd7a_f724_419e_8e3b_67cf2eb3b11f.slice/crio-6c573b346057205f7a7ba70b8f7cb3b91231ce8d6dad056bb79bb789cadc406f WatchSource:0}: Error finding container 6c573b346057205f7a7ba70b8f7cb3b91231ce8d6dad056bb79bb789cadc406f: Status 404 returned error can't find the container with id 6c573b346057205f7a7ba70b8f7cb3b91231ce8d6dad056bb79bb789cadc406f Jul 07 14:06:02.286146 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.286117 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts\" (UID: \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:02.286283 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.286218 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kngv\" (UniqueName: \"kubernetes.io/projected/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-kube-api-access-7kngv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts\" (UID: \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:02.286329 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.286303 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts\" (UID: \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:02.387478 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.387443 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts\" (UID: \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:02.387636 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.387539 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kngv\" (UniqueName: \"kubernetes.io/projected/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-kube-api-access-7kngv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts\" (UID: \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:02.387636 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.387582 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts\" (UID: \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:02.387890 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.387867 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts\" (UID: \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:02.387932 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.387889 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts\" (UID: \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:02.395845 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.395821 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kngv\" (UniqueName: \"kubernetes.io/projected/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-kube-api-access-7kngv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts\" (UID: \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:02.499316 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.499284 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:02.584974 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.584942 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq"] Jul 07 14:06:02.590819 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.590794 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:02.598962 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.598938 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq"] Jul 07 14:06:02.632723 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.632699 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts"] Jul 07 14:06:02.634682 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:06:02.634654 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0294c0eb_0a33_44dc_81d9_47a8c4976ad4.slice/crio-741871e1f8eba02eb01b0663c2b31a44d30a0da2a2d9cb250d7ffdf562ac6f8c WatchSource:0}: Error finding container 741871e1f8eba02eb01b0663c2b31a44d30a0da2a2d9cb250d7ffdf562ac6f8c: Status 404 returned error can't find the container with id 741871e1f8eba02eb01b0663c2b31a44d30a0da2a2d9cb250d7ffdf562ac6f8c Jul 07 14:06:02.690548 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.690523 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a329b74-8df1-468a-b52d-382e69a7c7a5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq\" (UID: \"1a329b74-8df1-468a-b52d-382e69a7c7a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:02.690668 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.690555 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpjkz\" (UniqueName: \"kubernetes.io/projected/1a329b74-8df1-468a-b52d-382e69a7c7a5-kube-api-access-gpjkz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq\" (UID: \"1a329b74-8df1-468a-b52d-382e69a7c7a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:02.690668 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.690626 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a329b74-8df1-468a-b52d-382e69a7c7a5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq\" (UID: \"1a329b74-8df1-468a-b52d-382e69a7c7a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:02.791354 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.791313 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a329b74-8df1-468a-b52d-382e69a7c7a5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq\" (UID: \"1a329b74-8df1-468a-b52d-382e69a7c7a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:02.791728 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.791411 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a329b74-8df1-468a-b52d-382e69a7c7a5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq\" (UID: \"1a329b74-8df1-468a-b52d-382e69a7c7a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:02.791728 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.791432 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpjkz\" (UniqueName: \"kubernetes.io/projected/1a329b74-8df1-468a-b52d-382e69a7c7a5-kube-api-access-gpjkz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq\" (UID: \"1a329b74-8df1-468a-b52d-382e69a7c7a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:02.791728 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.791696 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a329b74-8df1-468a-b52d-382e69a7c7a5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq\" (UID: \"1a329b74-8df1-468a-b52d-382e69a7c7a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:02.791857 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.791787 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a329b74-8df1-468a-b52d-382e69a7c7a5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq\" (UID: \"1a329b74-8df1-468a-b52d-382e69a7c7a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:02.799960 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.799929 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpjkz\" (UniqueName: \"kubernetes.io/projected/1a329b74-8df1-468a-b52d-382e69a7c7a5-kube-api-access-gpjkz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq\" (UID: \"1a329b74-8df1-468a-b52d-382e69a7c7a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:02.902764 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.902678 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:02.991042 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.990970 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l"] Jul 07 14:06:02.993898 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:02.993873 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:03.004027 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.003977 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l"] Jul 07 14:06:03.037582 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.037555 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq"] Jul 07 14:06:03.039444 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:06:03.039420 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a329b74_8df1_468a_b52d_382e69a7c7a5.slice/crio-b28d565a9b5f969dec7ad3fd859941fd14da7acb407822da7321980da42e7c92 WatchSource:0}: Error finding container b28d565a9b5f969dec7ad3fd859941fd14da7acb407822da7321980da42e7c92: Status 404 returned error can't find the container with id b28d565a9b5f969dec7ad3fd859941fd14da7acb407822da7321980da42e7c92 Jul 07 14:06:03.094654 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.094619 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c94ed17-05a2-402b-b8f3-f1f629a41431-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l\" (UID: \"8c94ed17-05a2-402b-b8f3-f1f629a41431\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:03.094792 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.094659 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c94ed17-05a2-402b-b8f3-f1f629a41431-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l\" (UID: \"8c94ed17-05a2-402b-b8f3-f1f629a41431\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:03.094792 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.094686 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9chz\" (UniqueName: \"kubernetes.io/projected/8c94ed17-05a2-402b-b8f3-f1f629a41431-kube-api-access-m9chz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l\" (UID: \"8c94ed17-05a2-402b-b8f3-f1f629a41431\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:03.133532 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.133499 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" event={"ID":"1a329b74-8df1-468a-b52d-382e69a7c7a5","Type":"ContainerStarted","Data":"b007f1d9b92a0a36cc86df171bbea4731acfe8d2fd5e64cf8c8a2324270292c8"} Jul 07 14:06:03.133711 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.133559 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" event={"ID":"1a329b74-8df1-468a-b52d-382e69a7c7a5","Type":"ContainerStarted","Data":"b28d565a9b5f969dec7ad3fd859941fd14da7acb407822da7321980da42e7c92"} Jul 07 14:06:03.135276 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.135251 2583 generic.go:356] "Generic (PLEG): container finished" podID="38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" containerID="bed562c0acab508d95cb0e63590a67440123eb64eba8cbffe31e56698b93be0f" exitCode=0 Jul 07 14:06:03.135415 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.135350 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" event={"ID":"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f","Type":"ContainerDied","Data":"bed562c0acab508d95cb0e63590a67440123eb64eba8cbffe31e56698b93be0f"} Jul 07 14:06:03.135415 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.135400 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" event={"ID":"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f","Type":"ContainerStarted","Data":"6c573b346057205f7a7ba70b8f7cb3b91231ce8d6dad056bb79bb789cadc406f"} Jul 07 14:06:03.137048 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.137027 2583 generic.go:356] "Generic (PLEG): container finished" podID="0294c0eb-0a33-44dc-81d9-47a8c4976ad4" containerID="60eb1b4edcd1229db6491622f067c8a01274ab8dcb2259a2f606e20d844b7bbd" exitCode=0 Jul 07 14:06:03.137140 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.137086 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" event={"ID":"0294c0eb-0a33-44dc-81d9-47a8c4976ad4","Type":"ContainerDied","Data":"60eb1b4edcd1229db6491622f067c8a01274ab8dcb2259a2f606e20d844b7bbd"} Jul 07 14:06:03.137140 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.137120 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" event={"ID":"0294c0eb-0a33-44dc-81d9-47a8c4976ad4","Type":"ContainerStarted","Data":"741871e1f8eba02eb01b0663c2b31a44d30a0da2a2d9cb250d7ffdf562ac6f8c"} Jul 07 14:06:03.195671 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.195634 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c94ed17-05a2-402b-b8f3-f1f629a41431-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l\" (UID: \"8c94ed17-05a2-402b-b8f3-f1f629a41431\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:03.195671 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.195670 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c94ed17-05a2-402b-b8f3-f1f629a41431-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l\" (UID: \"8c94ed17-05a2-402b-b8f3-f1f629a41431\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:03.195916 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.195689 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9chz\" (UniqueName: \"kubernetes.io/projected/8c94ed17-05a2-402b-b8f3-f1f629a41431-kube-api-access-m9chz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l\" (UID: \"8c94ed17-05a2-402b-b8f3-f1f629a41431\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:03.196113 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.196090 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c94ed17-05a2-402b-b8f3-f1f629a41431-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l\" (UID: \"8c94ed17-05a2-402b-b8f3-f1f629a41431\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:03.196190 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.196143 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c94ed17-05a2-402b-b8f3-f1f629a41431-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l\" (UID: \"8c94ed17-05a2-402b-b8f3-f1f629a41431\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:03.204709 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.204679 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9chz\" (UniqueName: \"kubernetes.io/projected/8c94ed17-05a2-402b-b8f3-f1f629a41431-kube-api-access-m9chz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l\" (UID: \"8c94ed17-05a2-402b-b8f3-f1f629a41431\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:03.315619 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.315582 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:03.448487 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:03.448460 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l"] Jul 07 14:06:03.450276 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:06:03.450253 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c94ed17_05a2_402b_b8f3_f1f629a41431.slice/crio-01ca89b724c0c8fe09843eae47a1dd9b077ad069fa34d51b9ffc2b299dc4645e WatchSource:0}: Error finding container 01ca89b724c0c8fe09843eae47a1dd9b077ad069fa34d51b9ffc2b299dc4645e: Status 404 returned error can't find the container with id 01ca89b724c0c8fe09843eae47a1dd9b077ad069fa34d51b9ffc2b299dc4645e Jul 07 14:06:04.144351 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:04.144251 2583 generic.go:356] "Generic (PLEG): container finished" podID="1a329b74-8df1-468a-b52d-382e69a7c7a5" containerID="b007f1d9b92a0a36cc86df171bbea4731acfe8d2fd5e64cf8c8a2324270292c8" exitCode=0 Jul 07 14:06:04.144351 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:04.144317 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" event={"ID":"1a329b74-8df1-468a-b52d-382e69a7c7a5","Type":"ContainerDied","Data":"b007f1d9b92a0a36cc86df171bbea4731acfe8d2fd5e64cf8c8a2324270292c8"} Jul 07 14:06:04.148662 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:04.148634 2583 generic.go:356] "Generic (PLEG): container finished" podID="38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" containerID="a0d33d0378704404dd16c9eb26e31e3c3afb0759290b7b4665ed773b081e8c36" exitCode=0 Jul 07 14:06:04.148754 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:04.148691 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" event={"ID":"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f","Type":"ContainerDied","Data":"a0d33d0378704404dd16c9eb26e31e3c3afb0759290b7b4665ed773b081e8c36"} Jul 07 14:06:04.150712 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:04.150691 2583 generic.go:356] "Generic (PLEG): container finished" podID="0294c0eb-0a33-44dc-81d9-47a8c4976ad4" containerID="20deb58f6e09a707cce031e054e9f8d4414e5813e358c3c7144065c23abc155f" exitCode=0 Jul 07 14:06:04.150798 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:04.150764 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" event={"ID":"0294c0eb-0a33-44dc-81d9-47a8c4976ad4","Type":"ContainerDied","Data":"20deb58f6e09a707cce031e054e9f8d4414e5813e358c3c7144065c23abc155f"} Jul 07 14:06:04.152926 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:04.152846 2583 generic.go:356] "Generic (PLEG): container finished" podID="8c94ed17-05a2-402b-b8f3-f1f629a41431" containerID="d6325a70f35a053247883d633e8ae620de33b383b07dd9de7bee94a653fd4a28" exitCode=0 Jul 07 14:06:04.152926 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:04.152921 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" event={"ID":"8c94ed17-05a2-402b-b8f3-f1f629a41431","Type":"ContainerDied","Data":"d6325a70f35a053247883d633e8ae620de33b383b07dd9de7bee94a653fd4a28"} Jul 07 14:06:04.153017 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:04.152948 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" event={"ID":"8c94ed17-05a2-402b-b8f3-f1f629a41431","Type":"ContainerStarted","Data":"01ca89b724c0c8fe09843eae47a1dd9b077ad069fa34d51b9ffc2b299dc4645e"} Jul 07 14:06:05.160425 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:05.160385 2583 generic.go:356] "Generic (PLEG): container finished" podID="1a329b74-8df1-468a-b52d-382e69a7c7a5" containerID="a73a0a747e291ff49daf7335cbc4be346b539996c359a77bdf8742f1b7594a5e" exitCode=0 Jul 07 14:06:05.160857 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:05.160460 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" event={"ID":"1a329b74-8df1-468a-b52d-382e69a7c7a5","Type":"ContainerDied","Data":"a73a0a747e291ff49daf7335cbc4be346b539996c359a77bdf8742f1b7594a5e"} Jul 07 14:06:05.162792 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:05.162765 2583 generic.go:356] "Generic (PLEG): container finished" podID="38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" containerID="497c6068702d46cda3cb7027669e8591b2f41bfc7032ffe7d5a5142ebb685dbb" exitCode=0 Jul 07 14:06:05.162877 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:05.162820 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" event={"ID":"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f","Type":"ContainerDied","Data":"497c6068702d46cda3cb7027669e8591b2f41bfc7032ffe7d5a5142ebb685dbb"} Jul 07 14:06:05.165071 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:05.165051 2583 generic.go:356] "Generic (PLEG): container finished" podID="0294c0eb-0a33-44dc-81d9-47a8c4976ad4" containerID="6e24c523f602b7d417858874e63f42e72a79fbf3938accb710151dcdce91fa7c" exitCode=0 Jul 07 14:06:05.165194 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:05.165124 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" event={"ID":"0294c0eb-0a33-44dc-81d9-47a8c4976ad4","Type":"ContainerDied","Data":"6e24c523f602b7d417858874e63f42e72a79fbf3938accb710151dcdce91fa7c"} Jul 07 14:06:05.166901 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:05.166881 2583 generic.go:356] "Generic (PLEG): container finished" podID="8c94ed17-05a2-402b-b8f3-f1f629a41431" containerID="0a29e144593ee3e68ff1bdf60e2cdf45bbb262df24909e94d2bc4d9bdbaf171b" exitCode=0 Jul 07 14:06:05.167003 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:05.166957 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" event={"ID":"8c94ed17-05a2-402b-b8f3-f1f629a41431","Type":"ContainerDied","Data":"0a29e144593ee3e68ff1bdf60e2cdf45bbb262df24909e94d2bc4d9bdbaf171b"} Jul 07 14:06:06.173525 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.173493 2583 generic.go:356] "Generic (PLEG): container finished" podID="1a329b74-8df1-468a-b52d-382e69a7c7a5" containerID="a747f77bf16eabe9f1c551243bea0074c0be554a1c3995d08b22da469b531b45" exitCode=0 Jul 07 14:06:06.173936 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.173584 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" event={"ID":"1a329b74-8df1-468a-b52d-382e69a7c7a5","Type":"ContainerDied","Data":"a747f77bf16eabe9f1c551243bea0074c0be554a1c3995d08b22da469b531b45"} Jul 07 14:06:06.175589 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.175563 2583 generic.go:356] "Generic (PLEG): container finished" podID="8c94ed17-05a2-402b-b8f3-f1f629a41431" containerID="1d094ab009aede8e4a050e70c756dd9d3920fc3eb230213786c21a8aa6c80ab1" exitCode=0 Jul 07 14:06:06.175715 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.175627 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" event={"ID":"8c94ed17-05a2-402b-b8f3-f1f629a41431","Type":"ContainerDied","Data":"1d094ab009aede8e4a050e70c756dd9d3920fc3eb230213786c21a8aa6c80ab1"} Jul 07 14:06:06.326475 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.326452 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:06.331035 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.331012 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:06.424325 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.424300 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-bundle\") pod \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\" (UID: \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\") " Jul 07 14:06:06.424502 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.424344 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-bundle\") pod \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\" (UID: \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\") " Jul 07 14:06:06.424502 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.424370 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-util\") pod \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\" (UID: \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\") " Jul 07 14:06:06.424502 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.424388 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kngv\" (UniqueName: \"kubernetes.io/projected/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-kube-api-access-7kngv\") pod \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\" (UID: \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\") " Jul 07 14:06:06.424502 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.424431 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mvss\" (UniqueName: \"kubernetes.io/projected/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-kube-api-access-2mvss\") pod \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\" (UID: \"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f\") " Jul 07 14:06:06.424502 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.424459 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-util\") pod \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\" (UID: \"0294c0eb-0a33-44dc-81d9-47a8c4976ad4\") " Jul 07 14:06:06.424891 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.424861 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-bundle" (OuterVolumeSpecName: "bundle") pod "0294c0eb-0a33-44dc-81d9-47a8c4976ad4" (UID: "0294c0eb-0a33-44dc-81d9-47a8c4976ad4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:06:06.425565 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.425031 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-bundle" (OuterVolumeSpecName: "bundle") pod "38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" (UID: "38bfcd7a-f724-419e-8e3b-67cf2eb3b11f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:06:06.427129 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.427089 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-kube-api-access-2mvss" (OuterVolumeSpecName: "kube-api-access-2mvss") pod "38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" (UID: "38bfcd7a-f724-419e-8e3b-67cf2eb3b11f"). InnerVolumeSpecName "kube-api-access-2mvss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:06:06.427247 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.427155 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-kube-api-access-7kngv" (OuterVolumeSpecName: "kube-api-access-7kngv") pod "0294c0eb-0a33-44dc-81d9-47a8c4976ad4" (UID: "0294c0eb-0a33-44dc-81d9-47a8c4976ad4"). InnerVolumeSpecName "kube-api-access-7kngv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:06:06.430782 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.430759 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-util" (OuterVolumeSpecName: "util") pod "0294c0eb-0a33-44dc-81d9-47a8c4976ad4" (UID: "0294c0eb-0a33-44dc-81d9-47a8c4976ad4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:06:06.431833 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.431810 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-util" (OuterVolumeSpecName: "util") pod "38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" (UID: "38bfcd7a-f724-419e-8e3b-67cf2eb3b11f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:06:06.525143 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.525105 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-bundle\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:06.525143 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.525141 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-bundle\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:06.525143 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.525152 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-util\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:06.525418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.525164 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kngv\" (UniqueName: \"kubernetes.io/projected/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-kube-api-access-7kngv\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:06.525418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.525177 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mvss\" (UniqueName: \"kubernetes.io/projected/38bfcd7a-f724-419e-8e3b-67cf2eb3b11f-kube-api-access-2mvss\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:06.525418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:06.525189 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0294c0eb-0a33-44dc-81d9-47a8c4976ad4-util\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:07.182366 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.182337 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" Jul 07 14:06:07.182764 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.182336 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8" event={"ID":"38bfcd7a-f724-419e-8e3b-67cf2eb3b11f","Type":"ContainerDied","Data":"6c573b346057205f7a7ba70b8f7cb3b91231ce8d6dad056bb79bb789cadc406f"} Jul 07 14:06:07.182764 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.182455 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c573b346057205f7a7ba70b8f7cb3b91231ce8d6dad056bb79bb789cadc406f" Jul 07 14:06:07.184210 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.184182 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" Jul 07 14:06:07.184334 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.184252 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts" event={"ID":"0294c0eb-0a33-44dc-81d9-47a8c4976ad4","Type":"ContainerDied","Data":"741871e1f8eba02eb01b0663c2b31a44d30a0da2a2d9cb250d7ffdf562ac6f8c"} Jul 07 14:06:07.184334 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.184294 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="741871e1f8eba02eb01b0663c2b31a44d30a0da2a2d9cb250d7ffdf562ac6f8c" Jul 07 14:06:07.336776 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.336753 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:07.338611 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.338589 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:07.434607 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.434513 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpjkz\" (UniqueName: \"kubernetes.io/projected/1a329b74-8df1-468a-b52d-382e69a7c7a5-kube-api-access-gpjkz\") pod \"1a329b74-8df1-468a-b52d-382e69a7c7a5\" (UID: \"1a329b74-8df1-468a-b52d-382e69a7c7a5\") " Jul 07 14:06:07.434607 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.434596 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a329b74-8df1-468a-b52d-382e69a7c7a5-bundle\") pod \"1a329b74-8df1-468a-b52d-382e69a7c7a5\" (UID: \"1a329b74-8df1-468a-b52d-382e69a7c7a5\") " Jul 07 14:06:07.434825 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.434691 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9chz\" (UniqueName: \"kubernetes.io/projected/8c94ed17-05a2-402b-b8f3-f1f629a41431-kube-api-access-m9chz\") pod \"8c94ed17-05a2-402b-b8f3-f1f629a41431\" (UID: \"8c94ed17-05a2-402b-b8f3-f1f629a41431\") " Jul 07 14:06:07.434825 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.434740 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c94ed17-05a2-402b-b8f3-f1f629a41431-bundle\") pod \"8c94ed17-05a2-402b-b8f3-f1f629a41431\" (UID: \"8c94ed17-05a2-402b-b8f3-f1f629a41431\") " Jul 07 14:06:07.434825 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.434773 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a329b74-8df1-468a-b52d-382e69a7c7a5-util\") pod \"1a329b74-8df1-468a-b52d-382e69a7c7a5\" (UID: \"1a329b74-8df1-468a-b52d-382e69a7c7a5\") " Jul 07 14:06:07.434825 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.434815 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c94ed17-05a2-402b-b8f3-f1f629a41431-util\") pod \"8c94ed17-05a2-402b-b8f3-f1f629a41431\" (UID: \"8c94ed17-05a2-402b-b8f3-f1f629a41431\") " Jul 07 14:06:07.435207 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.435180 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a329b74-8df1-468a-b52d-382e69a7c7a5-bundle" (OuterVolumeSpecName: "bundle") pod "1a329b74-8df1-468a-b52d-382e69a7c7a5" (UID: "1a329b74-8df1-468a-b52d-382e69a7c7a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:06:07.435474 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.435455 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c94ed17-05a2-402b-b8f3-f1f629a41431-bundle" (OuterVolumeSpecName: "bundle") pod "8c94ed17-05a2-402b-b8f3-f1f629a41431" (UID: "8c94ed17-05a2-402b-b8f3-f1f629a41431"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:06:07.437309 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.437280 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c94ed17-05a2-402b-b8f3-f1f629a41431-kube-api-access-m9chz" (OuterVolumeSpecName: "kube-api-access-m9chz") pod "8c94ed17-05a2-402b-b8f3-f1f629a41431" (UID: "8c94ed17-05a2-402b-b8f3-f1f629a41431"). InnerVolumeSpecName "kube-api-access-m9chz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:06:07.437309 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.437292 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a329b74-8df1-468a-b52d-382e69a7c7a5-kube-api-access-gpjkz" (OuterVolumeSpecName: "kube-api-access-gpjkz") pod "1a329b74-8df1-468a-b52d-382e69a7c7a5" (UID: "1a329b74-8df1-468a-b52d-382e69a7c7a5"). InnerVolumeSpecName "kube-api-access-gpjkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:06:07.440764 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.440736 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a329b74-8df1-468a-b52d-382e69a7c7a5-util" (OuterVolumeSpecName: "util") pod "1a329b74-8df1-468a-b52d-382e69a7c7a5" (UID: "1a329b74-8df1-468a-b52d-382e69a7c7a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:06:07.441007 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.440986 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c94ed17-05a2-402b-b8f3-f1f629a41431-util" (OuterVolumeSpecName: "util") pod "8c94ed17-05a2-402b-b8f3-f1f629a41431" (UID: "8c94ed17-05a2-402b-b8f3-f1f629a41431"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:06:07.535998 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.535950 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c94ed17-05a2-402b-b8f3-f1f629a41431-util\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:07.535998 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.535995 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpjkz\" (UniqueName: \"kubernetes.io/projected/1a329b74-8df1-468a-b52d-382e69a7c7a5-kube-api-access-gpjkz\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:07.535998 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.536010 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a329b74-8df1-468a-b52d-382e69a7c7a5-bundle\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:07.536267 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.536025 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9chz\" (UniqueName: \"kubernetes.io/projected/8c94ed17-05a2-402b-b8f3-f1f629a41431-kube-api-access-m9chz\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:07.536267 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.536037 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c94ed17-05a2-402b-b8f3-f1f629a41431-bundle\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:07.536267 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:07.536049 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a329b74-8df1-468a-b52d-382e69a7c7a5-util\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:08.191216 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:08.191187 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" Jul 07 14:06:08.191216 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:08.191211 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l" event={"ID":"8c94ed17-05a2-402b-b8f3-f1f629a41431","Type":"ContainerDied","Data":"01ca89b724c0c8fe09843eae47a1dd9b077ad069fa34d51b9ffc2b299dc4645e"} Jul 07 14:06:08.191660 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:08.191277 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01ca89b724c0c8fe09843eae47a1dd9b077ad069fa34d51b9ffc2b299dc4645e" Jul 07 14:06:08.193102 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:08.193079 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" event={"ID":"1a329b74-8df1-468a-b52d-382e69a7c7a5","Type":"ContainerDied","Data":"b28d565a9b5f969dec7ad3fd859941fd14da7acb407822da7321980da42e7c92"} Jul 07 14:06:08.193241 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:08.193105 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq" Jul 07 14:06:08.193241 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:08.193113 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b28d565a9b5f969dec7ad3fd859941fd14da7acb407822da7321980da42e7c92" Jul 07 14:06:11.921673 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:11.921634 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9f68bcc99-7xtpg" podUID="6575940e-e5e5-4227-b993-fb4c3e458f99" containerName="console" containerID="cri-o://5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9" gracePeriod=15 Jul 07 14:06:12.167727 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.167687 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:06:12.213288 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.213183 2583 generic.go:356] "Generic (PLEG): container finished" podID="6575940e-e5e5-4227-b993-fb4c3e458f99" containerID="5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9" exitCode=0 Jul 07 14:06:12.213288 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.213244 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f68bcc99-7xtpg" Jul 07 14:06:12.213288 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.213265 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f68bcc99-7xtpg" event={"ID":"6575940e-e5e5-4227-b993-fb4c3e458f99","Type":"ContainerDied","Data":"5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9"} Jul 07 14:06:12.213498 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.213355 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f68bcc99-7xtpg" event={"ID":"6575940e-e5e5-4227-b993-fb4c3e458f99","Type":"ContainerDied","Data":"dca2ac922a72bc3eb274bc8942f35b3a3247e53caf54ed9713832d82d03245b7"} Jul 07 14:06:12.213498 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.213378 2583 scope.go:117] "RemoveContainer" containerID="5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9" Jul 07 14:06:12.221560 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.221542 2583 scope.go:117] "RemoveContainer" containerID="5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9" Jul 07 14:06:12.221822 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:06:12.221806 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9\": container with ID starting with 5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9 not found: ID does not exist" containerID="5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9" Jul 07 14:06:12.221859 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.221831 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9"} err="failed to get container status \"5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9\": rpc error: code = NotFound desc = could not find container \"5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9\": container with ID starting with 5ba7cbbcd7ad73aa7d3d30ad2713fbbbdc1efc4c822a532cd8c50f2968c966a9 not found: ID does not exist" Jul 07 14:06:12.284350 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.284310 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9hbk\" (UniqueName: \"kubernetes.io/projected/6575940e-e5e5-4227-b993-fb4c3e458f99-kube-api-access-f9hbk\") pod \"6575940e-e5e5-4227-b993-fb4c3e458f99\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " Jul 07 14:06:12.284350 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.284352 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-service-ca\") pod \"6575940e-e5e5-4227-b993-fb4c3e458f99\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " Jul 07 14:06:12.284545 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.284442 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-oauth-serving-cert\") pod \"6575940e-e5e5-4227-b993-fb4c3e458f99\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " Jul 07 14:06:12.284545 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.284493 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6575940e-e5e5-4227-b993-fb4c3e458f99-console-serving-cert\") pod \"6575940e-e5e5-4227-b993-fb4c3e458f99\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " Jul 07 14:06:12.284545 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.284520 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6575940e-e5e5-4227-b993-fb4c3e458f99-console-oauth-config\") pod \"6575940e-e5e5-4227-b993-fb4c3e458f99\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " Jul 07 14:06:12.284753 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.284545 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-console-config\") pod \"6575940e-e5e5-4227-b993-fb4c3e458f99\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " Jul 07 14:06:12.284753 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.284615 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-trusted-ca-bundle\") pod \"6575940e-e5e5-4227-b993-fb4c3e458f99\" (UID: \"6575940e-e5e5-4227-b993-fb4c3e458f99\") " Jul 07 14:06:12.284957 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.284925 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6575940e-e5e5-4227-b993-fb4c3e458f99" (UID: "6575940e-e5e5-4227-b993-fb4c3e458f99"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:06:12.284957 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.284944 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-service-ca" (OuterVolumeSpecName: "service-ca") pod "6575940e-e5e5-4227-b993-fb4c3e458f99" (UID: "6575940e-e5e5-4227-b993-fb4c3e458f99"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:06:12.285098 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.285074 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-console-config" (OuterVolumeSpecName: "console-config") pod "6575940e-e5e5-4227-b993-fb4c3e458f99" (UID: "6575940e-e5e5-4227-b993-fb4c3e458f99"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:06:12.285134 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.285102 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6575940e-e5e5-4227-b993-fb4c3e458f99" (UID: "6575940e-e5e5-4227-b993-fb4c3e458f99"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:06:12.285369 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.285353 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-console-config\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:12.285423 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.285371 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-trusted-ca-bundle\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:12.285423 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.285381 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-service-ca\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:12.285423 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.285390 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6575940e-e5e5-4227-b993-fb4c3e458f99-oauth-serving-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:12.286733 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.286704 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6575940e-e5e5-4227-b993-fb4c3e458f99-kube-api-access-f9hbk" (OuterVolumeSpecName: "kube-api-access-f9hbk") pod "6575940e-e5e5-4227-b993-fb4c3e458f99" (UID: "6575940e-e5e5-4227-b993-fb4c3e458f99"). InnerVolumeSpecName "kube-api-access-f9hbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:06:12.286990 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.286967 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6575940e-e5e5-4227-b993-fb4c3e458f99-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6575940e-e5e5-4227-b993-fb4c3e458f99" (UID: "6575940e-e5e5-4227-b993-fb4c3e458f99"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:06:12.287045 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.286995 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6575940e-e5e5-4227-b993-fb4c3e458f99-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6575940e-e5e5-4227-b993-fb4c3e458f99" (UID: "6575940e-e5e5-4227-b993-fb4c3e458f99"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:06:12.386271 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.386205 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6575940e-e5e5-4227-b993-fb4c3e458f99-console-serving-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:12.386271 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.386261 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6575940e-e5e5-4227-b993-fb4c3e458f99-console-oauth-config\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:12.386271 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.386275 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9hbk\" (UniqueName: \"kubernetes.io/projected/6575940e-e5e5-4227-b993-fb4c3e458f99-kube-api-access-f9hbk\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:06:12.530447 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.530411 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9f68bcc99-7xtpg"] Jul 07 14:06:12.534477 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:12.534445 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9f68bcc99-7xtpg"] Jul 07 14:06:14.426307 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:06:14.426272 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6575940e-e5e5-4227-b993-fb4c3e458f99" path="/var/lib/kubelet/pods/6575940e-e5e5-4227-b993-fb4c3e458f99/volumes" Jul 07 14:07:16.607298 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607214 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607521 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" containerName="util" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607531 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" containerName="util" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607541 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0294c0eb-0a33-44dc-81d9-47a8c4976ad4" containerName="util" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607548 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0294c0eb-0a33-44dc-81d9-47a8c4976ad4" containerName="util" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607555 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a329b74-8df1-468a-b52d-382e69a7c7a5" containerName="util" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607560 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a329b74-8df1-468a-b52d-382e69a7c7a5" containerName="util" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607570 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c94ed17-05a2-402b-b8f3-f1f629a41431" containerName="extract" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607576 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c94ed17-05a2-402b-b8f3-f1f629a41431" containerName="extract" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607583 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c94ed17-05a2-402b-b8f3-f1f629a41431" containerName="pull" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607588 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c94ed17-05a2-402b-b8f3-f1f629a41431" containerName="pull" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607598 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" containerName="pull" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607602 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" containerName="pull" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607608 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a329b74-8df1-468a-b52d-382e69a7c7a5" containerName="pull" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607613 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a329b74-8df1-468a-b52d-382e69a7c7a5" containerName="pull" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607619 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6575940e-e5e5-4227-b993-fb4c3e458f99" containerName="console" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607624 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6575940e-e5e5-4227-b993-fb4c3e458f99" containerName="console" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607633 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0294c0eb-0a33-44dc-81d9-47a8c4976ad4" containerName="pull" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607638 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0294c0eb-0a33-44dc-81d9-47a8c4976ad4" containerName="pull" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607644 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a329b74-8df1-468a-b52d-382e69a7c7a5" containerName="extract" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607648 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a329b74-8df1-468a-b52d-382e69a7c7a5" containerName="extract" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607654 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c94ed17-05a2-402b-b8f3-f1f629a41431" containerName="util" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607659 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c94ed17-05a2-402b-b8f3-f1f629a41431" containerName="util" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607665 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" containerName="extract" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607671 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" containerName="extract" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607677 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0294c0eb-0a33-44dc-81d9-47a8c4976ad4" containerName="extract" Jul 07 14:07:16.607716 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.607682 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0294c0eb-0a33-44dc-81d9-47a8c4976ad4" containerName="extract" Jul 07 14:07:16.608844 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.608277 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6575940e-e5e5-4227-b993-fb4c3e458f99" containerName="console" Jul 07 14:07:16.608844 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.608310 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0294c0eb-0a33-44dc-81d9-47a8c4976ad4" containerName="extract" Jul 07 14:07:16.608844 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.608320 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a329b74-8df1-468a-b52d-382e69a7c7a5" containerName="extract" Jul 07 14:07:16.608844 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.608332 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c94ed17-05a2-402b-b8f3-f1f629a41431" containerName="extract" Jul 07 14:07:16.608844 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.608350 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="38bfcd7a-f724-419e-8e3b-67cf2eb3b11f" containerName="extract" Jul 07 14:07:16.614210 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.614182 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" Jul 07 14:07:16.617594 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.617569 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 14:07:16.617701 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.617580 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fzwnx\"" Jul 07 14:07:16.618706 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.618675 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 14:07:16.618823 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.618705 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 14:07:16.623473 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.623453 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:07:16.661545 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.661523 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:07:16.720937 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.720911 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e70ba20b-e21c-4aa5-ac37-355e71712ca7-config-file\") pod \"limitador-limitador-54d6d988d5-wd22v\" (UID: \"e70ba20b-e21c-4aa5-ac37-355e71712ca7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" Jul 07 14:07:16.721051 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.720967 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzhk9\" (UniqueName: \"kubernetes.io/projected/e70ba20b-e21c-4aa5-ac37-355e71712ca7-kube-api-access-pzhk9\") pod \"limitador-limitador-54d6d988d5-wd22v\" (UID: \"e70ba20b-e21c-4aa5-ac37-355e71712ca7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" Jul 07 14:07:16.821662 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.821632 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e70ba20b-e21c-4aa5-ac37-355e71712ca7-config-file\") pod \"limitador-limitador-54d6d988d5-wd22v\" (UID: \"e70ba20b-e21c-4aa5-ac37-355e71712ca7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" Jul 07 14:07:16.821817 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.821686 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzhk9\" (UniqueName: \"kubernetes.io/projected/e70ba20b-e21c-4aa5-ac37-355e71712ca7-kube-api-access-pzhk9\") pod \"limitador-limitador-54d6d988d5-wd22v\" (UID: \"e70ba20b-e21c-4aa5-ac37-355e71712ca7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" Jul 07 14:07:16.822277 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.822258 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e70ba20b-e21c-4aa5-ac37-355e71712ca7-config-file\") pod \"limitador-limitador-54d6d988d5-wd22v\" (UID: \"e70ba20b-e21c-4aa5-ac37-355e71712ca7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" Jul 07 14:07:16.834266 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.834239 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzhk9\" (UniqueName: \"kubernetes.io/projected/e70ba20b-e21c-4aa5-ac37-355e71712ca7-kube-api-access-pzhk9\") pod \"limitador-limitador-54d6d988d5-wd22v\" (UID: \"e70ba20b-e21c-4aa5-ac37-355e71712ca7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" Jul 07 14:07:16.926470 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:16.926384 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" Jul 07 14:07:17.058538 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:17.058510 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:07:17.060277 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:07:17.060248 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70ba20b_e21c_4aa5_ac37_355e71712ca7.slice/crio-0792c18515be3de2d1d9ec9d313c71ef482044d8fe8978ac11197d74c451c2c6 WatchSource:0}: Error finding container 0792c18515be3de2d1d9ec9d313c71ef482044d8fe8978ac11197d74c451c2c6: Status 404 returned error can't find the container with id 0792c18515be3de2d1d9ec9d313c71ef482044d8fe8978ac11197d74c451c2c6 Jul 07 14:07:17.523730 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:17.523696 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" event={"ID":"e70ba20b-e21c-4aa5-ac37-355e71712ca7","Type":"ContainerStarted","Data":"0792c18515be3de2d1d9ec9d313c71ef482044d8fe8978ac11197d74c451c2c6"} Jul 07 14:07:20.542094 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:20.542051 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" event={"ID":"e70ba20b-e21c-4aa5-ac37-355e71712ca7","Type":"ContainerStarted","Data":"429864381f1c70378c27f56352ee7e17e17812aa12d0683cdf85468354ba137c"} Jul 07 14:07:20.542571 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:20.542130 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" Jul 07 14:07:20.563116 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:20.563068 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" podStartSLOduration=1.641413778 podStartE2EDuration="4.563054169s" totalImagesPullingTime="2.921640391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:20.560710171 +0000 UTC m=+472.734497756" watchObservedRunningTime="2026-07-07 14:07:20.563054169 +0000 UTC m=+472.736841742" Jul 07 14:07:31.549218 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:07:31.549188 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wd22v" Jul 07 14:08:32.277390 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:08:32.277317 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:09:05.395880 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:09:05.395847 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:09:08.800264 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:09:08.800220 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:09:29.396155 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:09:29.396116 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:09:56.431359 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:09:56.431284 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:10:00.619768 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.619738 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs"] Jul 07 14:10:00.623027 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.623009 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.628367 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.628348 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fx6bc\"" Jul 07 14:10:00.628523 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.628349 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 07 14:10:00.628654 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.628638 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 14:10:00.628821 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.628803 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 14:10:00.635147 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.635124 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs"] Jul 07 14:10:00.723693 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.723668 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aa184cb-5e10-430a-8287-f599ef31bb11-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.723842 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.723706 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8aa184cb-5e10-430a-8287-f599ef31bb11-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.723842 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.723785 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpbmb\" (UniqueName: \"kubernetes.io/projected/8aa184cb-5e10-430a-8287-f599ef31bb11-kube-api-access-wpbmb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.723842 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.723809 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8aa184cb-5e10-430a-8287-f599ef31bb11-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.723842 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.723836 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8aa184cb-5e10-430a-8287-f599ef31bb11-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.723980 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.723852 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8aa184cb-5e10-430a-8287-f599ef31bb11-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.824165 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.824134 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aa184cb-5e10-430a-8287-f599ef31bb11-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.824344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.824171 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8aa184cb-5e10-430a-8287-f599ef31bb11-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.824344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.824219 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpbmb\" (UniqueName: \"kubernetes.io/projected/8aa184cb-5e10-430a-8287-f599ef31bb11-kube-api-access-wpbmb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.824344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.824261 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8aa184cb-5e10-430a-8287-f599ef31bb11-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.824344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.824277 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8aa184cb-5e10-430a-8287-f599ef31bb11-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.824344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.824291 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8aa184cb-5e10-430a-8287-f599ef31bb11-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.824611 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.824596 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aa184cb-5e10-430a-8287-f599ef31bb11-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.824655 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.824619 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8aa184cb-5e10-430a-8287-f599ef31bb11-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.824702 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.824684 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8aa184cb-5e10-430a-8287-f599ef31bb11-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.826416 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.826399 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8aa184cb-5e10-430a-8287-f599ef31bb11-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.826708 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.826692 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8aa184cb-5e10-430a-8287-f599ef31bb11-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.843189 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.843166 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpbmb\" (UniqueName: \"kubernetes.io/projected/8aa184cb-5e10-430a-8287-f599ef31bb11-kube-api-access-wpbmb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j76bs\" (UID: \"8aa184cb-5e10-430a-8287-f599ef31bb11\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:00.932553 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:00.932484 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:01.060737 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:01.060712 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs"] Jul 07 14:10:01.062355 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:10:01.062335 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa184cb_5e10_430a_8287_f599ef31bb11.slice/crio-8110f1dcc6e71c5770d7cc9e506e03531e8143964ed1916c02d18b621d0ea37d WatchSource:0}: Error finding container 8110f1dcc6e71c5770d7cc9e506e03531e8143964ed1916c02d18b621d0ea37d: Status 404 returned error can't find the container with id 8110f1dcc6e71c5770d7cc9e506e03531e8143964ed1916c02d18b621d0ea37d Jul 07 14:10:01.063656 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:01.063636 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:10:01.300410 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:01.300377 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" event={"ID":"8aa184cb-5e10-430a-8287-f599ef31bb11","Type":"ContainerStarted","Data":"8110f1dcc6e71c5770d7cc9e506e03531e8143964ed1916c02d18b621d0ea37d"} Jul 07 14:10:02.126866 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:02.126831 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:10:03.310813 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:03.310779 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" event={"ID":"8aa184cb-5e10-430a-8287-f599ef31bb11","Type":"ContainerStarted","Data":"806681c836d04537d05f9ce716d55afc637c94ade1023f897073562bfe73a00a"} Jul 07 14:10:03.340775 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:03.340720 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" podStartSLOduration=2.105882735 podStartE2EDuration="3.340704861s" totalImagesPullingTime="1.234822126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:03.339875478 +0000 UTC m=+635.513663052" watchObservedRunningTime="2026-07-07 14:10:03.340704861 +0000 UTC m=+635.514492413" Jul 07 14:10:10.933493 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:10.933459 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:10.933879 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:10.933523 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:10.945635 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:10.945611 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:11.358039 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:11.358003 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j76bs" Jul 07 14:10:22.365588 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:10:22.365556 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:12:10.805023 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:12:10.804991 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:12:20.199042 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:12:20.198999 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:12:30.687386 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:12:30.687346 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:12:40.997561 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:12:40.997525 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:12:51.896446 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:12:51.896356 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:13:16.905538 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:13:16.905504 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:13:28.693668 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:13:28.693625 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:14:02.591007 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:14:02.590957 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:14:09.699205 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:14:09.699175 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:14:18.998735 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:14:18.998693 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:14:26.191632 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:14:26.191589 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:14:36.898808 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:14:36.898766 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:14:46.797192 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:14:46.797156 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:14:57.894840 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:14:57.894801 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:15:07.898216 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:15:07.898177 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:15:30.098586 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:15:30.098550 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:15:39.295783 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:15:39.295744 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:16:02.494436 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:16:02.494345 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:16:15.415684 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:16:15.415648 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:16:30.903084 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:16:30.903045 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:16:39.803826 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:16:39.803786 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:16:49.403539 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:16:49.403500 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:16:59.211400 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:16:59.211362 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:17:07.701317 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:17:07.701281 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:18:57.729394 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:18:57.729317 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:19:06.401081 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:19:06.401041 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:19:19.099656 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:19:19.099616 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:19:30.505114 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:19:30.505076 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:19:43.299107 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:19:43.299073 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:19:52.000747 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:19:52.000708 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:20:01.797096 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:20:01.797055 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:20:14.411034 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:20:14.410991 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:20:23.718521 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:20:23.718424 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:20:32.301168 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:20:32.301138 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:20:42.700105 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:20:42.700069 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:21:05.024447 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:21:05.024409 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:21:14.908366 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:21:14.908329 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:21:25.799696 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:21:25.799662 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:21:35.101541 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:21:35.101504 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:21:41.525473 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:21:41.525436 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:21:57.705699 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:21:57.705623 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:22:07.101595 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:22:07.101559 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:22:16.396812 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:22:16.396775 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:22:26.300313 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:22:26.300277 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:22:36.523738 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:22:36.523703 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:22:46.100096 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:22:46.100056 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:22:59.005627 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:22:59.005590 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:23:12.693319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:23:12.693281 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:23:22.095950 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:23:22.095877 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:23:28.691859 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:23:28.691823 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:23:38.195119 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:23:38.195080 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:23:44.602041 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:23:44.602004 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:23:58.998977 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:23:58.998942 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:24:12.194695 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:12.194659 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:24:24.296574 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:24.296529 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:24:36.894712 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:36.894671 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c"] Jul 07 14:24:36.898273 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:36.898254 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:36.901991 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:36.901974 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a5687120-openshift-default-dockercfg-492cc\"" Jul 07 14:24:36.934844 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:36.934816 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c"] Jul 07 14:24:37.002002 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.001975 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-workload-socket\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.002002 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.002003 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w5mk\" (UniqueName: \"kubernetes.io/projected/98e81e82-7230-4e62-9d83-8fb023b79911-kube-api-access-6w5mk\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.002165 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.002024 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-credential-socket\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.002165 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.002053 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-workload-certs\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.002165 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.002100 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98e81e82-7230-4e62-9d83-8fb023b79911-istiod-ca-cert\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.002165 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.002136 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98e81e82-7230-4e62-9d83-8fb023b79911-istio-token\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.002165 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.002163 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-istio-envoy\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.002425 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.002190 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-istio-data\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.002425 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.002272 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98e81e82-7230-4e62-9d83-8fb023b79911-istio-podinfo\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.103467 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.103419 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98e81e82-7230-4e62-9d83-8fb023b79911-istio-podinfo\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.103467 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.103482 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-workload-socket\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.103713 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.103503 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5mk\" (UniqueName: \"kubernetes.io/projected/98e81e82-7230-4e62-9d83-8fb023b79911-kube-api-access-6w5mk\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.103713 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.103525 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-credential-socket\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.103713 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.103540 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-workload-certs\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.103713 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.103563 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98e81e82-7230-4e62-9d83-8fb023b79911-istiod-ca-cert\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.103713 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.103618 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98e81e82-7230-4e62-9d83-8fb023b79911-istio-token\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.103966 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.103802 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-istio-envoy\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.103966 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.103861 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-istio-data\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.103966 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.103896 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-workload-socket\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.103966 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.103928 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-workload-certs\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.104088 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.104025 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-credential-socket\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.104276 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.104246 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-istio-data\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.104483 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.104461 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98e81e82-7230-4e62-9d83-8fb023b79911-istiod-ca-cert\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.105899 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.105883 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-istio-envoy\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.106004 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.105988 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98e81e82-7230-4e62-9d83-8fb023b79911-istio-podinfo\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.112687 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.112662 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98e81e82-7230-4e62-9d83-8fb023b79911-istio-token\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.112808 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.112790 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w5mk\" (UniqueName: \"kubernetes.io/projected/98e81e82-7230-4e62-9d83-8fb023b79911-kube-api-access-6w5mk\") pod \"e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.208079 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.208010 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:37.346029 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.346001 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c"] Jul 07 14:24:37.347574 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:24:37.347549 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e81e82_7230_4e62_9d83_8fb023b79911.slice/crio-b4898fcbc9719e11bd67462335635cd84e972e0bcc08daab4204d6255d74176e WatchSource:0}: Error finding container b4898fcbc9719e11bd67462335635cd84e972e0bcc08daab4204d6255d74176e: Status 404 returned error can't find the container with id b4898fcbc9719e11bd67462335635cd84e972e0bcc08daab4204d6255d74176e Jul 07 14:24:37.349893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.349856 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:24:37.350016 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.349926 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:24:37.350016 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.349970 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:24:37.553729 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.553696 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" event={"ID":"98e81e82-7230-4e62-9d83-8fb023b79911","Type":"ContainerStarted","Data":"e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6"} Jul 07 14:24:37.553904 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.553751 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" event={"ID":"98e81e82-7230-4e62-9d83-8fb023b79911","Type":"ContainerStarted","Data":"b4898fcbc9719e11bd67462335635cd84e972e0bcc08daab4204d6255d74176e"} Jul 07 14:24:37.579562 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:37.579501 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" podStartSLOduration=1.579481279 podStartE2EDuration="1.579481279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:37.576622067 +0000 UTC m=+1509.750409653" watchObservedRunningTime="2026-07-07 14:24:37.579481279 +0000 UTC m=+1509.753268855" Jul 07 14:24:38.208315 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:38.208282 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:38.209661 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:38.209634 2583 patch_prober.go:28] interesting pod/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 07 14:24:38.209776 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:38.209683 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" podUID="98e81e82-7230-4e62-9d83-8fb023b79911" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 07 14:24:39.212801 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:39.212772 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:39.564366 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:39.564337 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:39.565363 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:39.565346 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:41.192247 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:41.192142 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:24:43.370132 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:43.370004 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c"] Jul 07 14:24:43.371119 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:43.370329 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" podUID="98e81e82-7230-4e62-9d83-8fb023b79911" containerName="istio-proxy" containerID="cri-o://e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6" gracePeriod=30 Jul 07 14:24:48.524218 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.524188 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:48.609018 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.608938 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98e81e82-7230-4e62-9d83-8fb023b79911-istiod-ca-cert\") pod \"98e81e82-7230-4e62-9d83-8fb023b79911\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " Jul 07 14:24:48.609018 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.608971 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-workload-certs\") pod \"98e81e82-7230-4e62-9d83-8fb023b79911\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " Jul 07 14:24:48.609018 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.608988 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98e81e82-7230-4e62-9d83-8fb023b79911-istio-token\") pod \"98e81e82-7230-4e62-9d83-8fb023b79911\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " Jul 07 14:24:48.609018 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.609018 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98e81e82-7230-4e62-9d83-8fb023b79911-istio-podinfo\") pod \"98e81e82-7230-4e62-9d83-8fb023b79911\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " Jul 07 14:24:48.609363 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.609041 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-istio-data\") pod \"98e81e82-7230-4e62-9d83-8fb023b79911\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " Jul 07 14:24:48.609363 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.609072 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-workload-socket\") pod \"98e81e82-7230-4e62-9d83-8fb023b79911\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " Jul 07 14:24:48.609363 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.609095 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6w5mk\" (UniqueName: \"kubernetes.io/projected/98e81e82-7230-4e62-9d83-8fb023b79911-kube-api-access-6w5mk\") pod \"98e81e82-7230-4e62-9d83-8fb023b79911\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " Jul 07 14:24:48.609363 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.609115 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-credential-socket\") pod \"98e81e82-7230-4e62-9d83-8fb023b79911\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " Jul 07 14:24:48.609363 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.609136 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-istio-envoy\") pod \"98e81e82-7230-4e62-9d83-8fb023b79911\" (UID: \"98e81e82-7230-4e62-9d83-8fb023b79911\") " Jul 07 14:24:48.609363 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.609295 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "98e81e82-7230-4e62-9d83-8fb023b79911" (UID: "98e81e82-7230-4e62-9d83-8fb023b79911"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:24:48.609655 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.609468 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-workload-certs\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:24:48.609655 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.609493 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98e81e82-7230-4e62-9d83-8fb023b79911-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "98e81e82-7230-4e62-9d83-8fb023b79911" (UID: "98e81e82-7230-4e62-9d83-8fb023b79911"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:24:48.609751 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.609710 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "98e81e82-7230-4e62-9d83-8fb023b79911" (UID: "98e81e82-7230-4e62-9d83-8fb023b79911"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:24:48.610145 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.610115 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "98e81e82-7230-4e62-9d83-8fb023b79911" (UID: "98e81e82-7230-4e62-9d83-8fb023b79911"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:24:48.610145 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.610130 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-istio-data" (OuterVolumeSpecName: "istio-data") pod "98e81e82-7230-4e62-9d83-8fb023b79911" (UID: "98e81e82-7230-4e62-9d83-8fb023b79911"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:24:48.611809 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.611762 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98e81e82-7230-4e62-9d83-8fb023b79911-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "98e81e82-7230-4e62-9d83-8fb023b79911" (UID: "98e81e82-7230-4e62-9d83-8fb023b79911"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 14:24:48.611908 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.611848 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "98e81e82-7230-4e62-9d83-8fb023b79911" (UID: "98e81e82-7230-4e62-9d83-8fb023b79911"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:24:48.611908 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.611866 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e81e82-7230-4e62-9d83-8fb023b79911-kube-api-access-6w5mk" (OuterVolumeSpecName: "kube-api-access-6w5mk") pod "98e81e82-7230-4e62-9d83-8fb023b79911" (UID: "98e81e82-7230-4e62-9d83-8fb023b79911"). InnerVolumeSpecName "kube-api-access-6w5mk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:24:48.612022 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.611895 2583 generic.go:356] "Generic (PLEG): container finished" podID="98e81e82-7230-4e62-9d83-8fb023b79911" containerID="e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6" exitCode=0 Jul 07 14:24:48.612022 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.611954 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" Jul 07 14:24:48.612022 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.612009 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" event={"ID":"98e81e82-7230-4e62-9d83-8fb023b79911","Type":"ContainerDied","Data":"e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6"} Jul 07 14:24:48.612169 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.612079 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c" event={"ID":"98e81e82-7230-4e62-9d83-8fb023b79911","Type":"ContainerDied","Data":"b4898fcbc9719e11bd67462335635cd84e972e0bcc08daab4204d6255d74176e"} Jul 07 14:24:48.612169 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.612107 2583 scope.go:117] "RemoveContainer" containerID="e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6" Jul 07 14:24:48.612445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.612425 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e81e82-7230-4e62-9d83-8fb023b79911-istio-token" (OuterVolumeSpecName: "istio-token") pod "98e81e82-7230-4e62-9d83-8fb023b79911" (UID: "98e81e82-7230-4e62-9d83-8fb023b79911"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:24:48.628577 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.628558 2583 scope.go:117] "RemoveContainer" containerID="e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6" Jul 07 14:24:48.628865 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:24:48.628844 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6\": container with ID starting with e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6 not found: ID does not exist" containerID="e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6" Jul 07 14:24:48.628910 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.628877 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6"} err="failed to get container status \"e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6\": rpc error: code = NotFound desc = could not find container \"e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6\": container with ID starting with e97b155724eed58b587a9a4594c9d0fc573693f0480fea0dcbb89dbfa965e6b6 not found: ID does not exist" Jul 07 14:24:48.710540 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.710507 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98e81e82-7230-4e62-9d83-8fb023b79911-istiod-ca-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:24:48.710540 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.710532 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98e81e82-7230-4e62-9d83-8fb023b79911-istio-token\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:24:48.710540 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.710542 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98e81e82-7230-4e62-9d83-8fb023b79911-istio-podinfo\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:24:48.710540 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.710550 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-istio-data\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:24:48.710782 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.710560 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-workload-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:24:48.710782 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.710568 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w5mk\" (UniqueName: \"kubernetes.io/projected/98e81e82-7230-4e62-9d83-8fb023b79911-kube-api-access-6w5mk\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:24:48.710782 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.710578 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-credential-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:24:48.710782 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.710585 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98e81e82-7230-4e62-9d83-8fb023b79911-istio-envoy\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:24:48.939407 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.939376 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c"] Jul 07 14:24:48.944868 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:48.944838 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a5687120-openshift-default-74646fd7cf-2mh7c"] Jul 07 14:24:49.600663 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:49.600629 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:24:50.012535 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.012425 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l"] Jul 07 14:24:50.013326 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.013292 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98e81e82-7230-4e62-9d83-8fb023b79911" containerName="istio-proxy" Jul 07 14:24:50.013326 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.013317 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="98e81e82-7230-4e62-9d83-8fb023b79911" containerName="istio-proxy" Jul 07 14:24:50.013501 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.013401 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="98e81e82-7230-4e62-9d83-8fb023b79911" containerName="istio-proxy" Jul 07 14:24:50.016128 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.016111 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.018936 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.018913 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ec5470d4-openshift-default-dockercfg-n7rbw\"" Jul 07 14:24:50.029886 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.029862 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l"] Jul 07 14:24:50.129256 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.128831 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-workload-certs\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.129256 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.128893 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-envoy\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.129256 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.128920 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-token\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.129256 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.128964 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-workload-socket\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.129256 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.129001 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istiod-ca-cert\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.129256 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.129033 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgsdb\" (UniqueName: \"kubernetes.io/projected/5b391f66-7c3e-49c1-b73a-d42e6adf6385-kube-api-access-sgsdb\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.129256 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.129080 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-credential-socket\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.129256 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.129110 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-podinfo\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.129256 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.129139 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-data\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.229681 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.229637 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-credential-socket\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.229681 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.229683 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-podinfo\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.229923 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.229703 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-data\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.229923 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.229730 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-workload-certs\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.229923 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.229756 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-envoy\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.229923 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.229771 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-token\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.229923 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.229802 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-workload-socket\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.229923 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.229829 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istiod-ca-cert\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.229923 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.229865 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgsdb\" (UniqueName: \"kubernetes.io/projected/5b391f66-7c3e-49c1-b73a-d42e6adf6385-kube-api-access-sgsdb\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.230345 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.230128 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-credential-socket\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.230345 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.230183 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-data\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.230445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.230367 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-workload-socket\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.230445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.230396 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-workload-certs\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.230714 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.230695 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istiod-ca-cert\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.232119 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.232095 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-envoy\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.232220 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.232166 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-podinfo\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.238450 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.238427 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgsdb\" (UniqueName: \"kubernetes.io/projected/5b391f66-7c3e-49c1-b73a-d42e6adf6385-kube-api-access-sgsdb\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.238577 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.238559 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-token\") pod \"e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.326778 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.326732 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:50.427566 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.427525 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98e81e82-7230-4e62-9d83-8fb023b79911" path="/var/lib/kubelet/pods/98e81e82-7230-4e62-9d83-8fb023b79911/volumes" Jul 07 14:24:50.461077 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.461054 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l"] Jul 07 14:24:50.462640 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:24:50.462612 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b391f66_7c3e_49c1_b73a_d42e6adf6385.slice/crio-a0bfec3758d12b028a6f5f8e17236bfb0866aa5dd6b2c4f015367f2e8dd6616c WatchSource:0}: Error finding container a0bfec3758d12b028a6f5f8e17236bfb0866aa5dd6b2c4f015367f2e8dd6616c: Status 404 returned error can't find the container with id a0bfec3758d12b028a6f5f8e17236bfb0866aa5dd6b2c4f015367f2e8dd6616c Jul 07 14:24:50.464876 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.464846 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:24:50.464982 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.464920 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:24:50.464982 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.464968 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:24:50.623546 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.623454 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" event={"ID":"5b391f66-7c3e-49c1-b73a-d42e6adf6385","Type":"ContainerStarted","Data":"d04b47f300d11cc14ce1e67ea51be4ea2d071977ae530b4723456777a19c8bd4"} Jul 07 14:24:50.623546 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.623512 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" event={"ID":"5b391f66-7c3e-49c1-b73a-d42e6adf6385","Type":"ContainerStarted","Data":"a0bfec3758d12b028a6f5f8e17236bfb0866aa5dd6b2c4f015367f2e8dd6616c"} Jul 07 14:24:50.647217 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:50.647166 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" podStartSLOduration=1.64714953 podStartE2EDuration="1.64714953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:50.645034249 +0000 UTC m=+1522.818821824" watchObservedRunningTime="2026-07-07 14:24:50.64714953 +0000 UTC m=+1522.820937105" Jul 07 14:24:51.327704 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:51.327671 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:51.332271 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:51.332245 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:51.628278 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:51.628184 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:24:51.629204 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:24:51.629185 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:25:02.479535 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:02.479472 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l"] Jul 07 14:25:02.479993 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:02.479702 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" podUID="5b391f66-7c3e-49c1-b73a-d42e6adf6385" containerName="istio-proxy" containerID="cri-o://d04b47f300d11cc14ce1e67ea51be4ea2d071977ae530b4723456777a19c8bd4" gracePeriod=30 Jul 07 14:25:06.630784 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:06.630750 2583 patch_prober.go:28] interesting pod/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 14:25:06.631123 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:06.630813 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" podUID="5b391f66-7c3e-49c1-b73a-d42e6adf6385" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:25:07.708673 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.708608 2583 generic.go:356] "Generic (PLEG): container finished" podID="5b391f66-7c3e-49c1-b73a-d42e6adf6385" containerID="d04b47f300d11cc14ce1e67ea51be4ea2d071977ae530b4723456777a19c8bd4" exitCode=0 Jul 07 14:25:07.709001 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.708674 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" event={"ID":"5b391f66-7c3e-49c1-b73a-d42e6adf6385","Type":"ContainerDied","Data":"d04b47f300d11cc14ce1e67ea51be4ea2d071977ae530b4723456777a19c8bd4"} Jul 07 14:25:07.726250 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.726207 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:25:07.879964 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.879932 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-envoy\") pod \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " Jul 07 14:25:07.880122 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.879987 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-token\") pod \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " Jul 07 14:25:07.880122 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880007 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-data\") pod \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " Jul 07 14:25:07.880122 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880107 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-credential-socket\") pod \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " Jul 07 14:25:07.880304 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880174 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgsdb\" (UniqueName: \"kubernetes.io/projected/5b391f66-7c3e-49c1-b73a-d42e6adf6385-kube-api-access-sgsdb\") pod \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " Jul 07 14:25:07.880304 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880206 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-workload-socket\") pod \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " Jul 07 14:25:07.880304 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880222 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b391f66-7c3e-49c1-b73a-d42e6adf6385" (UID: "5b391f66-7c3e-49c1-b73a-d42e6adf6385"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:07.880304 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880260 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istiod-ca-cert\") pod \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " Jul 07 14:25:07.880304 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880293 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-podinfo\") pod \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " Jul 07 14:25:07.880558 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880321 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-workload-certs\") pod \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\" (UID: \"5b391f66-7c3e-49c1-b73a-d42e6adf6385\") " Jul 07 14:25:07.880558 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880459 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b391f66-7c3e-49c1-b73a-d42e6adf6385" (UID: "5b391f66-7c3e-49c1-b73a-d42e6adf6385"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:07.880558 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880508 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b391f66-7c3e-49c1-b73a-d42e6adf6385" (UID: "5b391f66-7c3e-49c1-b73a-d42e6adf6385"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:07.880701 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880632 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-data\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:07.880701 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880652 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-credential-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:07.880701 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880675 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-workload-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:07.880701 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880648 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b391f66-7c3e-49c1-b73a-d42e6adf6385" (UID: "5b391f66-7c3e-49c1-b73a-d42e6adf6385"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:07.880701 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.880658 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b391f66-7c3e-49c1-b73a-d42e6adf6385" (UID: "5b391f66-7c3e-49c1-b73a-d42e6adf6385"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:25:07.882209 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.882185 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b391f66-7c3e-49c1-b73a-d42e6adf6385" (UID: "5b391f66-7c3e-49c1-b73a-d42e6adf6385"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:25:07.882357 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.882339 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b391f66-7c3e-49c1-b73a-d42e6adf6385" (UID: "5b391f66-7c3e-49c1-b73a-d42e6adf6385"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 14:25:07.882635 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.882618 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b391f66-7c3e-49c1-b73a-d42e6adf6385" (UID: "5b391f66-7c3e-49c1-b73a-d42e6adf6385"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:07.882695 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.882661 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b391f66-7c3e-49c1-b73a-d42e6adf6385-kube-api-access-sgsdb" (OuterVolumeSpecName: "kube-api-access-sgsdb") pod "5b391f66-7c3e-49c1-b73a-d42e6adf6385" (UID: "5b391f66-7c3e-49c1-b73a-d42e6adf6385"). InnerVolumeSpecName "kube-api-access-sgsdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:25:07.981726 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.981690 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-envoy\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:07.981726 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.981723 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-token\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:07.981726 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.981732 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgsdb\" (UniqueName: \"kubernetes.io/projected/5b391f66-7c3e-49c1-b73a-d42e6adf6385-kube-api-access-sgsdb\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:07.981908 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.981741 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istiod-ca-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:07.981908 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.981750 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b391f66-7c3e-49c1-b73a-d42e6adf6385-istio-podinfo\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:07.981908 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:07.981757 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b391f66-7c3e-49c1-b73a-d42e6adf6385-workload-certs\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:08.673662 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.673634 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm"] Jul 07 14:25:08.674057 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.674036 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b391f66-7c3e-49c1-b73a-d42e6adf6385" containerName="istio-proxy" Jul 07 14:25:08.674057 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.674058 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b391f66-7c3e-49c1-b73a-d42e6adf6385" containerName="istio-proxy" Jul 07 14:25:08.674258 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.674135 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b391f66-7c3e-49c1-b73a-d42e6adf6385" containerName="istio-proxy" Jul 07 14:25:08.676208 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.676184 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.678875 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.678855 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b908f305-openshift-default-dockercfg-m69k6\"" Jul 07 14:25:08.701694 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.701673 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm"] Jul 07 14:25:08.715103 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.715084 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" Jul 07 14:25:08.715451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.715083 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l" event={"ID":"5b391f66-7c3e-49c1-b73a-d42e6adf6385","Type":"ContainerDied","Data":"a0bfec3758d12b028a6f5f8e17236bfb0866aa5dd6b2c4f015367f2e8dd6616c"} Jul 07 14:25:08.715451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.715218 2583 scope.go:117] "RemoveContainer" containerID="d04b47f300d11cc14ce1e67ea51be4ea2d071977ae530b4723456777a19c8bd4" Jul 07 14:25:08.745128 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.745102 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l"] Jul 07 14:25:08.749443 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.749421 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ec5470d4-openshift-default-754f9c598c-mg54l"] Jul 07 14:25:08.787250 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.787198 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk8jl\" (UniqueName: \"kubernetes.io/projected/708851c7-a65f-471c-badd-1b8565fe17e8-kube-api-access-zk8jl\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.787372 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.787273 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/708851c7-a65f-471c-badd-1b8565fe17e8-istio-token\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.787372 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.787306 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-workload-socket\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.787372 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.787360 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-workload-certs\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.787536 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.787391 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-istio-data\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.787536 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.787421 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/708851c7-a65f-471c-badd-1b8565fe17e8-istiod-ca-cert\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.787536 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.787448 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-credential-socket\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.787536 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.787501 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-istio-envoy\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.787536 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.787526 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/708851c7-a65f-471c-badd-1b8565fe17e8-istio-podinfo\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.888347 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.888320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-credential-socket\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.888451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.888359 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-istio-envoy\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.888451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.888382 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/708851c7-a65f-471c-badd-1b8565fe17e8-istio-podinfo\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.888566 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.888452 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk8jl\" (UniqueName: \"kubernetes.io/projected/708851c7-a65f-471c-badd-1b8565fe17e8-kube-api-access-zk8jl\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.888566 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.888490 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/708851c7-a65f-471c-badd-1b8565fe17e8-istio-token\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.888566 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.888517 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-workload-socket\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.888750 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.888564 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-workload-certs\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.888750 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.888596 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-istio-data\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.888750 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.888626 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/708851c7-a65f-471c-badd-1b8565fe17e8-istiod-ca-cert\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.888750 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.888723 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-credential-socket\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.888950 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.888923 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-workload-certs\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.889006 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.888989 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-workload-socket\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.889078 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.889055 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-istio-data\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.889325 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.889307 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/708851c7-a65f-471c-badd-1b8565fe17e8-istiod-ca-cert\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.890644 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.890625 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-istio-envoy\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.890908 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.890892 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/708851c7-a65f-471c-badd-1b8565fe17e8-istio-podinfo\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.897152 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.897135 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/708851c7-a65f-471c-badd-1b8565fe17e8-istio-token\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.897494 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.897471 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk8jl\" (UniqueName: \"kubernetes.io/projected/708851c7-a65f-471c-badd-1b8565fe17e8-kube-api-access-zk8jl\") pod \"e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:08.986970 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:08.986919 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:09.116770 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:09.116738 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm"] Jul 07 14:25:09.118522 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:25:09.118486 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708851c7_a65f_471c_badd_1b8565fe17e8.slice/crio-d96759ed908ca54549735e5d1e610061a10a994b9cd38978b2faf166c9e4beb7 WatchSource:0}: Error finding container d96759ed908ca54549735e5d1e610061a10a994b9cd38978b2faf166c9e4beb7: Status 404 returned error can't find the container with id d96759ed908ca54549735e5d1e610061a10a994b9cd38978b2faf166c9e4beb7 Jul 07 14:25:09.120683 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:09.120656 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:25:09.120765 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:09.120735 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:25:09.120805 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:09.120764 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:25:09.722414 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:09.722383 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" event={"ID":"708851c7-a65f-471c-badd-1b8565fe17e8","Type":"ContainerStarted","Data":"5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360"} Jul 07 14:25:09.722771 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:09.722429 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" event={"ID":"708851c7-a65f-471c-badd-1b8565fe17e8","Type":"ContainerStarted","Data":"d96759ed908ca54549735e5d1e610061a10a994b9cd38978b2faf166c9e4beb7"} Jul 07 14:25:09.987823 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:09.987744 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:10.426073 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:10.426043 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b391f66-7c3e-49c1-b73a-d42e6adf6385" path="/var/lib/kubelet/pods/5b391f66-7c3e-49c1-b73a-d42e6adf6385/volumes" Jul 07 14:25:10.992068 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:10.992038 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:11.022329 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:11.022275 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" podStartSLOduration=3.022261325 podStartE2EDuration="3.022261325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:09.748418351 +0000 UTC m=+1541.922205924" watchObservedRunningTime="2026-07-07 14:25:11.022261325 +0000 UTC m=+1543.196048897" Jul 07 14:25:11.732889 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:11.732857 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:11.733875 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:11.733855 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:12.298250 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:12.298183 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:25:14.426214 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:14.426185 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm"] Jul 07 14:25:14.752717 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:14.752595 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" podUID="708851c7-a65f-471c-badd-1b8565fe17e8" containerName="istio-proxy" containerID="cri-o://5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360" gracePeriod=30 Jul 07 14:25:20.225799 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.225777 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:20.394350 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394278 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-credential-socket\") pod \"708851c7-a65f-471c-badd-1b8565fe17e8\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " Jul 07 14:25:20.394350 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394315 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-workload-certs\") pod \"708851c7-a65f-471c-badd-1b8565fe17e8\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " Jul 07 14:25:20.394350 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394336 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk8jl\" (UniqueName: \"kubernetes.io/projected/708851c7-a65f-471c-badd-1b8565fe17e8-kube-api-access-zk8jl\") pod \"708851c7-a65f-471c-badd-1b8565fe17e8\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " Jul 07 14:25:20.394621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394360 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-istio-data\") pod \"708851c7-a65f-471c-badd-1b8565fe17e8\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " Jul 07 14:25:20.394621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394381 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-istio-envoy\") pod \"708851c7-a65f-471c-badd-1b8565fe17e8\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " Jul 07 14:25:20.394621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394406 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-workload-socket\") pod \"708851c7-a65f-471c-badd-1b8565fe17e8\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " Jul 07 14:25:20.394621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394442 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/708851c7-a65f-471c-badd-1b8565fe17e8-istiod-ca-cert\") pod \"708851c7-a65f-471c-badd-1b8565fe17e8\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " Jul 07 14:25:20.394621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394478 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/708851c7-a65f-471c-badd-1b8565fe17e8-istio-token\") pod \"708851c7-a65f-471c-badd-1b8565fe17e8\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " Jul 07 14:25:20.394621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394512 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/708851c7-a65f-471c-badd-1b8565fe17e8-istio-podinfo\") pod \"708851c7-a65f-471c-badd-1b8565fe17e8\" (UID: \"708851c7-a65f-471c-badd-1b8565fe17e8\") " Jul 07 14:25:20.394621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394589 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "708851c7-a65f-471c-badd-1b8565fe17e8" (UID: "708851c7-a65f-471c-badd-1b8565fe17e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:20.395120 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394663 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "708851c7-a65f-471c-badd-1b8565fe17e8" (UID: "708851c7-a65f-471c-badd-1b8565fe17e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:20.395120 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394859 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/708851c7-a65f-471c-badd-1b8565fe17e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "708851c7-a65f-471c-badd-1b8565fe17e8" (UID: "708851c7-a65f-471c-badd-1b8565fe17e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:25:20.395120 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394884 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-credential-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:20.395120 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.394903 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-workload-certs\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:20.395120 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.395102 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "708851c7-a65f-471c-badd-1b8565fe17e8" (UID: "708851c7-a65f-471c-badd-1b8565fe17e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:20.395335 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.395250 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "708851c7-a65f-471c-badd-1b8565fe17e8" (UID: "708851c7-a65f-471c-badd-1b8565fe17e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:20.396633 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.396605 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/708851c7-a65f-471c-badd-1b8565fe17e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "708851c7-a65f-471c-badd-1b8565fe17e8" (UID: "708851c7-a65f-471c-badd-1b8565fe17e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:25:20.396725 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.396643 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/708851c7-a65f-471c-badd-1b8565fe17e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "708851c7-a65f-471c-badd-1b8565fe17e8" (UID: "708851c7-a65f-471c-badd-1b8565fe17e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 14:25:20.396725 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.396649 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/708851c7-a65f-471c-badd-1b8565fe17e8-kube-api-access-zk8jl" (OuterVolumeSpecName: "kube-api-access-zk8jl") pod "708851c7-a65f-471c-badd-1b8565fe17e8" (UID: "708851c7-a65f-471c-badd-1b8565fe17e8"). InnerVolumeSpecName "kube-api-access-zk8jl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:25:20.396725 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.396699 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "708851c7-a65f-471c-badd-1b8565fe17e8" (UID: "708851c7-a65f-471c-badd-1b8565fe17e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:20.496176 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.496154 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk8jl\" (UniqueName: \"kubernetes.io/projected/708851c7-a65f-471c-badd-1b8565fe17e8-kube-api-access-zk8jl\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:20.496176 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.496176 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-istio-data\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:20.496342 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.496185 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-istio-envoy\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:20.496342 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.496193 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/708851c7-a65f-471c-badd-1b8565fe17e8-workload-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:20.496342 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.496201 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/708851c7-a65f-471c-badd-1b8565fe17e8-istiod-ca-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:20.496342 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.496209 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/708851c7-a65f-471c-badd-1b8565fe17e8-istio-token\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:20.496342 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.496216 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/708851c7-a65f-471c-badd-1b8565fe17e8-istio-podinfo\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:25:20.712367 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.712274 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:25:20.787855 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.787827 2583 generic.go:356] "Generic (PLEG): container finished" podID="708851c7-a65f-471c-badd-1b8565fe17e8" containerID="5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360" exitCode=0 Jul 07 14:25:20.788004 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.787873 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" Jul 07 14:25:20.788004 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.787917 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" event={"ID":"708851c7-a65f-471c-badd-1b8565fe17e8","Type":"ContainerDied","Data":"5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360"} Jul 07 14:25:20.788004 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.787969 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm" event={"ID":"708851c7-a65f-471c-badd-1b8565fe17e8","Type":"ContainerDied","Data":"d96759ed908ca54549735e5d1e610061a10a994b9cd38978b2faf166c9e4beb7"} Jul 07 14:25:20.788004 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.787994 2583 scope.go:117] "RemoveContainer" containerID="5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360" Jul 07 14:25:20.796642 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.796626 2583 scope.go:117] "RemoveContainer" containerID="5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360" Jul 07 14:25:20.796927 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:25:20.796908 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360\": container with ID starting with 5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360 not found: ID does not exist" containerID="5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360" Jul 07 14:25:20.796987 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.796938 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360"} err="failed to get container status \"5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360\": rpc error: code = NotFound desc = could not find container \"5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360\": container with ID starting with 5f0d1a66b87f4d934bd3e9b9387297119400b472389c8b259013645e5e271360 not found: ID does not exist" Jul 07 14:25:20.809361 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.809339 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm"] Jul 07 14:25:20.814531 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:20.814509 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b908f305-openshift-default-79dcf6bb5f-jzkpm"] Jul 07 14:25:22.426900 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:25:22.426866 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="708851c7-a65f-471c-badd-1b8565fe17e8" path="/var/lib/kubelet/pods/708851c7-a65f-471c-badd-1b8565fe17e8/volumes" Jul 07 14:26:43.700255 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:43.700164 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:26:51.099427 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:51.099392 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:26:57.397274 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.397216 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f"] Jul 07 14:26:57.397636 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.397592 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708851c7-a65f-471c-badd-1b8565fe17e8" containerName="istio-proxy" Jul 07 14:26:57.397636 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.397604 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="708851c7-a65f-471c-badd-1b8565fe17e8" containerName="istio-proxy" Jul 07 14:26:57.397709 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.397663 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="708851c7-a65f-471c-badd-1b8565fe17e8" containerName="istio-proxy" Jul 07 14:26:57.400655 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.400638 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.403413 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.403390 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2f1f0536-openshift-default-dockercfg-62stz\"" Jul 07 14:26:57.427156 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.427124 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f"] Jul 07 14:26:57.508451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.508411 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-workload-certs\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.508451 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.508451 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-workload-socket\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.508714 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.508531 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-token\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.508714 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.508570 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-podinfo\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.508714 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.508609 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-data\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.508714 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.508639 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istiod-ca-cert\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.508714 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.508694 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz7lq\" (UniqueName: \"kubernetes.io/projected/5f57d922-9c45-44cb-9b3b-843e4001c3cb-kube-api-access-mz7lq\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.508880 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.508767 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-credential-socket\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.508880 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.508804 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-envoy\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.609391 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.609345 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-data\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.609391 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.609399 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istiod-ca-cert\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.609621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.609454 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz7lq\" (UniqueName: \"kubernetes.io/projected/5f57d922-9c45-44cb-9b3b-843e4001c3cb-kube-api-access-mz7lq\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.609621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.609510 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-credential-socket\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.609621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.609540 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-envoy\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.609621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.609573 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-workload-certs\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.609621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.609603 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-workload-socket\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.609857 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.609652 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-token\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.609857 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.609680 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-podinfo\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.609857 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.609832 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-data\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.610034 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.609982 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-workload-certs\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.610034 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.610019 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-workload-socket\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.610148 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.610090 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-credential-socket\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.610205 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.610193 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istiod-ca-cert\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.611935 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.611906 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-envoy\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.612042 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.611986 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-podinfo\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.623077 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.623054 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz7lq\" (UniqueName: \"kubernetes.io/projected/5f57d922-9c45-44cb-9b3b-843e4001c3cb-kube-api-access-mz7lq\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.624392 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.624365 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-token\") pod \"e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.710349 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.710248 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:57.853626 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.853602 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f"] Jul 07 14:26:57.855060 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:26:57.855036 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f57d922_9c45_44cb_9b3b_843e4001c3cb.slice/crio-170ff0eaf77ed1acf752e18140a470216a31f9fa624646388788e973162e2b67 WatchSource:0}: Error finding container 170ff0eaf77ed1acf752e18140a470216a31f9fa624646388788e973162e2b67: Status 404 returned error can't find the container with id 170ff0eaf77ed1acf752e18140a470216a31f9fa624646388788e973162e2b67 Jul 07 14:26:57.857135 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.857107 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:26:57.857211 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.857169 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:26:57.857211 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:57.857196 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:26:58.256562 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:58.256517 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" event={"ID":"5f57d922-9c45-44cb-9b3b-843e4001c3cb","Type":"ContainerStarted","Data":"a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe"} Jul 07 14:26:58.256740 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:58.256590 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" event={"ID":"5f57d922-9c45-44cb-9b3b-843e4001c3cb","Type":"ContainerStarted","Data":"170ff0eaf77ed1acf752e18140a470216a31f9fa624646388788e973162e2b67"} Jul 07 14:26:58.280441 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:58.280392 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" podStartSLOduration=1.28037476 podStartE2EDuration="1.28037476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:26:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:26:58.278540213 +0000 UTC m=+1650.452327812" watchObservedRunningTime="2026-07-07 14:26:58.28037476 +0000 UTC m=+1650.454162333" Jul 07 14:26:58.710438 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:58.710405 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:58.715806 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:58.715784 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:59.261199 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:59.261166 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:59.262081 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:59.262065 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:26:59.893058 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:26:59.893018 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:27:09.695465 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:09.695433 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:27:13.328571 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:13.328539 2583 generic.go:356] "Generic (PLEG): container finished" podID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerID="a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe" exitCode=0 Jul 07 14:27:13.328941 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:13.328615 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" event={"ID":"5f57d922-9c45-44cb-9b3b-843e4001c3cb","Type":"ContainerDied","Data":"a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe"} Jul 07 14:27:13.329014 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:13.329000 2583 scope.go:117] "RemoveContainer" containerID="a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe" Jul 07 14:27:13.330034 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:13.330005 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:27:13.330117 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:13.330088 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:27:13.330166 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:13.330148 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:27:14.262065 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:14.262024 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:27:14.337392 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:14.337350 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" event={"ID":"5f57d922-9c45-44cb-9b3b-843e4001c3cb","Type":"ContainerStarted","Data":"a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643"} Jul 07 14:27:14.711008 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:14.710968 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:27:14.711907 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:14.711881 2583 patch_prober.go:28] interesting pod/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 07 14:27:14.712049 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:14.711953 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" podUID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 07 14:27:15.710724 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:15.710689 2583 patch_prober.go:28] interesting pod/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 07 14:27:15.711099 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:15.710754 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" podUID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 07 14:27:16.503524 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:16.503485 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:27:16.710893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:16.710853 2583 patch_prober.go:28] interesting pod/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 07 14:27:16.711291 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:16.710915 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" podUID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 07 14:27:17.711554 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:17.711519 2583 patch_prober.go:28] interesting pod/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 07 14:27:17.712019 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:17.711589 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" podUID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 07 14:27:18.714775 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:18.714749 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:27:18.715259 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:18.715060 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:27:18.715724 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:18.715704 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:27:19.276270 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:19.276088 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f"] Jul 07 14:27:19.373464 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:19.373423 2583 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" secret="" err="secret \"e2e-mt-2f1f0536-openshift-default-dockercfg-62stz\" not found" Jul 07 14:27:20.378410 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:20.378376 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" podUID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerName="istio-proxy" containerID="cri-o://a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643" gracePeriod=30 Jul 07 14:27:25.629538 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.629512 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:27:25.654529 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.654458 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-token\") pod \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " Jul 07 14:27:25.654529 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.654499 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-data\") pod \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " Jul 07 14:27:25.654856 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.654538 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-envoy\") pod \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " Jul 07 14:27:25.654856 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.654588 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-podinfo\") pod \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " Jul 07 14:27:25.654856 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.654624 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-workload-socket\") pod \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " Jul 07 14:27:25.654856 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.654653 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istiod-ca-cert\") pod \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " Jul 07 14:27:25.654856 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.654692 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-credential-socket\") pod \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " Jul 07 14:27:25.654856 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.654765 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-workload-certs\") pod \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " Jul 07 14:27:25.654856 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.654812 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz7lq\" (UniqueName: \"kubernetes.io/projected/5f57d922-9c45-44cb-9b3b-843e4001c3cb-kube-api-access-mz7lq\") pod \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\" (UID: \"5f57d922-9c45-44cb-9b3b-843e4001c3cb\") " Jul 07 14:27:25.655680 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.655350 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f57d922-9c45-44cb-9b3b-843e4001c3cb" (UID: "5f57d922-9c45-44cb-9b3b-843e4001c3cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:27:25.655680 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.655372 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f57d922-9c45-44cb-9b3b-843e4001c3cb" (UID: "5f57d922-9c45-44cb-9b3b-843e4001c3cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:27:25.655680 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.655507 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f57d922-9c45-44cb-9b3b-843e4001c3cb" (UID: "5f57d922-9c45-44cb-9b3b-843e4001c3cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:27:25.655680 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.655527 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f57d922-9c45-44cb-9b3b-843e4001c3cb" (UID: "5f57d922-9c45-44cb-9b3b-843e4001c3cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:27:25.655680 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.655634 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f57d922-9c45-44cb-9b3b-843e4001c3cb" (UID: "5f57d922-9c45-44cb-9b3b-843e4001c3cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:27:25.657530 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.657500 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f57d922-9c45-44cb-9b3b-843e4001c3cb" (UID: "5f57d922-9c45-44cb-9b3b-843e4001c3cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:27:25.657530 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.657523 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f57d922-9c45-44cb-9b3b-843e4001c3cb-kube-api-access-mz7lq" (OuterVolumeSpecName: "kube-api-access-mz7lq") pod "5f57d922-9c45-44cb-9b3b-843e4001c3cb" (UID: "5f57d922-9c45-44cb-9b3b-843e4001c3cb"). InnerVolumeSpecName "kube-api-access-mz7lq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:27:25.657765 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.657742 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f57d922-9c45-44cb-9b3b-843e4001c3cb" (UID: "5f57d922-9c45-44cb-9b3b-843e4001c3cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:27:25.657876 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.657779 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f57d922-9c45-44cb-9b3b-843e4001c3cb" (UID: "5f57d922-9c45-44cb-9b3b-843e4001c3cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 14:27:25.756385 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.756351 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-workload-certs\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:27:25.756385 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.756379 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz7lq\" (UniqueName: \"kubernetes.io/projected/5f57d922-9c45-44cb-9b3b-843e4001c3cb-kube-api-access-mz7lq\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:27:25.756385 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.756393 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-token\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:27:25.756625 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.756406 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-data\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:27:25.756625 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.756416 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-envoy\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:27:25.756625 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.756427 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istio-podinfo\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:27:25.756625 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.756437 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-workload-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:27:25.756625 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.756448 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f57d922-9c45-44cb-9b3b-843e4001c3cb-istiod-ca-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:27:25.756625 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:25.756460 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f57d922-9c45-44cb-9b3b-843e4001c3cb-credential-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:27:26.413774 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:26.413735 2583 generic.go:356] "Generic (PLEG): container finished" podID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerID="a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643" exitCode=0 Jul 07 14:27:26.413943 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:26.413796 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" Jul 07 14:27:26.413943 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:26.413803 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" event={"ID":"5f57d922-9c45-44cb-9b3b-843e4001c3cb","Type":"ContainerDied","Data":"a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643"} Jul 07 14:27:26.413943 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:26.413882 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f" event={"ID":"5f57d922-9c45-44cb-9b3b-843e4001c3cb","Type":"ContainerDied","Data":"170ff0eaf77ed1acf752e18140a470216a31f9fa624646388788e973162e2b67"} Jul 07 14:27:26.413943 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:26.413913 2583 scope.go:117] "RemoveContainer" containerID="a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643" Jul 07 14:27:26.422760 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:26.422742 2583 scope.go:117] "RemoveContainer" containerID="a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe" Jul 07 14:27:26.430943 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:26.430926 2583 scope.go:117] "RemoveContainer" containerID="a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643" Jul 07 14:27:26.431189 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:27:26.431169 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643\": container with ID starting with a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643 not found: ID does not exist" containerID="a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643" Jul 07 14:27:26.431382 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:26.431197 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643"} err="failed to get container status \"a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643\": rpc error: code = NotFound desc = could not find container \"a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643\": container with ID starting with a34ca95e4ec90529ff26135f40510bd1c0858bbbdc9d1b398066e308501d1643 not found: ID does not exist" Jul 07 14:27:26.431382 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:26.431214 2583 scope.go:117] "RemoveContainer" containerID="a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe" Jul 07 14:27:26.431494 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:27:26.431474 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe\": container with ID starting with a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe not found: ID does not exist" containerID="a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe" Jul 07 14:27:26.431542 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:26.431497 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe"} err="failed to get container status \"a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe\": rpc error: code = NotFound desc = could not find container \"a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe\": container with ID starting with a5b5599c57641cac602f05d23a4312db20d015acafd7cb1c6bbdd5b297d473fe not found: ID does not exist" Jul 07 14:27:26.437764 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:26.437628 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f"] Jul 07 14:27:26.439879 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:26.439857 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2f1f0536-openshift-default-859bf77fc9-n4w6f"] Jul 07 14:27:28.427474 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:28.427442 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" path="/var/lib/kubelet/pods/5f57d922-9c45-44cb-9b3b-843e4001c3cb/volumes" Jul 07 14:27:39.127799 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.127767 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh"] Jul 07 14:27:39.128165 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.128106 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerName="istio-proxy" Jul 07 14:27:39.128165 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.128117 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerName="istio-proxy" Jul 07 14:27:39.128165 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.128134 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerName="istio-proxy" Jul 07 14:27:39.128165 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.128140 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerName="istio-proxy" Jul 07 14:27:39.128346 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.128189 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerName="istio-proxy" Jul 07 14:27:39.128346 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.128196 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f57d922-9c45-44cb-9b3b-843e4001c3cb" containerName="istio-proxy" Jul 07 14:27:39.130894 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.130873 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.133443 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.133423 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9a9d5643-openshift-default-dockercfg-mcvbn\"" Jul 07 14:27:39.145581 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.145552 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh"] Jul 07 14:27:39.282854 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.282820 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-token\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.283019 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.282859 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-data\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.283019 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.282887 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-workload-certs\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.283019 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.282965 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istiod-ca-cert\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.283019 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.283007 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-podinfo\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.283169 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.283038 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vd8v\" (UniqueName: \"kubernetes.io/projected/d9cdbd09-e800-4f0d-bf4e-546bb213733e-kube-api-access-6vd8v\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.283169 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.283060 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-credential-socket\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.283169 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.283127 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-workload-socket\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.283169 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.283165 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-envoy\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.384646 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.384556 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-token\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.384646 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.384597 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-data\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.384646 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.384620 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-workload-certs\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.384646 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.384645 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istiod-ca-cert\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.384960 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.384678 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-podinfo\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.384960 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.384712 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vd8v\" (UniqueName: \"kubernetes.io/projected/d9cdbd09-e800-4f0d-bf4e-546bb213733e-kube-api-access-6vd8v\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.384960 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.384743 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-credential-socket\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.384960 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.384778 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-workload-socket\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.384960 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.384802 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-envoy\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.385215 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.385016 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-data\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.385215 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.385064 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-workload-certs\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.385215 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.385151 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-credential-socket\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.385215 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.385186 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-workload-socket\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.385684 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.385661 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istiod-ca-cert\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.387054 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.387034 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-envoy\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.387238 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.387206 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-podinfo\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.393671 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.393646 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vd8v\" (UniqueName: \"kubernetes.io/projected/d9cdbd09-e800-4f0d-bf4e-546bb213733e-kube-api-access-6vd8v\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.394168 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.394143 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-token\") pod \"e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.440672 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.440641 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:39.587793 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.587761 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh"] Jul 07 14:27:39.588877 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:27:39.588856 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9cdbd09_e800_4f0d_bf4e_546bb213733e.slice/crio-d4192641207c0fa5f3b2f176c8bf5ca71529b7d61a2a0e30c9f7c1ea6bb1a725 WatchSource:0}: Error finding container d4192641207c0fa5f3b2f176c8bf5ca71529b7d61a2a0e30c9f7c1ea6bb1a725: Status 404 returned error can't find the container with id d4192641207c0fa5f3b2f176c8bf5ca71529b7d61a2a0e30c9f7c1ea6bb1a725 Jul 07 14:27:39.590839 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.590810 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:27:39.590918 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.590876 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:27:39.590918 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:39.590905 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:27:40.487995 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:40.487954 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" event={"ID":"d9cdbd09-e800-4f0d-bf4e-546bb213733e","Type":"ContainerStarted","Data":"54e9dda917f606a3a4f36769ff43bc04ee361de8865aa1ea4a902a617fd15d23"} Jul 07 14:27:40.488457 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:40.488009 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" event={"ID":"d9cdbd09-e800-4f0d-bf4e-546bb213733e","Type":"ContainerStarted","Data":"d4192641207c0fa5f3b2f176c8bf5ca71529b7d61a2a0e30c9f7c1ea6bb1a725"} Jul 07 14:27:40.519252 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:40.519189 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" podStartSLOduration=1.5191741730000001 podStartE2EDuration="1.519174173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:27:40.51621258 +0000 UTC m=+1692.690000168" watchObservedRunningTime="2026-07-07 14:27:40.519174173 +0000 UTC m=+1692.692961748" Jul 07 14:27:41.440961 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:41.440913 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:41.446206 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:41.446177 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:41.493296 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:41.493266 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:41.494362 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:41.494341 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:47.998665 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:47.998609 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:27:55.579809 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:55.579772 2583 generic.go:356] "Generic (PLEG): container finished" podID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerID="54e9dda917f606a3a4f36769ff43bc04ee361de8865aa1ea4a902a617fd15d23" exitCode=0 Jul 07 14:27:55.580339 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:55.579814 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" event={"ID":"d9cdbd09-e800-4f0d-bf4e-546bb213733e","Type":"ContainerDied","Data":"54e9dda917f606a3a4f36769ff43bc04ee361de8865aa1ea4a902a617fd15d23"} Jul 07 14:27:55.580339 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:55.580320 2583 scope.go:117] "RemoveContainer" containerID="54e9dda917f606a3a4f36769ff43bc04ee361de8865aa1ea4a902a617fd15d23" Jul 07 14:27:55.581379 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:55.581350 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:27:55.581476 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:55.581434 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:27:55.581476 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:55.581464 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:27:56.493696 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:56.493657 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:56.586212 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:56.586183 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" event={"ID":"d9cdbd09-e800-4f0d-bf4e-546bb213733e","Type":"ContainerStarted","Data":"dbbfcac185a52932e389113587f16ede1490a7864328af62d76cec3a7ef2e546"} Jul 07 14:27:57.441923 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:57.441846 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:27:57.443453 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:57.443073 2583 patch_prober.go:28] interesting pod/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 07 14:27:57.443453 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:57.443148 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" podUID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 07 14:27:58.442156 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:58.442107 2583 patch_prober.go:28] interesting pod/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 07 14:27:58.442785 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:58.442178 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" podUID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 07 14:27:59.441619 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:59.441578 2583 patch_prober.go:28] interesting pod/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 07 14:27:59.441929 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:59.441900 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" podUID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 07 14:27:59.499529 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:27:59.499494 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:28:00.445612 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:28:00.445576 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:28:00.445845 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:28:00.445825 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:28:00.446613 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:28:00.446598 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:28:13.198928 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:28:13.198895 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:28:23.999261 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:28:23.999213 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:28:36.204773 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:28:36.204732 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:29:10.098247 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:10.098193 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:29:13.856851 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:13.856817 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh"] Jul 07 14:29:13.857248 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:13.857005 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" podUID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerName="istio-proxy" containerID="cri-o://dbbfcac185a52932e389113587f16ede1490a7864328af62d76cec3a7ef2e546" gracePeriod=30 Jul 07 14:29:15.448047 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:15.447997 2583 patch_prober.go:28] interesting pod/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 14:29:15.448504 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:15.448080 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" podUID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:29:18.989670 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:18.989635 2583 generic.go:356] "Generic (PLEG): container finished" podID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerID="dbbfcac185a52932e389113587f16ede1490a7864328af62d76cec3a7ef2e546" exitCode=0 Jul 07 14:29:18.990036 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:18.989698 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" event={"ID":"d9cdbd09-e800-4f0d-bf4e-546bb213733e","Type":"ContainerDied","Data":"dbbfcac185a52932e389113587f16ede1490a7864328af62d76cec3a7ef2e546"} Jul 07 14:29:18.990036 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:18.989757 2583 scope.go:117] "RemoveContainer" containerID="54e9dda917f606a3a4f36769ff43bc04ee361de8865aa1ea4a902a617fd15d23" Jul 07 14:29:19.091015 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.090989 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:29:19.164533 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.164451 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-workload-socket\") pod \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " Jul 07 14:29:19.164533 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.164488 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-envoy\") pod \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " Jul 07 14:29:19.164533 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.164514 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vd8v\" (UniqueName: \"kubernetes.io/projected/d9cdbd09-e800-4f0d-bf4e-546bb213733e-kube-api-access-6vd8v\") pod \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " Jul 07 14:29:19.164794 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.164538 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-credential-socket\") pod \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " Jul 07 14:29:19.164794 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.164557 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-podinfo\") pod \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " Jul 07 14:29:19.164794 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.164703 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istiod-ca-cert\") pod \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " Jul 07 14:29:19.164950 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.164785 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d9cdbd09-e800-4f0d-bf4e-546bb213733e" (UID: "d9cdbd09-e800-4f0d-bf4e-546bb213733e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:29:19.164950 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.164796 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d9cdbd09-e800-4f0d-bf4e-546bb213733e" (UID: "d9cdbd09-e800-4f0d-bf4e-546bb213733e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:29:19.164950 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.164825 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-workload-certs\") pod \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " Jul 07 14:29:19.164950 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.164862 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-token\") pod \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " Jul 07 14:29:19.164950 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.164891 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-data\") pod \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\" (UID: \"d9cdbd09-e800-4f0d-bf4e-546bb213733e\") " Jul 07 14:29:19.165182 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.164950 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d9cdbd09-e800-4f0d-bf4e-546bb213733e" (UID: "d9cdbd09-e800-4f0d-bf4e-546bb213733e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:29:19.165182 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.165080 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d9cdbd09-e800-4f0d-bf4e-546bb213733e" (UID: "d9cdbd09-e800-4f0d-bf4e-546bb213733e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:29:19.165347 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.165326 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-workload-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:29:19.165415 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.165350 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-credential-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:29:19.165415 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.165364 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istiod-ca-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:29:19.165415 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.165376 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-workload-certs\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:29:19.165665 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.165646 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-data" (OuterVolumeSpecName: "istio-data") pod "d9cdbd09-e800-4f0d-bf4e-546bb213733e" (UID: "d9cdbd09-e800-4f0d-bf4e-546bb213733e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:29:19.166810 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.166786 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d9cdbd09-e800-4f0d-bf4e-546bb213733e" (UID: "d9cdbd09-e800-4f0d-bf4e-546bb213733e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 14:29:19.166920 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.166841 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-token" (OuterVolumeSpecName: "istio-token") pod "d9cdbd09-e800-4f0d-bf4e-546bb213733e" (UID: "d9cdbd09-e800-4f0d-bf4e-546bb213733e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:29:19.167066 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.167046 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d9cdbd09-e800-4f0d-bf4e-546bb213733e" (UID: "d9cdbd09-e800-4f0d-bf4e-546bb213733e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:29:19.167129 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.167055 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9cdbd09-e800-4f0d-bf4e-546bb213733e-kube-api-access-6vd8v" (OuterVolumeSpecName: "kube-api-access-6vd8v") pod "d9cdbd09-e800-4f0d-bf4e-546bb213733e" (UID: "d9cdbd09-e800-4f0d-bf4e-546bb213733e"). InnerVolumeSpecName "kube-api-access-6vd8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:29:19.266836 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.266801 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-envoy\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:29:19.266836 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.266831 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vd8v\" (UniqueName: \"kubernetes.io/projected/d9cdbd09-e800-4f0d-bf4e-546bb213733e-kube-api-access-6vd8v\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:29:19.266836 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.266840 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-podinfo\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:29:19.267069 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.266851 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-token\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:29:19.267069 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.266863 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9cdbd09-e800-4f0d-bf4e-546bb213733e-istio-data\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:29:19.836815 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.836774 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:29:19.995949 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.995886 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" Jul 07 14:29:19.996383 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.995886 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh" event={"ID":"d9cdbd09-e800-4f0d-bf4e-546bb213733e","Type":"ContainerDied","Data":"d4192641207c0fa5f3b2f176c8bf5ca71529b7d61a2a0e30c9f7c1ea6bb1a725"} Jul 07 14:29:19.996383 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:19.996027 2583 scope.go:117] "RemoveContainer" containerID="dbbfcac185a52932e389113587f16ede1490a7864328af62d76cec3a7ef2e546" Jul 07 14:29:20.023885 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:20.023862 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh"] Jul 07 14:29:20.026000 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:20.025981 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9a9d5643-openshift-default-8bcdf555f-gsllh"] Jul 07 14:29:20.425784 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:20.425750 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" path="/var/lib/kubelet/pods/d9cdbd09-e800-4f0d-bf4e-546bb213733e/volumes" Jul 07 14:29:30.498621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:29:30.498586 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:30:00.166580 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.166544 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723910-v4m4x"] Jul 07 14:30:00.167068 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.166870 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerName="istio-proxy" Jul 07 14:30:00.167068 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.166881 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerName="istio-proxy" Jul 07 14:30:00.167068 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.166898 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerName="istio-proxy" Jul 07 14:30:00.167068 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.166904 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerName="istio-proxy" Jul 07 14:30:00.167068 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.166973 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerName="istio-proxy" Jul 07 14:30:00.167068 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.166983 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9cdbd09-e800-4f0d-bf4e-546bb213733e" containerName="istio-proxy" Jul 07 14:30:00.168878 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.168854 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723910-v4m4x" Jul 07 14:30:00.172199 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.172183 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-h8tk9\"" Jul 07 14:30:00.180691 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.180667 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723910-v4m4x"] Jul 07 14:30:00.302593 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.302554 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf5m4\" (UniqueName: \"kubernetes.io/projected/2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e-kube-api-access-kf5m4\") pod \"maas-api-key-cleanup-29723910-v4m4x\" (UID: \"2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e\") " pod="opendatahub/maas-api-key-cleanup-29723910-v4m4x" Jul 07 14:30:00.403444 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.403412 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf5m4\" (UniqueName: \"kubernetes.io/projected/2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e-kube-api-access-kf5m4\") pod \"maas-api-key-cleanup-29723910-v4m4x\" (UID: \"2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e\") " pod="opendatahub/maas-api-key-cleanup-29723910-v4m4x" Jul 07 14:30:00.414790 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.414756 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf5m4\" (UniqueName: \"kubernetes.io/projected/2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e-kube-api-access-kf5m4\") pod \"maas-api-key-cleanup-29723910-v4m4x\" (UID: \"2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e\") " pod="opendatahub/maas-api-key-cleanup-29723910-v4m4x" Jul 07 14:30:00.478325 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.478221 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723910-v4m4x" Jul 07 14:30:00.611079 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.611055 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723910-v4m4x"] Jul 07 14:30:00.613127 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:30:00.613096 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de75cfc_5630_4ffd_ab20_cc5b1ff2fa2e.slice/crio-1afa57b7f520bc6a24ca747394954705b887948dfa30ceb4f7ab78c80e6a4c81 WatchSource:0}: Error finding container 1afa57b7f520bc6a24ca747394954705b887948dfa30ceb4f7ab78c80e6a4c81: Status 404 returned error can't find the container with id 1afa57b7f520bc6a24ca747394954705b887948dfa30ceb4f7ab78c80e6a4c81 Jul 07 14:30:00.615055 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:00.615038 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:30:01.195043 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:01.195001 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723910-v4m4x" event={"ID":"2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e","Type":"ContainerStarted","Data":"1afa57b7f520bc6a24ca747394954705b887948dfa30ceb4f7ab78c80e6a4c81"} Jul 07 14:30:03.207114 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:03.207070 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723910-v4m4x" event={"ID":"2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e","Type":"ContainerStarted","Data":"f07d21a3701b960a23c1c940be7cabd2c0d7cc2dd4ba7afca905c9783b133016"} Jul 07 14:30:03.226859 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:03.226812 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723910-v4m4x" podStartSLOduration=1.20435532 podStartE2EDuration="3.226798272s" totalImagesPullingTime="2.022442952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:03.22532008 +0000 UTC m=+1835.399107650" watchObservedRunningTime="2026-07-07 14:30:03.226798272 +0000 UTC m=+1835.400585843" Jul 07 14:30:04.213196 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:04.213164 2583 generic.go:356] "Generic (PLEG): container finished" podID="2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e" containerID="f07d21a3701b960a23c1c940be7cabd2c0d7cc2dd4ba7afca905c9783b133016" exitCode=0 Jul 07 14:30:04.213575 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:04.213219 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723910-v4m4x" event={"ID":"2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e","Type":"ContainerDied","Data":"f07d21a3701b960a23c1c940be7cabd2c0d7cc2dd4ba7afca905c9783b133016"} Jul 07 14:30:05.344679 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:05.344654 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723910-v4m4x" Jul 07 14:30:05.445611 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:05.445587 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf5m4\" (UniqueName: \"kubernetes.io/projected/2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e-kube-api-access-kf5m4\") pod \"2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e\" (UID: \"2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e\") " Jul 07 14:30:05.447672 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:05.447643 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e-kube-api-access-kf5m4" (OuterVolumeSpecName: "kube-api-access-kf5m4") pod "2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e" (UID: "2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e"). InnerVolumeSpecName "kube-api-access-kf5m4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:30:05.546807 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:05.546770 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf5m4\" (UniqueName: \"kubernetes.io/projected/2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e-kube-api-access-kf5m4\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:30:06.224248 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:06.224198 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723910-v4m4x" Jul 07 14:30:06.224435 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:06.224262 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723910-v4m4x" event={"ID":"2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e","Type":"ContainerDied","Data":"1afa57b7f520bc6a24ca747394954705b887948dfa30ceb4f7ab78c80e6a4c81"} Jul 07 14:30:06.224435 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:06.224306 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1afa57b7f520bc6a24ca747394954705b887948dfa30ceb4f7ab78c80e6a4c81" Jul 07 14:30:09.834083 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.834049 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7"] Jul 07 14:30:09.834564 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.834545 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e" containerName="cleanup" Jul 07 14:30:09.834638 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.834567 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e" containerName="cleanup" Jul 07 14:30:09.834684 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.834650 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e" containerName="cleanup" Jul 07 14:30:09.836436 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.836411 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:09.841113 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.841093 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-8dd42e-openshift-default-dockercfg-vb75q\"" Jul 07 14:30:09.859239 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.859203 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7"] Jul 07 14:30:09.989753 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.989721 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-workload-socket\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:09.989753 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.989753 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-credential-socket\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:09.990008 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.989777 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istiod-ca-cert\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:09.990008 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.989797 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfsdh\" (UniqueName: \"kubernetes.io/projected/a98e0c4a-5d02-4c9d-835e-2165f52f209d-kube-api-access-cfsdh\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:09.990008 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.989877 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-workload-certs\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:09.990008 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.989943 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-token\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:09.990008 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.990008 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-data\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:09.990251 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.990043 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-envoy\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:09.990251 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:09.990095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-podinfo\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091042 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.090971 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-data\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091042 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091009 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-envoy\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091042 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091032 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-podinfo\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091327 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091057 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-workload-socket\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091327 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091072 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-credential-socket\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091327 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091091 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istiod-ca-cert\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091327 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091116 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfsdh\" (UniqueName: \"kubernetes.io/projected/a98e0c4a-5d02-4c9d-835e-2165f52f209d-kube-api-access-cfsdh\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091327 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091140 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-workload-certs\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091327 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091181 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-token\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091599 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091491 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-data\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091599 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091517 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-workload-socket\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091696 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091646 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-credential-socket\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091696 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091668 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-workload-certs\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.091984 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.091962 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istiod-ca-cert\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.093469 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.093450 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-envoy\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.093698 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.093681 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-podinfo\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.102816 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.102788 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-token\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.102894 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.102842 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfsdh\" (UniqueName: \"kubernetes.io/projected/a98e0c4a-5d02-4c9d-835e-2165f52f209d-kube-api-access-cfsdh\") pod \"e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.146520 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.146500 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:10.283189 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.283158 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7"] Jul 07 14:30:10.285899 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:30:10.285878 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98e0c4a_5d02_4c9d_835e_2165f52f209d.slice/crio-17ba1b180d86b8bafad617515479eaf4f7ad2691aa3b08b3f8626d2c8bbdecca WatchSource:0}: Error finding container 17ba1b180d86b8bafad617515479eaf4f7ad2691aa3b08b3f8626d2c8bbdecca: Status 404 returned error can't find the container with id 17ba1b180d86b8bafad617515479eaf4f7ad2691aa3b08b3f8626d2c8bbdecca Jul 07 14:30:10.287911 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.287880 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:30:10.288008 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.287955 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:30:10.288008 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:10.287997 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:30:11.249663 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:11.249627 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" event={"ID":"a98e0c4a-5d02-4c9d-835e-2165f52f209d","Type":"ContainerStarted","Data":"31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967"} Jul 07 14:30:11.250016 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:11.249688 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" event={"ID":"a98e0c4a-5d02-4c9d-835e-2165f52f209d","Type":"ContainerStarted","Data":"17ba1b180d86b8bafad617515479eaf4f7ad2691aa3b08b3f8626d2c8bbdecca"} Jul 07 14:30:11.272582 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:11.272530 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" podStartSLOduration=2.272511739 podStartE2EDuration="2.272511739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:11.272094422 +0000 UTC m=+1843.445881987" watchObservedRunningTime="2026-07-07 14:30:11.272511739 +0000 UTC m=+1843.446299312" Jul 07 14:30:12.146857 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:12.146826 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:12.151628 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:12.151601 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:12.254481 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:12.254457 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:12.255319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:12.255295 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:18.472906 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.472878 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5"] Jul 07 14:30:18.475053 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.475039 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.479391 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.479372 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-b9e929-openshift-default-dockercfg-h45gl\"" Jul 07 14:30:18.491174 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.491148 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5"] Jul 07 14:30:18.563776 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.563742 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbqgd\" (UniqueName: \"kubernetes.io/projected/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-kube-api-access-pbqgd\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.563935 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.563785 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-workload-certs\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.563935 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.563811 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istiod-ca-cert\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.563935 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.563877 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-workload-socket\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.563935 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.563909 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-envoy\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.564175 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.563959 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-data\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.564175 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.563998 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-podinfo\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.564175 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.564020 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-token\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.564175 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.564051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-credential-socket\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.664987 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.664956 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-data\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665160 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.664993 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-podinfo\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665160 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.665010 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-token\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665160 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.665029 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-credential-socket\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665160 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.665058 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbqgd\" (UniqueName: \"kubernetes.io/projected/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-kube-api-access-pbqgd\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665160 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.665084 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-workload-certs\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665160 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.665108 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istiod-ca-cert\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665502 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.665175 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-workload-socket\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665502 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.665204 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-envoy\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665502 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.665453 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-data\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665502 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.665491 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-credential-socket\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665627 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.665518 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-workload-certs\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665627 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.665544 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-workload-socket\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.665862 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.665840 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istiod-ca-cert\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.667336 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.667319 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-envoy\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.667440 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.667425 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-podinfo\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.674323 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.674303 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-token\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.674604 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.674587 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbqgd\" (UniqueName: \"kubernetes.io/projected/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-kube-api-access-pbqgd\") pod \"e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.785598 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.785574 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:18.917171 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.917138 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5"] Jul 07 14:30:18.918552 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:30:18.918528 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bcdeac_36a8_4ecc_a05a_7a3c0147e3c6.slice/crio-e12e6303d2e45c974be18008516d5a7e4d4744fbcc7b8c165d689c5a70b33f3c WatchSource:0}: Error finding container e12e6303d2e45c974be18008516d5a7e4d4744fbcc7b8c165d689c5a70b33f3c: Status 404 returned error can't find the container with id e12e6303d2e45c974be18008516d5a7e4d4744fbcc7b8c165d689c5a70b33f3c Jul 07 14:30:18.920456 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.920429 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:30:18.920535 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.920489 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:30:18.920535 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:18.920520 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:30:19.295934 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:19.295904 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" event={"ID":"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6","Type":"ContainerStarted","Data":"f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91"} Jul 07 14:30:19.296101 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:19.295951 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" event={"ID":"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6","Type":"ContainerStarted","Data":"e12e6303d2e45c974be18008516d5a7e4d4744fbcc7b8c165d689c5a70b33f3c"} Jul 07 14:30:19.320000 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:19.319951 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" podStartSLOduration=1.319938507 podStartE2EDuration="1.319938507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:19.317380599 +0000 UTC m=+1851.491168172" watchObservedRunningTime="2026-07-07 14:30:19.319938507 +0000 UTC m=+1851.493726080" Jul 07 14:30:19.786131 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:19.786098 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:19.787344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:19.787318 2583 patch_prober.go:28] interesting pod/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 07 14:30:19.787394 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:19.787378 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 07 14:30:20.790901 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:20.790864 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:20.904013 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:20.903977 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:30:21.305773 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:21.305746 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:21.306696 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:21.306680 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:28.296430 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:28.296387 2583 patch_prober.go:28] interesting pod/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 14:30:28.304410 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:28.296445 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 14:30:29.356821 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:29.356779 2583 generic.go:356] "Generic (PLEG): container finished" podID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerID="31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967" exitCode=0 Jul 07 14:30:29.357307 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:29.356861 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" event={"ID":"a98e0c4a-5d02-4c9d-835e-2165f52f209d","Type":"ContainerDied","Data":"31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967"} Jul 07 14:30:29.357444 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:29.357425 2583 scope.go:117] "RemoveContainer" containerID="31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967" Jul 07 14:30:29.358543 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:29.358514 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:30:29.358661 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:29.358586 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:30:29.358661 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:29.358617 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:30:30.365616 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:30.365579 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" event={"ID":"a98e0c4a-5d02-4c9d-835e-2165f52f209d","Type":"ContainerStarted","Data":"8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106"} Jul 07 14:30:31.146778 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:31.146738 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:31.147086 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:31.147053 2583 patch_prober.go:28] interesting pod/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 07 14:30:31.147163 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:31.147121 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 07 14:30:31.291325 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:31.291280 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:30:32.147000 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:32.146963 2583 patch_prober.go:28] interesting pod/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 07 14:30:32.147616 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:32.147580 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 07 14:30:33.147961 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:33.147919 2583 patch_prober.go:28] interesting pod/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 07 14:30:33.148476 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:33.147992 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 07 14:30:34.147692 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:34.147245 2583 patch_prober.go:28] interesting pod/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 07 14:30:34.147692 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:34.147310 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 07 14:30:35.150280 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:35.150193 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:35.150679 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:35.150477 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:35.151049 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:35.151033 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:30:35.395125 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:35.395091 2583 generic.go:356] "Generic (PLEG): container finished" podID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerID="f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91" exitCode=0 Jul 07 14:30:35.395356 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:35.395165 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" event={"ID":"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6","Type":"ContainerDied","Data":"f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91"} Jul 07 14:30:35.395776 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:35.395754 2583 scope.go:117] "RemoveContainer" containerID="f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91" Jul 07 14:30:35.396698 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:35.396673 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:30:35.396755 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:35.396740 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:30:35.396788 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:35.396770 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:30:36.306167 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:36.306134 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:36.401679 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:36.401644 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" event={"ID":"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6","Type":"ContainerStarted","Data":"77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc"} Jul 07 14:30:36.786393 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:36.786347 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:36.787611 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:36.787579 2583 patch_prober.go:28] interesting pod/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 07 14:30:36.787735 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:36.787630 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 07 14:30:37.786960 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:37.786922 2583 patch_prober.go:28] interesting pod/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 07 14:30:37.787371 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:37.786979 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 07 14:30:38.785915 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:38.785881 2583 patch_prober.go:28] interesting pod/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 07 14:30:38.786097 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:38.785940 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 07 14:30:39.786851 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:39.786814 2583 patch_prober.go:28] interesting pod/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 07 14:30:39.787274 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:39.786870 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 07 14:30:40.790369 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:40.790331 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:40.790783 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:40.790608 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:40.791180 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:40.791159 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:30:43.313142 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:30:43.313106 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:31:19.645921 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:31:19.645888 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:31:36.929491 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:31:36.929454 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:31:48.499964 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:31:48.499925 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:32:19.383049 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:19.382999 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7"] Jul 07 14:32:19.383541 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:19.383264 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" containerID="cri-o://8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106" gracePeriod=30 Jul 07 14:32:20.153355 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:20.153273 2583 patch_prober.go:28] interesting pod/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 14:32:20.153355 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:20.153331 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:32:23.212580 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:23.212541 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:32:24.643411 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.643342 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:32:24.722567 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.722529 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istiod-ca-cert\") pod \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " Jul 07 14:32:24.722751 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.722582 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfsdh\" (UniqueName: \"kubernetes.io/projected/a98e0c4a-5d02-4c9d-835e-2165f52f209d-kube-api-access-cfsdh\") pod \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " Jul 07 14:32:24.722751 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.722603 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-envoy\") pod \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " Jul 07 14:32:24.722751 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.722690 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-workload-socket\") pod \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " Jul 07 14:32:24.722751 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.722750 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-workload-certs\") pod \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " Jul 07 14:32:24.722976 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.722771 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-token\") pod \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " Jul 07 14:32:24.722976 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.722813 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-credential-socket\") pod \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " Jul 07 14:32:24.722976 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.722857 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-data\") pod \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " Jul 07 14:32:24.722976 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.722880 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-podinfo\") pod \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\" (UID: \"a98e0c4a-5d02-4c9d-835e-2165f52f209d\") " Jul 07 14:32:24.723175 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.723036 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a98e0c4a-5d02-4c9d-835e-2165f52f209d" (UID: "a98e0c4a-5d02-4c9d-835e-2165f52f209d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:32:24.723175 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.723115 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a98e0c4a-5d02-4c9d-835e-2165f52f209d" (UID: "a98e0c4a-5d02-4c9d-835e-2165f52f209d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:32:24.723175 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.723120 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a98e0c4a-5d02-4c9d-835e-2165f52f209d" (UID: "a98e0c4a-5d02-4c9d-835e-2165f52f209d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:32:24.723383 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.723200 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a98e0c4a-5d02-4c9d-835e-2165f52f209d" (UID: "a98e0c4a-5d02-4c9d-835e-2165f52f209d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:32:24.723383 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.723306 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istiod-ca-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:24.723383 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.723325 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-workload-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:24.723383 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.723338 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-credential-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:24.723868 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.723847 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-data" (OuterVolumeSpecName: "istio-data") pod "a98e0c4a-5d02-4c9d-835e-2165f52f209d" (UID: "a98e0c4a-5d02-4c9d-835e-2165f52f209d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:32:24.724870 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.724840 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a98e0c4a-5d02-4c9d-835e-2165f52f209d-kube-api-access-cfsdh" (OuterVolumeSpecName: "kube-api-access-cfsdh") pod "a98e0c4a-5d02-4c9d-835e-2165f52f209d" (UID: "a98e0c4a-5d02-4c9d-835e-2165f52f209d"). InnerVolumeSpecName "kube-api-access-cfsdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:32:24.724870 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.724851 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a98e0c4a-5d02-4c9d-835e-2165f52f209d" (UID: "a98e0c4a-5d02-4c9d-835e-2165f52f209d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:32:24.725309 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.725290 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a98e0c4a-5d02-4c9d-835e-2165f52f209d" (UID: "a98e0c4a-5d02-4c9d-835e-2165f52f209d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 14:32:24.725370 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.725307 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-token" (OuterVolumeSpecName: "istio-token") pod "a98e0c4a-5d02-4c9d-835e-2165f52f209d" (UID: "a98e0c4a-5d02-4c9d-835e-2165f52f209d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:32:24.824167 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.824122 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfsdh\" (UniqueName: \"kubernetes.io/projected/a98e0c4a-5d02-4c9d-835e-2165f52f209d-kube-api-access-cfsdh\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:24.824167 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.824160 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-envoy\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:24.824167 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.824172 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-workload-certs\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:24.824438 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.824183 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-token\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:24.824438 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.824194 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-data\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:24.824438 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.824204 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a98e0c4a-5d02-4c9d-835e-2165f52f209d-istio-podinfo\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:24.958808 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.958713 2583 generic.go:356] "Generic (PLEG): container finished" podID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerID="8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106" exitCode=0 Jul 07 14:32:24.958808 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.958767 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" Jul 07 14:32:24.958808 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.958791 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" event={"ID":"a98e0c4a-5d02-4c9d-835e-2165f52f209d","Type":"ContainerDied","Data":"8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106"} Jul 07 14:32:24.959077 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.958838 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7" event={"ID":"a98e0c4a-5d02-4c9d-835e-2165f52f209d","Type":"ContainerDied","Data":"17ba1b180d86b8bafad617515479eaf4f7ad2691aa3b08b3f8626d2c8bbdecca"} Jul 07 14:32:24.959077 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.958860 2583 scope.go:117] "RemoveContainer" containerID="8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106" Jul 07 14:32:24.968048 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.968029 2583 scope.go:117] "RemoveContainer" containerID="31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967" Jul 07 14:32:24.976592 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.976572 2583 scope.go:117] "RemoveContainer" containerID="8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106" Jul 07 14:32:24.976874 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:32:24.976855 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106\": container with ID starting with 8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106 not found: ID does not exist" containerID="8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106" Jul 07 14:32:24.976927 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.976883 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106"} err="failed to get container status \"8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106\": rpc error: code = NotFound desc = could not find container \"8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106\": container with ID starting with 8af3030ccbadbe1d6ff866d636d91a91e12df699832ade84560f41dd0fd3e106 not found: ID does not exist" Jul 07 14:32:24.976927 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.976905 2583 scope.go:117] "RemoveContainer" containerID="31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967" Jul 07 14:32:24.977128 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:32:24.977107 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967\": container with ID starting with 31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967 not found: ID does not exist" containerID="31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967" Jul 07 14:32:24.977169 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.977137 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967"} err="failed to get container status \"31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967\": rpc error: code = NotFound desc = could not find container \"31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967\": container with ID starting with 31ef55fcf321afe995cad66a1c548034a7013cad4056222e72555e38f8b53967 not found: ID does not exist" Jul 07 14:32:24.981445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.981422 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7"] Jul 07 14:32:24.987158 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:24.987137 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-8dd42e-openshift-default-65b7577959-5npb7"] Jul 07 14:32:26.426653 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:26.426615 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" path="/var/lib/kubelet/pods/a98e0c4a-5d02-4c9d-835e-2165f52f209d/volumes" Jul 07 14:32:26.546128 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:26.546087 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5"] Jul 07 14:32:26.546373 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:26.546335 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerName="istio-proxy" containerID="cri-o://77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc" gracePeriod=30 Jul 07 14:32:27.498510 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.498475 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn"] Jul 07 14:32:27.498866 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.498801 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" Jul 07 14:32:27.498866 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.498812 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" Jul 07 14:32:27.498942 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.498923 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" Jul 07 14:32:27.498942 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.498934 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" Jul 07 14:32:27.503238 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.503209 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.506975 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.506950 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-4fab5e-openshift-default-dockercfg-wcx76\"" Jul 07 14:32:27.518077 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.518054 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn"] Jul 07 14:32:27.549278 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.549250 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc51136a-609e-4331-a95b-852f281014f5-istio-podinfo\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.549411 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.549299 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-workload-socket\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.549411 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.549320 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-istio-envoy\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.549527 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.549407 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-istio-data\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.549527 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.549446 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc51136a-609e-4331-a95b-852f281014f5-istiod-ca-cert\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.549527 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.549482 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pxtm\" (UniqueName: \"kubernetes.io/projected/bc51136a-609e-4331-a95b-852f281014f5-kube-api-access-4pxtm\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.549654 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.549546 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-credential-socket\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.549654 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.549570 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-workload-certs\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.549654 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.549592 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc51136a-609e-4331-a95b-852f281014f5-istio-token\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.650275 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.650212 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc51136a-609e-4331-a95b-852f281014f5-istio-podinfo\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.650469 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.650286 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-workload-socket\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.650469 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.650304 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-istio-envoy\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.650469 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.650332 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-istio-data\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.650469 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.650350 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc51136a-609e-4331-a95b-852f281014f5-istiod-ca-cert\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.650469 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.650382 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pxtm\" (UniqueName: \"kubernetes.io/projected/bc51136a-609e-4331-a95b-852f281014f5-kube-api-access-4pxtm\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.650469 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.650443 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-credential-socket\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.650469 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.650465 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-workload-certs\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.650839 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.650484 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc51136a-609e-4331-a95b-852f281014f5-istio-token\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.650839 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.650727 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-workload-socket\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.651039 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.651009 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-istio-data\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.651110 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.651089 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-workload-certs\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.651178 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.651161 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-credential-socket\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.651816 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.651793 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc51136a-609e-4331-a95b-852f281014f5-istiod-ca-cert\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.652897 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.652876 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-istio-envoy\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.653195 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.653177 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc51136a-609e-4331-a95b-852f281014f5-istio-podinfo\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.664039 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.663991 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc51136a-609e-4331-a95b-852f281014f5-istio-token\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.666582 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.666536 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pxtm\" (UniqueName: \"kubernetes.io/projected/bc51136a-609e-4331-a95b-852f281014f5-kube-api-access-4pxtm\") pod \"e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.812590 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.812560 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:27.955534 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.955503 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn"] Jul 07 14:32:27.956646 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:32:27.956619 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc51136a_609e_4331_a95b_852f281014f5.slice/crio-b79f0c4550b2d2dd172591fc285a4e44f9560ba3fa18ef9e5a3c35facce07164 WatchSource:0}: Error finding container b79f0c4550b2d2dd172591fc285a4e44f9560ba3fa18ef9e5a3c35facce07164: Status 404 returned error can't find the container with id b79f0c4550b2d2dd172591fc285a4e44f9560ba3fa18ef9e5a3c35facce07164 Jul 07 14:32:27.958657 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.958626 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:32:27.958762 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.958700 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:32:27.958762 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.958746 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:32:27.976416 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:27.976390 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" event={"ID":"bc51136a-609e-4331-a95b-852f281014f5","Type":"ContainerStarted","Data":"b79f0c4550b2d2dd172591fc285a4e44f9560ba3fa18ef9e5a3c35facce07164"} Jul 07 14:32:28.982968 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:28.982932 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" event={"ID":"bc51136a-609e-4331-a95b-852f281014f5","Type":"ContainerStarted","Data":"e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c"} Jul 07 14:32:29.009207 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:29.009152 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" podStartSLOduration=2.009139295 podStartE2EDuration="2.009139295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:29.007647183 +0000 UTC m=+1981.181434758" watchObservedRunningTime="2026-07-07 14:32:29.009139295 +0000 UTC m=+1981.182926869" Jul 07 14:32:29.813263 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:29.813198 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:29.818140 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:29.818113 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:29.992370 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:29.992333 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:29.993352 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:29.993331 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:31.797557 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.797533 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:32:31.891445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891358 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-data\") pod \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " Jul 07 14:32:31.891445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891409 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-envoy\") pod \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " Jul 07 14:32:31.891445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891430 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istiod-ca-cert\") pod \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " Jul 07 14:32:31.891723 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891460 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-credential-socket\") pod \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " Jul 07 14:32:31.891723 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891476 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-workload-socket\") pod \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " Jul 07 14:32:31.891723 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891507 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbqgd\" (UniqueName: \"kubernetes.io/projected/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-kube-api-access-pbqgd\") pod \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " Jul 07 14:32:31.891723 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891540 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-token\") pod \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " Jul 07 14:32:31.891723 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891601 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-podinfo\") pod \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " Jul 07 14:32:31.891723 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891629 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-workload-certs\") pod \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\" (UID: \"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6\") " Jul 07 14:32:31.892022 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891758 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" (UID: "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:32:31.892022 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891871 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" (UID: "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:32:31.892022 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891882 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" (UID: "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:32:31.892022 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.891899 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-credential-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:31.892221 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.892082 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" (UID: "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:32:31.892221 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.892168 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" (UID: "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:32:31.893766 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.893742 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-kube-api-access-pbqgd" (OuterVolumeSpecName: "kube-api-access-pbqgd") pod "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" (UID: "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6"). InnerVolumeSpecName "kube-api-access-pbqgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:32:31.893896 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.893874 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" (UID: "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:32:31.894041 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.894025 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" (UID: "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 14:32:31.894079 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.894041 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" (UID: "83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:32:31.992774 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.992734 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-data\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:31.992774 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.992768 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-envoy\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:31.992774 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.992780 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istiod-ca-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:31.992999 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.992791 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-workload-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:31.992999 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.992803 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbqgd\" (UniqueName: \"kubernetes.io/projected/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-kube-api-access-pbqgd\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:31.992999 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.992815 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-token\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:31.992999 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.992826 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-istio-podinfo\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:31.992999 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:31.992836 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6-workload-certs\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:32:32.003266 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.003217 2583 generic.go:356] "Generic (PLEG): container finished" podID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerID="77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc" exitCode=0 Jul 07 14:32:32.003374 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.003286 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" Jul 07 14:32:32.003374 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.003332 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" event={"ID":"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6","Type":"ContainerDied","Data":"77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc"} Jul 07 14:32:32.003460 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.003393 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5" event={"ID":"83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6","Type":"ContainerDied","Data":"e12e6303d2e45c974be18008516d5a7e4d4744fbcc7b8c165d689c5a70b33f3c"} Jul 07 14:32:32.003460 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.003425 2583 scope.go:117] "RemoveContainer" containerID="77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc" Jul 07 14:32:32.012355 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.012340 2583 scope.go:117] "RemoveContainer" containerID="f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91" Jul 07 14:32:32.019989 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.019970 2583 scope.go:117] "RemoveContainer" containerID="77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc" Jul 07 14:32:32.020273 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:32:32.020246 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc\": container with ID starting with 77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc not found: ID does not exist" containerID="77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc" Jul 07 14:32:32.020319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.020285 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc"} err="failed to get container status \"77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc\": rpc error: code = NotFound desc = could not find container \"77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc\": container with ID starting with 77521258d48d0a5581c96b02c8f3382857ba5bced5fcb72ebe9e3045456254fc not found: ID does not exist" Jul 07 14:32:32.020319 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.020309 2583 scope.go:117] "RemoveContainer" containerID="f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91" Jul 07 14:32:32.020556 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:32:32.020540 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91\": container with ID starting with f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91 not found: ID does not exist" containerID="f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91" Jul 07 14:32:32.020609 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.020559 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91"} err="failed to get container status \"f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91\": rpc error: code = NotFound desc = could not find container \"f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91\": container with ID starting with f2f422057700dad2dbfeff18eaa965c4b2bd0a0e391b6492cfab662687d46c91 not found: ID does not exist" Jul 07 14:32:32.027128 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.027107 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5"] Jul 07 14:32:32.031638 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.031618 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-b9e929-openshift-default-786844f45f-4nvb5"] Jul 07 14:32:32.426454 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:32.426421 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" path="/var/lib/kubelet/pods/83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6/volumes" Jul 07 14:32:35.698518 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:35.698482 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:32:36.302338 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.302306 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww"] Jul 07 14:32:36.302647 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.302634 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerName="istio-proxy" Jul 07 14:32:36.302743 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.302649 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerName="istio-proxy" Jul 07 14:32:36.302743 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.302662 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" Jul 07 14:32:36.302743 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.302671 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a98e0c4a-5d02-4c9d-835e-2165f52f209d" containerName="istio-proxy" Jul 07 14:32:36.302743 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.302681 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerName="istio-proxy" Jul 07 14:32:36.302743 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.302689 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerName="istio-proxy" Jul 07 14:32:36.302992 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.302788 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerName="istio-proxy" Jul 07 14:32:36.302992 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.302805 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="83bcdeac-36a8-4ecc-a05a-7a3c0147e3c6" containerName="istio-proxy" Jul 07 14:32:36.307477 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.307458 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.310668 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.310649 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-8b95cf-openshift-default-dockercfg-jvnz8\"" Jul 07 14:32:36.320325 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.320302 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww"] Jul 07 14:32:36.434367 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.434335 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8931857-0455-4410-b3ac-3799c6c06255-istiod-ca-cert\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.434533 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.434387 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8931857-0455-4410-b3ac-3799c6c06255-istio-token\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.434533 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.434414 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lrjh\" (UniqueName: \"kubernetes.io/projected/b8931857-0455-4410-b3ac-3799c6c06255-kube-api-access-2lrjh\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.434533 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.434446 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-istio-data\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.434533 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.434473 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8931857-0455-4410-b3ac-3799c6c06255-istio-podinfo\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.434729 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.434555 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-credential-socket\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.434729 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.434608 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-istio-envoy\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.434729 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.434688 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-workload-socket\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.434873 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.434749 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-workload-certs\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.535780 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.535740 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-workload-certs\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536043 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.535791 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8931857-0455-4410-b3ac-3799c6c06255-istiod-ca-cert\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536043 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.535815 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8931857-0455-4410-b3ac-3799c6c06255-istio-token\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536043 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.535831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lrjh\" (UniqueName: \"kubernetes.io/projected/b8931857-0455-4410-b3ac-3799c6c06255-kube-api-access-2lrjh\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536043 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.535859 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-istio-data\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536043 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.535884 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8931857-0455-4410-b3ac-3799c6c06255-istio-podinfo\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536415 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.536066 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-credential-socket\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536415 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.536164 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-istio-envoy\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536415 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.536212 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-workload-socket\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536415 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.536257 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-workload-certs\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536415 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.536294 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-istio-data\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536619 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.536443 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-credential-socket\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536619 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.536565 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-workload-socket\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.536809 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.536793 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8931857-0455-4410-b3ac-3799c6c06255-istiod-ca-cert\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.538346 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.538304 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-istio-envoy\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.538508 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.538491 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8931857-0455-4410-b3ac-3799c6c06255-istio-podinfo\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.548412 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.548389 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lrjh\" (UniqueName: \"kubernetes.io/projected/b8931857-0455-4410-b3ac-3799c6c06255-kube-api-access-2lrjh\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.558420 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.558357 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8931857-0455-4410-b3ac-3799c6c06255-istio-token\") pod \"e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.617591 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.617553 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:36.756132 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.756101 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww"] Jul 07 14:32:36.757173 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:32:36.757146 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8931857_0455_4410_b3ac_3799c6c06255.slice/crio-1284c04494b3bb08986f886c1e9506bc6d38dd384fbab5d0b3fd856d4a6ad391 WatchSource:0}: Error finding container 1284c04494b3bb08986f886c1e9506bc6d38dd384fbab5d0b3fd856d4a6ad391: Status 404 returned error can't find the container with id 1284c04494b3bb08986f886c1e9506bc6d38dd384fbab5d0b3fd856d4a6ad391 Jul 07 14:32:36.759110 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.759081 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:32:36.759180 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.759160 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:32:36.759215 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:36.759186 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:32:37.032874 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:37.032824 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" event={"ID":"b8931857-0455-4410-b3ac-3799c6c06255","Type":"ContainerStarted","Data":"a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7"} Jul 07 14:32:37.033215 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:37.033190 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" event={"ID":"b8931857-0455-4410-b3ac-3799c6c06255","Type":"ContainerStarted","Data":"1284c04494b3bb08986f886c1e9506bc6d38dd384fbab5d0b3fd856d4a6ad391"} Jul 07 14:32:37.618354 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:37.618305 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:37.623427 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:37.623403 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:37.651378 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:37.651296 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" podStartSLOduration=1.651273535 podStartE2EDuration="1.651273535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:37.058737686 +0000 UTC m=+1989.232525263" watchObservedRunningTime="2026-07-07 14:32:37.651273535 +0000 UTC m=+1989.825061112" Jul 07 14:32:38.040986 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:38.040948 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:38.046005 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:38.045978 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:44.080020 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:44.079980 2583 generic.go:356] "Generic (PLEG): container finished" podID="bc51136a-609e-4331-a95b-852f281014f5" containerID="e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c" exitCode=0 Jul 07 14:32:44.080523 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:44.080061 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" event={"ID":"bc51136a-609e-4331-a95b-852f281014f5","Type":"ContainerDied","Data":"e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c"} Jul 07 14:32:44.080523 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:44.080449 2583 scope.go:117] "RemoveContainer" containerID="e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c" Jul 07 14:32:44.081425 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:44.081400 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:32:44.081524 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:44.081462 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:32:44.081524 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:44.081492 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:32:44.991074 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:44.991030 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:32:44.995296 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:44.995267 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:45.086744 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:45.086707 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" event={"ID":"bc51136a-609e-4331-a95b-852f281014f5","Type":"ContainerStarted","Data":"d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34"} Jul 07 14:32:45.813124 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:45.813092 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:45.814365 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:45.814335 2583 patch_prober.go:28] interesting pod/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 07 14:32:45.814485 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:45.814415 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" podUID="bc51136a-609e-4331-a95b-852f281014f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 07 14:32:46.813605 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:46.813569 2583 patch_prober.go:28] interesting pod/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 07 14:32:46.814199 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:46.814165 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" podUID="bc51136a-609e-4331-a95b-852f281014f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 07 14:32:47.812974 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:47.812937 2583 patch_prober.go:28] interesting pod/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 07 14:32:47.813157 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:47.812992 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" podUID="bc51136a-609e-4331-a95b-852f281014f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 07 14:32:48.812928 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:48.812901 2583 patch_prober.go:28] interesting pod/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 07 14:32:48.813447 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:48.813069 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" podUID="bc51136a-609e-4331-a95b-852f281014f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 07 14:32:49.817584 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:49.817553 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:49.818097 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:49.817813 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:49.818438 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:49.818420 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:32:53.041852 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:53.041817 2583 patch_prober.go:28] interesting pod/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 07 14:32:53.042273 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:53.041880 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" podUID="b8931857-0455-4410-b3ac-3799c6c06255" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 07 14:32:53.131292 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:53.131261 2583 generic.go:356] "Generic (PLEG): container finished" podID="b8931857-0455-4410-b3ac-3799c6c06255" containerID="a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7" exitCode=0 Jul 07 14:32:53.131464 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:53.131329 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" event={"ID":"b8931857-0455-4410-b3ac-3799c6c06255","Type":"ContainerDied","Data":"a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7"} Jul 07 14:32:53.131773 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:53.131751 2583 scope.go:117] "RemoveContainer" containerID="a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7" Jul 07 14:32:53.132729 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:53.132706 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:32:53.132795 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:53.132776 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:32:53.132833 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:53.132807 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:32:54.141980 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:54.141944 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" event={"ID":"b8931857-0455-4410-b3ac-3799c6c06255","Type":"ContainerStarted","Data":"b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2"} Jul 07 14:32:54.618375 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:54.618343 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:54.618586 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:54.618564 2583 patch_prober.go:28] interesting pod/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 07 14:32:54.618640 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:54.618622 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" podUID="b8931857-0455-4410-b3ac-3799c6c06255" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 07 14:32:55.618943 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:55.618905 2583 patch_prober.go:28] interesting pod/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 07 14:32:55.619387 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:55.618960 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" podUID="b8931857-0455-4410-b3ac-3799c6c06255" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 07 14:32:56.298407 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:56.298371 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:32:56.618189 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:56.618101 2583 patch_prober.go:28] interesting pod/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 07 14:32:56.618189 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:56.618157 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" podUID="b8931857-0455-4410-b3ac-3799c6c06255" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 07 14:32:57.618274 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:57.618214 2583 patch_prober.go:28] interesting pod/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 07 14:32:57.618661 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:57.618293 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" podUID="b8931857-0455-4410-b3ac-3799c6c06255" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 07 14:32:58.419086 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:58.419045 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn"] Jul 07 14:32:58.419338 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:58.419314 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" podUID="bc51136a-609e-4331-a95b-852f281014f5" containerName="istio-proxy" containerID="cri-o://d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34" gracePeriod=30 Jul 07 14:32:58.621905 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:58.621873 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:58.622352 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:58.622119 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:32:58.622979 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:32:58.622959 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:33:03.704262 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.704240 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:33:03.803418 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.803370 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-istio-data\") pod \"bc51136a-609e-4331-a95b-852f281014f5\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " Jul 07 14:33:03.803623 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.803440 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc51136a-609e-4331-a95b-852f281014f5-istio-token\") pod \"bc51136a-609e-4331-a95b-852f281014f5\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " Jul 07 14:33:03.803623 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.803520 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc51136a-609e-4331-a95b-852f281014f5-istio-podinfo\") pod \"bc51136a-609e-4331-a95b-852f281014f5\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " Jul 07 14:33:03.803623 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.803548 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-workload-socket\") pod \"bc51136a-609e-4331-a95b-852f281014f5\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " Jul 07 14:33:03.803623 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.803570 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-istio-envoy\") pod \"bc51136a-609e-4331-a95b-852f281014f5\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " Jul 07 14:33:03.803623 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.803600 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-workload-certs\") pod \"bc51136a-609e-4331-a95b-852f281014f5\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " Jul 07 14:33:03.803934 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.803622 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-credential-socket\") pod \"bc51136a-609e-4331-a95b-852f281014f5\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " Jul 07 14:33:03.803934 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.803677 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pxtm\" (UniqueName: \"kubernetes.io/projected/bc51136a-609e-4331-a95b-852f281014f5-kube-api-access-4pxtm\") pod \"bc51136a-609e-4331-a95b-852f281014f5\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " Jul 07 14:33:03.803934 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.803710 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc51136a-609e-4331-a95b-852f281014f5-istiod-ca-cert\") pod \"bc51136a-609e-4331-a95b-852f281014f5\" (UID: \"bc51136a-609e-4331-a95b-852f281014f5\") " Jul 07 14:33:03.803934 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.803855 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc51136a-609e-4331-a95b-852f281014f5" (UID: "bc51136a-609e-4331-a95b-852f281014f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:03.804143 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.804042 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-credential-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:03.804143 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.803879 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc51136a-609e-4331-a95b-852f281014f5" (UID: "bc51136a-609e-4331-a95b-852f281014f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:03.804291 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.804138 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc51136a-609e-4331-a95b-852f281014f5" (UID: "bc51136a-609e-4331-a95b-852f281014f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:03.804344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.804289 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc51136a-609e-4331-a95b-852f281014f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc51136a-609e-4331-a95b-852f281014f5" (UID: "bc51136a-609e-4331-a95b-852f281014f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:33:03.804344 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.804299 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc51136a-609e-4331-a95b-852f281014f5" (UID: "bc51136a-609e-4331-a95b-852f281014f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:03.806291 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.806192 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc51136a-609e-4331-a95b-852f281014f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc51136a-609e-4331-a95b-852f281014f5" (UID: "bc51136a-609e-4331-a95b-852f281014f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:33:03.806291 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.806209 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc51136a-609e-4331-a95b-852f281014f5-kube-api-access-4pxtm" (OuterVolumeSpecName: "kube-api-access-4pxtm") pod "bc51136a-609e-4331-a95b-852f281014f5" (UID: "bc51136a-609e-4331-a95b-852f281014f5"). InnerVolumeSpecName "kube-api-access-4pxtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:33:03.806291 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.806263 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc51136a-609e-4331-a95b-852f281014f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc51136a-609e-4331-a95b-852f281014f5" (UID: "bc51136a-609e-4331-a95b-852f281014f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 14:33:03.806465 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.806295 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc51136a-609e-4331-a95b-852f281014f5" (UID: "bc51136a-609e-4331-a95b-852f281014f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:03.905407 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.905369 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc51136a-609e-4331-a95b-852f281014f5-istio-podinfo\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:03.905407 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.905399 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-workload-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:03.905407 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.905412 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-istio-envoy\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:03.905641 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.905424 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-workload-certs\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:03.905641 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.905434 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pxtm\" (UniqueName: \"kubernetes.io/projected/bc51136a-609e-4331-a95b-852f281014f5-kube-api-access-4pxtm\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:03.905641 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.905447 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc51136a-609e-4331-a95b-852f281014f5-istiod-ca-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:03.905641 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.905459 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc51136a-609e-4331-a95b-852f281014f5-istio-data\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:03.905641 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:03.905470 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc51136a-609e-4331-a95b-852f281014f5-istio-token\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:04.199142 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.199107 2583 generic.go:356] "Generic (PLEG): container finished" podID="bc51136a-609e-4331-a95b-852f281014f5" containerID="d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34" exitCode=0 Jul 07 14:33:04.199322 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.199155 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" Jul 07 14:33:04.199322 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.199172 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" event={"ID":"bc51136a-609e-4331-a95b-852f281014f5","Type":"ContainerDied","Data":"d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34"} Jul 07 14:33:04.199322 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.199221 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn" event={"ID":"bc51136a-609e-4331-a95b-852f281014f5","Type":"ContainerDied","Data":"b79f0c4550b2d2dd172591fc285a4e44f9560ba3fa18ef9e5a3c35facce07164"} Jul 07 14:33:04.199322 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.199250 2583 scope.go:117] "RemoveContainer" containerID="d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34" Jul 07 14:33:04.208676 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.208662 2583 scope.go:117] "RemoveContainer" containerID="e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c" Jul 07 14:33:04.216452 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.216434 2583 scope.go:117] "RemoveContainer" containerID="d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34" Jul 07 14:33:04.216724 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:33:04.216709 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34\": container with ID starting with d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34 not found: ID does not exist" containerID="d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34" Jul 07 14:33:04.216783 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.216731 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34"} err="failed to get container status \"d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34\": rpc error: code = NotFound desc = could not find container \"d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34\": container with ID starting with d6791b2da5e3f45816af40e44623148c7fb01d638ab4d29b6eed3b989af1da34 not found: ID does not exist" Jul 07 14:33:04.216783 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.216747 2583 scope.go:117] "RemoveContainer" containerID="e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c" Jul 07 14:33:04.216986 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:33:04.216967 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c\": container with ID starting with e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c not found: ID does not exist" containerID="e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c" Jul 07 14:33:04.217040 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.216994 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c"} err="failed to get container status \"e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c\": rpc error: code = NotFound desc = could not find container \"e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c\": container with ID starting with e817bb6ad7724b0101eab1f0112f169709ae2b6911a4d0873e9171d86bc1942c not found: ID does not exist" Jul 07 14:33:04.222893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.222871 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn"] Jul 07 14:33:04.226933 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.226912 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-4fab5e-openshift-default-6877d848f7-rbdkn"] Jul 07 14:33:04.425852 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:04.425819 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc51136a-609e-4331-a95b-852f281014f5" path="/var/lib/kubelet/pods/bc51136a-609e-4331-a95b-852f281014f5/volumes" Jul 07 14:33:05.548164 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:05.548133 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww"] Jul 07 14:33:05.548524 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:05.548349 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" podUID="b8931857-0455-4410-b3ac-3799c6c06255" containerName="istio-proxy" containerID="cri-o://b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2" gracePeriod=30 Jul 07 14:33:06.475561 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.475528 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm"] Jul 07 14:33:06.475860 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.475847 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc51136a-609e-4331-a95b-852f281014f5" containerName="istio-proxy" Jul 07 14:33:06.475860 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.475860 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc51136a-609e-4331-a95b-852f281014f5" containerName="istio-proxy" Jul 07 14:33:06.475985 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.475869 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc51136a-609e-4331-a95b-852f281014f5" containerName="istio-proxy" Jul 07 14:33:06.475985 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.475875 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc51136a-609e-4331-a95b-852f281014f5" containerName="istio-proxy" Jul 07 14:33:06.475985 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.475931 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc51136a-609e-4331-a95b-852f281014f5" containerName="istio-proxy" Jul 07 14:33:06.478719 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.478696 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.481548 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.481531 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0b992a-openshift-default-dockercfg-6sswh\"" Jul 07 14:33:06.499996 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.497449 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm"] Jul 07 14:33:06.526348 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.526319 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-podinfo\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.526470 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.526390 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-workload-socket\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.526470 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.526417 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-workload-certs\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.526470 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.526440 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istiod-ca-cert\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.526470 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.526464 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6rgm\" (UniqueName: \"kubernetes.io/projected/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-kube-api-access-n6rgm\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.526664 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.526496 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-data\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.526664 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.526519 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-token\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.526664 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.526557 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-credential-socket\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.526824 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.526796 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-envoy\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.628085 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628052 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-envoy\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.628085 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628094 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-podinfo\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.628617 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628116 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-workload-socket\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.628617 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628138 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-workload-certs\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.628617 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628169 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istiod-ca-cert\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.628617 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628201 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6rgm\" (UniqueName: \"kubernetes.io/projected/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-kube-api-access-n6rgm\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.628617 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628366 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-data\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.628617 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628409 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-token\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.628617 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628454 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-credential-socket\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.628617 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628579 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-workload-certs\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.628934 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628681 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-workload-socket\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.628934 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628916 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-credential-socket\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.629030 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.628985 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-data\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.629139 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.629120 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istiod-ca-cert\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.630343 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.630315 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-envoy\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.630606 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.630587 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-podinfo\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.636576 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.636547 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-token\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.636990 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.636973 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6rgm\" (UniqueName: \"kubernetes.io/projected/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-kube-api-access-n6rgm\") pod \"e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.789702 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.789683 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:06.927450 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.927425 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm"] Jul 07 14:33:06.928444 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:33:06.928420 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5995860d_88f8_42f4_a8ca_2d0d3070c6dc.slice/crio-de5140a08631fe447c7ed3217eeffdb0cd129402303afe1abe14f81d0b34c08d WatchSource:0}: Error finding container de5140a08631fe447c7ed3217eeffdb0cd129402303afe1abe14f81d0b34c08d: Status 404 returned error can't find the container with id de5140a08631fe447c7ed3217eeffdb0cd129402303afe1abe14f81d0b34c08d Jul 07 14:33:06.931181 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.931143 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:33:06.931279 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.931258 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:33:06.931322 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:06.931305 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:33:07.217433 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:07.217344 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" event={"ID":"5995860d-88f8-42f4-a8ca-2d0d3070c6dc","Type":"ContainerStarted","Data":"96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6"} Jul 07 14:33:07.217433 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:07.217408 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" event={"ID":"5995860d-88f8-42f4-a8ca-2d0d3070c6dc","Type":"ContainerStarted","Data":"de5140a08631fe447c7ed3217eeffdb0cd129402303afe1abe14f81d0b34c08d"} Jul 07 14:33:07.239658 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:07.239612 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" podStartSLOduration=1.239598172 podStartE2EDuration="1.239598172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:33:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:07.237302696 +0000 UTC m=+2019.411090271" watchObservedRunningTime="2026-07-07 14:33:07.239598172 +0000 UTC m=+2019.413385746" Jul 07 14:33:07.790779 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:07.790746 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:07.795775 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:07.795751 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:08.092619 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:08.092545 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:33:08.222216 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:08.222189 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:08.223195 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:08.223177 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:10.798065 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.798042 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:33:10.866502 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.866414 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lrjh\" (UniqueName: \"kubernetes.io/projected/b8931857-0455-4410-b3ac-3799c6c06255-kube-api-access-2lrjh\") pod \"b8931857-0455-4410-b3ac-3799c6c06255\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " Jul 07 14:33:10.866502 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.866491 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-istio-data\") pod \"b8931857-0455-4410-b3ac-3799c6c06255\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " Jul 07 14:33:10.866708 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.866519 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-credential-socket\") pod \"b8931857-0455-4410-b3ac-3799c6c06255\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " Jul 07 14:33:10.866708 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.866569 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-workload-certs\") pod \"b8931857-0455-4410-b3ac-3799c6c06255\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " Jul 07 14:33:10.866708 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.866605 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8931857-0455-4410-b3ac-3799c6c06255-istio-podinfo\") pod \"b8931857-0455-4410-b3ac-3799c6c06255\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " Jul 07 14:33:10.866708 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.866628 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-istio-envoy\") pod \"b8931857-0455-4410-b3ac-3799c6c06255\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " Jul 07 14:33:10.866708 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.866669 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8931857-0455-4410-b3ac-3799c6c06255-istiod-ca-cert\") pod \"b8931857-0455-4410-b3ac-3799c6c06255\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " Jul 07 14:33:10.866954 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.866714 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8931857-0455-4410-b3ac-3799c6c06255-istio-token\") pod \"b8931857-0455-4410-b3ac-3799c6c06255\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " Jul 07 14:33:10.866954 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.866752 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-workload-socket\") pod \"b8931857-0455-4410-b3ac-3799c6c06255\" (UID: \"b8931857-0455-4410-b3ac-3799c6c06255\") " Jul 07 14:33:10.866954 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.866817 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8931857-0455-4410-b3ac-3799c6c06255" (UID: "b8931857-0455-4410-b3ac-3799c6c06255"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:10.867109 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.867024 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8931857-0455-4410-b3ac-3799c6c06255" (UID: "b8931857-0455-4410-b3ac-3799c6c06255"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:10.867164 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.867106 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-credential-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:10.867383 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.867349 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8931857-0455-4410-b3ac-3799c6c06255-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8931857-0455-4410-b3ac-3799c6c06255" (UID: "b8931857-0455-4410-b3ac-3799c6c06255"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:33:10.867507 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.867425 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8931857-0455-4410-b3ac-3799c6c06255" (UID: "b8931857-0455-4410-b3ac-3799c6c06255"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:10.867628 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.867603 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8931857-0455-4410-b3ac-3799c6c06255" (UID: "b8931857-0455-4410-b3ac-3799c6c06255"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:10.868889 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.868865 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8931857-0455-4410-b3ac-3799c6c06255-kube-api-access-2lrjh" (OuterVolumeSpecName: "kube-api-access-2lrjh") pod "b8931857-0455-4410-b3ac-3799c6c06255" (UID: "b8931857-0455-4410-b3ac-3799c6c06255"). InnerVolumeSpecName "kube-api-access-2lrjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:33:10.869002 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.868910 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8931857-0455-4410-b3ac-3799c6c06255" (UID: "b8931857-0455-4410-b3ac-3799c6c06255"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:33:10.869089 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.869009 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8931857-0455-4410-b3ac-3799c6c06255-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8931857-0455-4410-b3ac-3799c6c06255" (UID: "b8931857-0455-4410-b3ac-3799c6c06255"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 14:33:10.869089 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.869040 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8931857-0455-4410-b3ac-3799c6c06255-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8931857-0455-4410-b3ac-3799c6c06255" (UID: "b8931857-0455-4410-b3ac-3799c6c06255"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:33:10.968384 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.968354 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8931857-0455-4410-b3ac-3799c6c06255-istio-token\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:10.968384 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.968381 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-workload-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:10.968581 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.968391 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lrjh\" (UniqueName: \"kubernetes.io/projected/b8931857-0455-4410-b3ac-3799c6c06255-kube-api-access-2lrjh\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:10.968581 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.968400 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-istio-data\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:10.968581 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.968409 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-workload-certs\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:10.968581 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.968416 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8931857-0455-4410-b3ac-3799c6c06255-istio-podinfo\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:10.968581 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.968424 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8931857-0455-4410-b3ac-3799c6c06255-istio-envoy\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:10.968581 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:10.968431 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8931857-0455-4410-b3ac-3799c6c06255-istiod-ca-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:33:11.240934 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:11.240846 2583 generic.go:356] "Generic (PLEG): container finished" podID="b8931857-0455-4410-b3ac-3799c6c06255" containerID="b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2" exitCode=0 Jul 07 14:33:11.240934 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:11.240889 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" Jul 07 14:33:11.241115 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:11.240930 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" event={"ID":"b8931857-0455-4410-b3ac-3799c6c06255","Type":"ContainerDied","Data":"b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2"} Jul 07 14:33:11.241115 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:11.240979 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww" event={"ID":"b8931857-0455-4410-b3ac-3799c6c06255","Type":"ContainerDied","Data":"1284c04494b3bb08986f886c1e9506bc6d38dd384fbab5d0b3fd856d4a6ad391"} Jul 07 14:33:11.241115 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:11.241004 2583 scope.go:117] "RemoveContainer" containerID="b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2" Jul 07 14:33:11.249959 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:11.249943 2583 scope.go:117] "RemoveContainer" containerID="a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7" Jul 07 14:33:11.257713 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:11.257696 2583 scope.go:117] "RemoveContainer" containerID="b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2" Jul 07 14:33:11.257980 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:33:11.257961 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2\": container with ID starting with b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2 not found: ID does not exist" containerID="b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2" Jul 07 14:33:11.258034 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:11.257988 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2"} err="failed to get container status \"b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2\": rpc error: code = NotFound desc = could not find container \"b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2\": container with ID starting with b631623aec2d4050edaafbdca8fbd3506b8a7831777e60ffc4eedcc22eb9aed2 not found: ID does not exist" Jul 07 14:33:11.258034 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:11.258007 2583 scope.go:117] "RemoveContainer" containerID="a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7" Jul 07 14:33:11.258327 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:33:11.258217 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7\": container with ID starting with a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7 not found: ID does not exist" containerID="a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7" Jul 07 14:33:11.258403 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:11.258335 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7"} err="failed to get container status \"a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7\": rpc error: code = NotFound desc = could not find container \"a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7\": container with ID starting with a5f66c71a04c8ba80c490a4cf624ae96e2f265dad5f7841dcfa55887825004b7 not found: ID does not exist" Jul 07 14:33:11.264584 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:11.264564 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww"] Jul 07 14:33:11.271549 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:11.271526 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-8b95cf-openshift-default-7cb6875c8c-46kww"] Jul 07 14:33:12.426971 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:12.426936 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8931857-0455-4410-b3ac-3799c6c06255" path="/var/lib/kubelet/pods/b8931857-0455-4410-b3ac-3799c6c06255/volumes" Jul 07 14:33:14.399653 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.399617 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f"] Jul 07 14:33:14.400035 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.399941 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8931857-0455-4410-b3ac-3799c6c06255" containerName="istio-proxy" Jul 07 14:33:14.400035 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.399951 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8931857-0455-4410-b3ac-3799c6c06255" containerName="istio-proxy" Jul 07 14:33:14.400035 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.399968 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8931857-0455-4410-b3ac-3799c6c06255" containerName="istio-proxy" Jul 07 14:33:14.400035 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.399973 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8931857-0455-4410-b3ac-3799c6c06255" containerName="istio-proxy" Jul 07 14:33:14.400194 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.400045 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8931857-0455-4410-b3ac-3799c6c06255" containerName="istio-proxy" Jul 07 14:33:14.400194 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.400056 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8931857-0455-4410-b3ac-3799c6c06255" containerName="istio-proxy" Jul 07 14:33:14.400194 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.400064 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc51136a-609e-4331-a95b-852f281014f5" containerName="istio-proxy" Jul 07 14:33:14.402866 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.402848 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.405902 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.405881 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-bb9591-openshift-default-dockercfg-82fsh\"" Jul 07 14:33:14.414410 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.414386 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f"] Jul 07 14:33:14.500311 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.500272 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-workload-socket\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.500463 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.500325 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-istio-envoy\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.500463 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.500344 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c534f13-3911-4fc6-a791-6951273bc259-istio-token\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.500463 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.500370 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c534f13-3911-4fc6-a791-6951273bc259-istio-podinfo\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.500463 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.500394 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c534f13-3911-4fc6-a791-6951273bc259-istiod-ca-cert\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.500463 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.500412 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-workload-certs\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.500463 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.500452 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-istio-data\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.500672 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.500470 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-credential-socket\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.500672 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.500494 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpkdx\" (UniqueName: \"kubernetes.io/projected/5c534f13-3911-4fc6-a791-6951273bc259-kube-api-access-dpkdx\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.601545 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.601507 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c534f13-3911-4fc6-a791-6951273bc259-istiod-ca-cert\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.601725 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.601560 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-workload-certs\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.601725 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.601604 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-istio-data\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.601725 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.601628 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-credential-socket\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.601725 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.601650 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpkdx\" (UniqueName: \"kubernetes.io/projected/5c534f13-3911-4fc6-a791-6951273bc259-kube-api-access-dpkdx\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.601947 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.601729 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-workload-socket\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.601947 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.601795 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-istio-envoy\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.601947 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.601816 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c534f13-3911-4fc6-a791-6951273bc259-istio-token\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.601947 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.601846 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c534f13-3911-4fc6-a791-6951273bc259-istio-podinfo\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.602710 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.602687 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-credential-socket\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.602912 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.602697 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-workload-socket\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.603246 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.603202 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-workload-certs\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.603929 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.603250 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-istio-data\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.604054 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.603805 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c534f13-3911-4fc6-a791-6951273bc259-istiod-ca-cert\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.604921 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.604894 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c534f13-3911-4fc6-a791-6951273bc259-istio-podinfo\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.605918 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.605895 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-istio-envoy\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.611927 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.611904 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpkdx\" (UniqueName: \"kubernetes.io/projected/5c534f13-3911-4fc6-a791-6951273bc259-kube-api-access-dpkdx\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.612328 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.612305 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c534f13-3911-4fc6-a791-6951273bc259-istio-token\") pod \"e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.713722 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.713616 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:14.852041 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.852012 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f"] Jul 07 14:33:14.854533 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:33:14.854500 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c534f13_3911_4fc6_a791_6951273bc259.slice/crio-403cd96a1b6191b2ae35525cc11392f736dfe33754747e44a6f39d755963182f WatchSource:0}: Error finding container 403cd96a1b6191b2ae35525cc11392f736dfe33754747e44a6f39d755963182f: Status 404 returned error can't find the container with id 403cd96a1b6191b2ae35525cc11392f736dfe33754747e44a6f39d755963182f Jul 07 14:33:14.857192 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.857157 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:33:14.857291 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.857261 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:33:14.857338 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:14.857308 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:33:15.270123 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:15.270089 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" event={"ID":"5c534f13-3911-4fc6-a791-6951273bc259","Type":"ContainerStarted","Data":"d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7"} Jul 07 14:33:15.270362 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:15.270143 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" event={"ID":"5c534f13-3911-4fc6-a791-6951273bc259","Type":"ContainerStarted","Data":"403cd96a1b6191b2ae35525cc11392f736dfe33754747e44a6f39d755963182f"} Jul 07 14:33:15.293282 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:15.293216 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" podStartSLOduration=1.293200906 podStartE2EDuration="1.293200906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:33:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:15.292399185 +0000 UTC m=+2027.466186791" watchObservedRunningTime="2026-07-07 14:33:15.293200906 +0000 UTC m=+2027.466988480" Jul 07 14:33:15.714705 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:15.714619 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:15.719563 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:15.719533 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:16.275620 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:16.275588 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:16.276517 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:16.276499 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:18.609034 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:18.609000 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:33:22.311204 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:22.311177 2583 generic.go:356] "Generic (PLEG): container finished" podID="5995860d-88f8-42f4-a8ca-2d0d3070c6dc" containerID="96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6" exitCode=0 Jul 07 14:33:22.311577 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:22.311258 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" event={"ID":"5995860d-88f8-42f4-a8ca-2d0d3070c6dc","Type":"ContainerDied","Data":"96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6"} Jul 07 14:33:22.311625 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:22.311582 2583 scope.go:117] "RemoveContainer" containerID="96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6" Jul 07 14:33:22.312524 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:22.312499 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:33:22.312593 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:22.312580 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:33:22.312634 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:22.312624 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:33:23.222302 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:23.222274 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:23.317837 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:23.317800 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" event={"ID":"5995860d-88f8-42f4-a8ca-2d0d3070c6dc","Type":"ContainerStarted","Data":"922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb"} Jul 07 14:33:23.790734 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:23.790700 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:23.791929 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:23.791894 2583 patch_prober.go:28] interesting pod/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 07 14:33:23.792060 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:23.791948 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" podUID="5995860d-88f8-42f4-a8ca-2d0d3070c6dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 07 14:33:24.790739 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:24.790699 2583 patch_prober.go:28] interesting pod/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 07 14:33:24.791126 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:24.790755 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" podUID="5995860d-88f8-42f4-a8ca-2d0d3070c6dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 07 14:33:25.791045 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:25.790995 2583 patch_prober.go:28] interesting pod/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 07 14:33:25.791558 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:25.791059 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" podUID="5995860d-88f8-42f4-a8ca-2d0d3070c6dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 07 14:33:26.790651 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:26.790620 2583 patch_prober.go:28] interesting pod/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 07 14:33:26.790882 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:26.790860 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" podUID="5995860d-88f8-42f4-a8ca-2d0d3070c6dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 07 14:33:27.794200 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:27.794172 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:27.794616 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:27.794458 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:27.795329 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:27.795313 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:33:27.906053 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:27.906025 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:33:31.276991 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:31.276953 2583 patch_prober.go:28] interesting pod/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 07 14:33:31.277409 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:31.277023 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" podUID="5c534f13-3911-4fc6-a791-6951273bc259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 07 14:33:31.364630 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:31.364602 2583 generic.go:356] "Generic (PLEG): container finished" podID="5c534f13-3911-4fc6-a791-6951273bc259" containerID="d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7" exitCode=0 Jul 07 14:33:31.364793 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:31.364677 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" event={"ID":"5c534f13-3911-4fc6-a791-6951273bc259","Type":"ContainerDied","Data":"d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7"} Jul 07 14:33:31.365076 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:31.365061 2583 scope.go:117] "RemoveContainer" containerID="d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7" Jul 07 14:33:31.366011 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:31.365986 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:33:31.366064 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:31.366053 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:33:31.366104 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:31.366082 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 14:33:32.371016 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:32.370984 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" event={"ID":"5c534f13-3911-4fc6-a791-6951273bc259","Type":"ContainerStarted","Data":"e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054"} Jul 07 14:33:32.714530 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:32.714434 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:32.714692 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:32.714673 2583 patch_prober.go:28] interesting pod/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 07 14:33:32.714740 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:32.714719 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" podUID="5c534f13-3911-4fc6-a791-6951273bc259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 07 14:33:33.714562 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:33.714523 2583 patch_prober.go:28] interesting pod/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 07 14:33:33.714946 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:33.714590 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" podUID="5c534f13-3911-4fc6-a791-6951273bc259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 07 14:33:34.714280 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:34.714220 2583 patch_prober.go:28] interesting pod/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 07 14:33:34.714458 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:34.714317 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" podUID="5c534f13-3911-4fc6-a791-6951273bc259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 07 14:33:35.714610 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:35.714573 2583 patch_prober.go:28] interesting pod/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 07 14:33:35.715009 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:35.714628 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" podUID="5c534f13-3911-4fc6-a791-6951273bc259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 07 14:33:36.718285 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:36.718259 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:36.718664 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:36.718522 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:36.719261 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:36.719244 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:33:39.003140 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:33:39.003106 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:34:12.794520 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:34:12.794434 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:34:38.801621 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:34:38.801585 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:34:57.111788 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:34:57.111756 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:35:11.497514 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:35:11.497479 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:35:29.996189 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:35:29.996106 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:35:46.095443 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:35:46.095411 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:35:59.893679 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:35:59.893640 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:36:13.593308 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:36:13.593273 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:36:29.007258 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:36:29.003445 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:37:00.603675 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:37:00.603586 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:37:18.706608 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:37:18.706571 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:37:35.494580 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:37:35.494538 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:37:48.303178 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:37:48.303144 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:38:02.828135 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:38:02.828098 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:38:53.400978 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:38:53.400940 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:39:11.210487 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:39:11.210450 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:39:25.805599 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:39:25.805560 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:39:39.401944 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:39:39.401913 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:40:13.561038 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:13.560953 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm"] Jul 07 14:40:13.561629 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:13.561174 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" podUID="5995860d-88f8-42f4-a8ca-2d0d3070c6dc" containerName="istio-proxy" containerID="cri-o://922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb" gracePeriod=30 Jul 07 14:40:17.257111 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:17.257070 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wd22v"] Jul 07 14:40:18.810415 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.810387 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:40:18.978932 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.978845 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-workload-certs\") pod \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " Jul 07 14:40:18.978932 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.978885 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-token\") pod \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " Jul 07 14:40:18.978932 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.978913 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-credential-socket\") pod \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " Jul 07 14:40:18.979217 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.978944 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-workload-socket\") pod \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " Jul 07 14:40:18.979217 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.978962 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istiod-ca-cert\") pod \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " Jul 07 14:40:18.979217 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.978976 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-envoy\") pod \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " Jul 07 14:40:18.979217 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.979000 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-podinfo\") pod \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " Jul 07 14:40:18.979217 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.979101 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-data\") pod \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " Jul 07 14:40:18.979217 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.979119 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6rgm\" (UniqueName: \"kubernetes.io/projected/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-kube-api-access-n6rgm\") pod \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\" (UID: \"5995860d-88f8-42f4-a8ca-2d0d3070c6dc\") " Jul 07 14:40:18.979217 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.979137 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5995860d-88f8-42f4-a8ca-2d0d3070c6dc" (UID: "5995860d-88f8-42f4-a8ca-2d0d3070c6dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:40:18.979672 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.979341 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5995860d-88f8-42f4-a8ca-2d0d3070c6dc" (UID: "5995860d-88f8-42f4-a8ca-2d0d3070c6dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:40:18.979672 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.979437 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-workload-certs\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:18.979672 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.979455 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-workload-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:18.979672 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.979494 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5995860d-88f8-42f4-a8ca-2d0d3070c6dc" (UID: "5995860d-88f8-42f4-a8ca-2d0d3070c6dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:40:18.979883 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.979703 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5995860d-88f8-42f4-a8ca-2d0d3070c6dc" (UID: "5995860d-88f8-42f4-a8ca-2d0d3070c6dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:40:18.980001 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.979981 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "5995860d-88f8-42f4-a8ca-2d0d3070c6dc" (UID: "5995860d-88f8-42f4-a8ca-2d0d3070c6dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:40:18.981360 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.981331 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5995860d-88f8-42f4-a8ca-2d0d3070c6dc" (UID: "5995860d-88f8-42f4-a8ca-2d0d3070c6dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 14:40:18.981479 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.981404 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-kube-api-access-n6rgm" (OuterVolumeSpecName: "kube-api-access-n6rgm") pod "5995860d-88f8-42f4-a8ca-2d0d3070c6dc" (UID: "5995860d-88f8-42f4-a8ca-2d0d3070c6dc"). InnerVolumeSpecName "kube-api-access-n6rgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:40:18.981601 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.981580 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "5995860d-88f8-42f4-a8ca-2d0d3070c6dc" (UID: "5995860d-88f8-42f4-a8ca-2d0d3070c6dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:40:18.981704 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:18.981688 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5995860d-88f8-42f4-a8ca-2d0d3070c6dc" (UID: "5995860d-88f8-42f4-a8ca-2d0d3070c6dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:40:19.080535 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.080496 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-token\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:19.080535 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.080527 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-credential-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:19.080535 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.080536 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istiod-ca-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:19.080535 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.080546 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-envoy\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:19.080804 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.080556 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-podinfo\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:19.080804 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.080563 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-istio-data\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:19.080804 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.080571 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6rgm\" (UniqueName: \"kubernetes.io/projected/5995860d-88f8-42f4-a8ca-2d0d3070c6dc-kube-api-access-n6rgm\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:19.434406 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.434371 2583 generic.go:356] "Generic (PLEG): container finished" podID="5995860d-88f8-42f4-a8ca-2d0d3070c6dc" containerID="922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb" exitCode=0 Jul 07 14:40:19.434605 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.434421 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" Jul 07 14:40:19.434605 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.434458 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" event={"ID":"5995860d-88f8-42f4-a8ca-2d0d3070c6dc","Type":"ContainerDied","Data":"922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb"} Jul 07 14:40:19.434605 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.434518 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm" event={"ID":"5995860d-88f8-42f4-a8ca-2d0d3070c6dc","Type":"ContainerDied","Data":"de5140a08631fe447c7ed3217eeffdb0cd129402303afe1abe14f81d0b34c08d"} Jul 07 14:40:19.434605 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.434551 2583 scope.go:117] "RemoveContainer" containerID="922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb" Jul 07 14:40:19.443764 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.443744 2583 scope.go:117] "RemoveContainer" containerID="96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6" Jul 07 14:40:19.452108 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.452089 2583 scope.go:117] "RemoveContainer" containerID="922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb" Jul 07 14:40:19.452382 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:40:19.452361 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb\": container with ID starting with 922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb not found: ID does not exist" containerID="922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb" Jul 07 14:40:19.452456 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.452391 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb"} err="failed to get container status \"922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb\": rpc error: code = NotFound desc = could not find container \"922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb\": container with ID starting with 922cc7594980c39715327ee62d1dad2935d72536da1542a691a4d270d7f762bb not found: ID does not exist" Jul 07 14:40:19.452456 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.452410 2583 scope.go:117] "RemoveContainer" containerID="96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6" Jul 07 14:40:19.452668 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:40:19.452650 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6\": container with ID starting with 96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6 not found: ID does not exist" containerID="96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6" Jul 07 14:40:19.452719 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.452673 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6"} err="failed to get container status \"96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6\": rpc error: code = NotFound desc = could not find container \"96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6\": container with ID starting with 96d9f96717083db3ed219595535ae2acd93ecfde161d10cdd6b0f67fccba24a6 not found: ID does not exist" Jul 07 14:40:19.457756 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.457732 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm"] Jul 07 14:40:19.462105 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:19.462081 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0b992a-openshift-default-869d974cbc-qnjpm"] Jul 07 14:40:20.427389 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:20.427359 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5995860d-88f8-42f4-a8ca-2d0d3070c6dc" path="/var/lib/kubelet/pods/5995860d-88f8-42f4-a8ca-2d0d3070c6dc/volumes" Jul 07 14:40:20.903168 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:20.903133 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f"] Jul 07 14:40:20.903422 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:20.903398 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" podUID="5c534f13-3911-4fc6-a791-6951273bc259" containerName="istio-proxy" containerID="cri-o://e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054" gracePeriod=30 Jul 07 14:40:21.721053 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:21.721020 2583 patch_prober.go:28] interesting pod/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 14:40:21.721434 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:21.721090 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" podUID="5c534f13-3911-4fc6-a791-6951273bc259" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:40:26.158269 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.158245 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:40:26.241324 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241255 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-istio-data\") pod \"5c534f13-3911-4fc6-a791-6951273bc259\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " Jul 07 14:40:26.241472 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241335 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c534f13-3911-4fc6-a791-6951273bc259-istiod-ca-cert\") pod \"5c534f13-3911-4fc6-a791-6951273bc259\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " Jul 07 14:40:26.241472 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241369 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c534f13-3911-4fc6-a791-6951273bc259-istio-token\") pod \"5c534f13-3911-4fc6-a791-6951273bc259\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " Jul 07 14:40:26.241472 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241396 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-workload-socket\") pod \"5c534f13-3911-4fc6-a791-6951273bc259\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " Jul 07 14:40:26.241472 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241449 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c534f13-3911-4fc6-a791-6951273bc259-istio-podinfo\") pod \"5c534f13-3911-4fc6-a791-6951273bc259\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " Jul 07 14:40:26.241691 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241474 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpkdx\" (UniqueName: \"kubernetes.io/projected/5c534f13-3911-4fc6-a791-6951273bc259-kube-api-access-dpkdx\") pod \"5c534f13-3911-4fc6-a791-6951273bc259\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " Jul 07 14:40:26.241691 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241510 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-istio-envoy\") pod \"5c534f13-3911-4fc6-a791-6951273bc259\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " Jul 07 14:40:26.241691 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241557 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-workload-certs\") pod \"5c534f13-3911-4fc6-a791-6951273bc259\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " Jul 07 14:40:26.241691 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241584 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-credential-socket\") pod \"5c534f13-3911-4fc6-a791-6951273bc259\" (UID: \"5c534f13-3911-4fc6-a791-6951273bc259\") " Jul 07 14:40:26.241929 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241680 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c534f13-3911-4fc6-a791-6951273bc259" (UID: "5c534f13-3911-4fc6-a791-6951273bc259"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:40:26.241929 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241848 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c534f13-3911-4fc6-a791-6951273bc259" (UID: "5c534f13-3911-4fc6-a791-6951273bc259"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:40:26.241929 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241865 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c534f13-3911-4fc6-a791-6951273bc259" (UID: "5c534f13-3911-4fc6-a791-6951273bc259"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:40:26.241929 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241874 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c534f13-3911-4fc6-a791-6951273bc259-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c534f13-3911-4fc6-a791-6951273bc259" (UID: "5c534f13-3911-4fc6-a791-6951273bc259"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:40:26.242134 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241975 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-workload-certs\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:26.242134 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.241993 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-credential-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:26.242134 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.242042 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c534f13-3911-4fc6-a791-6951273bc259-istiod-ca-cert\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:26.242134 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.242040 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c534f13-3911-4fc6-a791-6951273bc259" (UID: "5c534f13-3911-4fc6-a791-6951273bc259"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:40:26.242134 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.242055 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-workload-socket\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:26.243705 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.243685 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c534f13-3911-4fc6-a791-6951273bc259-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c534f13-3911-4fc6-a791-6951273bc259" (UID: "5c534f13-3911-4fc6-a791-6951273bc259"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:40:26.243919 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.243893 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c534f13-3911-4fc6-a791-6951273bc259-kube-api-access-dpkdx" (OuterVolumeSpecName: "kube-api-access-dpkdx") pod "5c534f13-3911-4fc6-a791-6951273bc259" (UID: "5c534f13-3911-4fc6-a791-6951273bc259"). InnerVolumeSpecName "kube-api-access-dpkdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:40:26.244080 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.244058 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c534f13-3911-4fc6-a791-6951273bc259" (UID: "5c534f13-3911-4fc6-a791-6951273bc259"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:40:26.244144 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.244058 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c534f13-3911-4fc6-a791-6951273bc259-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c534f13-3911-4fc6-a791-6951273bc259" (UID: "5c534f13-3911-4fc6-a791-6951273bc259"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 14:40:26.343317 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.343292 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-istio-data\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:26.343317 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.343316 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c534f13-3911-4fc6-a791-6951273bc259-istio-token\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:26.343448 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.343325 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c534f13-3911-4fc6-a791-6951273bc259-istio-podinfo\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:26.343448 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.343334 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpkdx\" (UniqueName: \"kubernetes.io/projected/5c534f13-3911-4fc6-a791-6951273bc259-kube-api-access-dpkdx\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:26.343448 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.343343 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c534f13-3911-4fc6-a791-6951273bc259-istio-envoy\") on node \"ip-10-0-136-167.ec2.internal\" DevicePath \"\"" Jul 07 14:40:26.470480 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.470450 2583 generic.go:356] "Generic (PLEG): container finished" podID="5c534f13-3911-4fc6-a791-6951273bc259" containerID="e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054" exitCode=0 Jul 07 14:40:26.470590 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.470499 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" Jul 07 14:40:26.470590 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.470493 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" event={"ID":"5c534f13-3911-4fc6-a791-6951273bc259","Type":"ContainerDied","Data":"e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054"} Jul 07 14:40:26.470708 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.470633 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f" event={"ID":"5c534f13-3911-4fc6-a791-6951273bc259","Type":"ContainerDied","Data":"403cd96a1b6191b2ae35525cc11392f736dfe33754747e44a6f39d755963182f"} Jul 07 14:40:26.470708 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.470671 2583 scope.go:117] "RemoveContainer" containerID="e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054" Jul 07 14:40:26.483564 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.483543 2583 scope.go:117] "RemoveContainer" containerID="d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7" Jul 07 14:40:26.491278 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.491264 2583 scope.go:117] "RemoveContainer" containerID="e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054" Jul 07 14:40:26.491536 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:40:26.491496 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054\": container with ID starting with e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054 not found: ID does not exist" containerID="e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054" Jul 07 14:40:26.491536 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.491521 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054"} err="failed to get container status \"e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054\": rpc error: code = NotFound desc = could not find container \"e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054\": container with ID starting with e9c1993f754e8a09fd533707c90fb1c2e3fa6e22354a50835c9bd1a549a5f054 not found: ID does not exist" Jul 07 14:40:26.491672 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.491543 2583 scope.go:117] "RemoveContainer" containerID="d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7" Jul 07 14:40:26.491798 ip-10-0-136-167 kubenswrapper[2583]: E0707 14:40:26.491779 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7\": container with ID starting with d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7 not found: ID does not exist" containerID="d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7" Jul 07 14:40:26.491844 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.491803 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7"} err="failed to get container status \"d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7\": rpc error: code = NotFound desc = could not find container \"d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7\": container with ID starting with d6081a349cf976dfd0ddd9b5099f3f850c0585a2e1f412389862e61a6626e3d7 not found: ID does not exist" Jul 07 14:40:26.495538 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.495517 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f"] Jul 07 14:40:26.499893 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:26.499872 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-bb9591-openshift-default-5544b56595-7cl9f"] Jul 07 14:40:27.185188 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:27.185158 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723910-v4m4x_2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e/cleanup/0.log" Jul 07 14:40:27.823300 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:27.823271 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d498b796-q9vkg_8d60e77a-5d16-452c-aa5e-6adb2d68ff3c/copy-manifests/0.log" Jul 07 14:40:27.831771 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:27.831748 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d498b796-q9vkg_8d60e77a-5d16-452c-aa5e-6adb2d68ff3c/manager/0.log" Jul 07 14:40:28.427347 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:28.427318 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c534f13-3911-4fc6-a791-6951273bc259" path="/var/lib/kubelet/pods/5c534f13-3911-4fc6-a791-6951273bc259/volumes" Jul 07 14:40:28.894039 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:28.894005 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq_1a329b74-8df1-468a-b52d-382e69a7c7a5/util/0.log" Jul 07 14:40:28.901138 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:28.901112 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq_1a329b74-8df1-468a-b52d-382e69a7c7a5/pull/0.log" Jul 07 14:40:28.907623 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:28.907597 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq_1a329b74-8df1-468a-b52d-382e69a7c7a5/extract/0.log" Jul 07 14:40:29.026731 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:29.026708 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts_0294c0eb-0a33-44dc-81d9-47a8c4976ad4/util/0.log" Jul 07 14:40:29.033460 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:29.033430 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts_0294c0eb-0a33-44dc-81d9-47a8c4976ad4/pull/0.log" Jul 07 14:40:29.039985 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:29.039970 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts_0294c0eb-0a33-44dc-81d9-47a8c4976ad4/extract/0.log" Jul 07 14:40:29.171561 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:29.171497 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l_8c94ed17-05a2-402b-b8f3-f1f629a41431/util/0.log" Jul 07 14:40:29.184182 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:29.184165 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l_8c94ed17-05a2-402b-b8f3-f1f629a41431/pull/0.log" Jul 07 14:40:29.199628 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:29.199606 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l_8c94ed17-05a2-402b-b8f3-f1f629a41431/extract/0.log" Jul 07 14:40:29.334603 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:29.334580 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8_38bfcd7a-f724-419e-8e3b-67cf2eb3b11f/extract/0.log" Jul 07 14:40:29.341664 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:29.341641 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8_38bfcd7a-f724-419e-8e3b-67cf2eb3b11f/util/0.log" Jul 07 14:40:29.353073 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:29.353054 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8_38bfcd7a-f724-419e-8e3b-67cf2eb3b11f/pull/0.log" Jul 07 14:40:30.286588 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:30.286559 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wd22v_e70ba20b-e21c-4aa5-ac37-355e71712ca7/limitador/0.log" Jul 07 14:40:30.808906 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:30.808859 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678zmqr6_092f4611-6943-4d62-b7e0-7e18ea270d57/istio-proxy/0.log" Jul 07 14:40:30.926124 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:30.926099 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-szr94_b483707a-b864-41c1-b8dc-d651806901a7/discovery/0.log" Jul 07 14:40:32.598825 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:32.598762 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-j76bs_8aa184cb-5e10-430a-8287-f599ef31bb11/main/0.log" Jul 07 14:40:40.623519 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:40.623488 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kkd6d_01865e08-26a6-463c-b42f-d466b8a23b34/global-pull-secret-syncer/0.log" Jul 07 14:40:40.772502 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:40.772470 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-swvbl_e53774d3-9199-4e60-9c05-d506c750eb57/konnectivity-agent/0.log" Jul 07 14:40:40.823275 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:40.823245 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-167.ec2.internal_684e505a654ab219cfa598f20931a3ab/haproxy/0.log" Jul 07 14:40:45.457237 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:45.457207 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq_1a329b74-8df1-468a-b52d-382e69a7c7a5/extract/0.log" Jul 07 14:40:45.484323 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:45.484298 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq_1a329b74-8df1-468a-b52d-382e69a7c7a5/util/0.log" Jul 07 14:40:45.506839 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:45.506819 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75962gpq_1a329b74-8df1-468a-b52d-382e69a7c7a5/pull/0.log" Jul 07 14:40:45.555161 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:45.555137 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts_0294c0eb-0a33-44dc-81d9-47a8c4976ad4/extract/0.log" Jul 07 14:40:45.579987 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:45.579963 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts_0294c0eb-0a33-44dc-81d9-47a8c4976ad4/util/0.log" Jul 07 14:40:45.605090 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:45.605070 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0txwts_0294c0eb-0a33-44dc-81d9-47a8c4976ad4/pull/0.log" Jul 07 14:40:45.653041 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:45.653022 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l_8c94ed17-05a2-402b-b8f3-f1f629a41431/extract/0.log" Jul 07 14:40:45.679869 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:45.679843 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l_8c94ed17-05a2-402b-b8f3-f1f629a41431/util/0.log" Jul 07 14:40:45.702863 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:45.702829 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735qp9l_8c94ed17-05a2-402b-b8f3-f1f629a41431/pull/0.log" Jul 07 14:40:45.734673 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:45.734577 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8_38bfcd7a-f724-419e-8e3b-67cf2eb3b11f/extract/0.log" Jul 07 14:40:45.770143 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:45.770126 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8_38bfcd7a-f724-419e-8e3b-67cf2eb3b11f/util/0.log" Jul 07 14:40:45.805617 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:45.805599 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19dxs8_38bfcd7a-f724-419e-8e3b-67cf2eb3b11f/pull/0.log" Jul 07 14:40:46.628795 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:46.628769 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wd22v_e70ba20b-e21c-4aa5-ac37-355e71712ca7/limitador/0.log" Jul 07 14:40:48.321311 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.321276 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0f18304-c567-435d-bbb6-6ba3a56b6c66/alertmanager/0.log" Jul 07 14:40:48.348311 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.348286 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0f18304-c567-435d-bbb6-6ba3a56b6c66/config-reloader/0.log" Jul 07 14:40:48.380539 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.380490 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0f18304-c567-435d-bbb6-6ba3a56b6c66/kube-rbac-proxy-web/0.log" Jul 07 14:40:48.407005 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.406964 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0f18304-c567-435d-bbb6-6ba3a56b6c66/kube-rbac-proxy/0.log" Jul 07 14:40:48.432764 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.432739 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0f18304-c567-435d-bbb6-6ba3a56b6c66/kube-rbac-proxy-metric/0.log" Jul 07 14:40:48.457677 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.457654 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0f18304-c567-435d-bbb6-6ba3a56b6c66/prom-label-proxy/0.log" Jul 07 14:40:48.482270 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.482248 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0f18304-c567-435d-bbb6-6ba3a56b6c66/init-config-reloader/0.log" Jul 07 14:40:48.572242 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.572162 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jlm5n_a9cfdd26-61bf-4b70-964a-58e73f9362cc/kube-state-metrics/0.log" Jul 07 14:40:48.591728 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.591707 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jlm5n_a9cfdd26-61bf-4b70-964a-58e73f9362cc/kube-rbac-proxy-main/0.log" Jul 07 14:40:48.620962 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.620936 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jlm5n_a9cfdd26-61bf-4b70-964a-58e73f9362cc/kube-rbac-proxy-self/0.log" Jul 07 14:40:48.652272 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.652248 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6699c57dc8-nwh6t_516c8155-59d9-484f-8c52-a77e6a4bf1ab/metrics-server/0.log" Jul 07 14:40:48.729862 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.729836 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4gsw5_fff9a581-0792-4744-b783-2276a817971a/node-exporter/0.log" Jul 07 14:40:48.755662 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.755637 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4gsw5_fff9a581-0792-4744-b783-2276a817971a/kube-rbac-proxy/0.log" Jul 07 14:40:48.783939 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:48.783919 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4gsw5_fff9a581-0792-4744-b783-2276a817971a/init-textfile/0.log" Jul 07 14:40:49.391442 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:49.391415 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b7dccf98b-bvj29_93c8b59c-8447-4518-a26a-f98869bda922/telemeter-client/0.log" Jul 07 14:40:49.419719 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:49.419690 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b7dccf98b-bvj29_93c8b59c-8447-4518-a26a-f98869bda922/reload/0.log" Jul 07 14:40:49.443203 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:49.443181 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b7dccf98b-bvj29_93c8b59c-8447-4518-a26a-f98869bda922/kube-rbac-proxy/0.log" Jul 07 14:40:50.820013 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.819977 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz"] Jul 07 14:40:50.820475 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.820456 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5995860d-88f8-42f4-a8ca-2d0d3070c6dc" containerName="istio-proxy" Jul 07 14:40:50.820532 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.820478 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5995860d-88f8-42f4-a8ca-2d0d3070c6dc" containerName="istio-proxy" Jul 07 14:40:50.820532 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.820500 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c534f13-3911-4fc6-a791-6951273bc259" containerName="istio-proxy" Jul 07 14:40:50.820532 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.820509 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c534f13-3911-4fc6-a791-6951273bc259" containerName="istio-proxy" Jul 07 14:40:50.820682 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.820641 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c534f13-3911-4fc6-a791-6951273bc259" containerName="istio-proxy" Jul 07 14:40:50.820682 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.820657 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c534f13-3911-4fc6-a791-6951273bc259" containerName="istio-proxy" Jul 07 14:40:50.820682 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.820667 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5995860d-88f8-42f4-a8ca-2d0d3070c6dc" containerName="istio-proxy" Jul 07 14:40:50.820682 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.820678 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5995860d-88f8-42f4-a8ca-2d0d3070c6dc" containerName="istio-proxy" Jul 07 14:40:50.823832 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.823816 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:50.826597 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.826580 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6d5pc\"/\"default-dockercfg-ftvtb\"" Jul 07 14:40:50.826798 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.826782 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6d5pc\"/\"openshift-service-ca.crt\"" Jul 07 14:40:50.827656 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.827641 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6d5pc\"/\"kube-root-ca.crt\"" Jul 07 14:40:50.831887 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.831858 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz"] Jul 07 14:40:50.951771 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.951741 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/def3b846-1ac5-440f-98f4-1d800e63c799-podres\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:50.951932 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.951786 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def3b846-1ac5-440f-98f4-1d800e63c799-sys\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:50.951932 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.951810 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fzs9\" (UniqueName: \"kubernetes.io/projected/def3b846-1ac5-440f-98f4-1d800e63c799-kube-api-access-9fzs9\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:50.951932 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.951838 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/def3b846-1ac5-440f-98f4-1d800e63c799-proc\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:50.951932 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:50.951853 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/def3b846-1ac5-440f-98f4-1d800e63c799-lib-modules\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.053218 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.053179 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/def3b846-1ac5-440f-98f4-1d800e63c799-podres\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.053406 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.053254 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def3b846-1ac5-440f-98f4-1d800e63c799-sys\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.053406 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.053288 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fzs9\" (UniqueName: \"kubernetes.io/projected/def3b846-1ac5-440f-98f4-1d800e63c799-kube-api-access-9fzs9\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.053406 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.053327 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/def3b846-1ac5-440f-98f4-1d800e63c799-proc\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.053406 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.053344 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/def3b846-1ac5-440f-98f4-1d800e63c799-lib-modules\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.053406 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.053365 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def3b846-1ac5-440f-98f4-1d800e63c799-sys\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.053406 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.053372 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/def3b846-1ac5-440f-98f4-1d800e63c799-podres\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.053668 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.053486 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/def3b846-1ac5-440f-98f4-1d800e63c799-lib-modules\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.053668 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.053519 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/def3b846-1ac5-440f-98f4-1d800e63c799-proc\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.062574 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.062552 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fzs9\" (UniqueName: \"kubernetes.io/projected/def3b846-1ac5-440f-98f4-1d800e63c799-kube-api-access-9fzs9\") pod \"perf-node-gather-daemonset-hg9dz\" (UID: \"def3b846-1ac5-440f-98f4-1d800e63c799\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.134920 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.134848 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.268635 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.268551 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz"] Jul 07 14:40:51.270460 ip-10-0-136-167 kubenswrapper[2583]: W0707 14:40:51.270433 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddef3b846_1ac5_440f_98f4_1d800e63c799.slice/crio-5def55b511c1eb3209465035f5f9e2e13997c406a2224bb8a031910c2908a822 WatchSource:0}: Error finding container 5def55b511c1eb3209465035f5f9e2e13997c406a2224bb8a031910c2908a822: Status 404 returned error can't find the container with id 5def55b511c1eb3209465035f5f9e2e13997c406a2224bb8a031910c2908a822 Jul 07 14:40:51.596296 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.596260 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" event={"ID":"def3b846-1ac5-440f-98f4-1d800e63c799","Type":"ContainerStarted","Data":"782677601f8c2e5c0c2daeb429b09b3283115330f6917b96f6d4d5fc0e2b4ef5"} Jul 07 14:40:51.596455 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.596316 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" event={"ID":"def3b846-1ac5-440f-98f4-1d800e63c799","Type":"ContainerStarted","Data":"5def55b511c1eb3209465035f5f9e2e13997c406a2224bb8a031910c2908a822"} Jul 07 14:40:51.596497 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.596465 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:51.615445 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:51.615403 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" podStartSLOduration=1.615390514 podStartE2EDuration="1.615390514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:40:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:51.613305463 +0000 UTC m=+2483.787093040" watchObservedRunningTime="2026-07-07 14:40:51.615390514 +0000 UTC m=+2483.789178088" Jul 07 14:40:53.711702 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:53.711667 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xnjlx_6f85f374-2b96-49f3-bbee-190907c09083/dns/0.log" Jul 07 14:40:53.732781 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:53.732755 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xnjlx_6f85f374-2b96-49f3-bbee-190907c09083/kube-rbac-proxy/0.log" Jul 07 14:40:53.787968 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:53.787949 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qvpbf_b4da12c5-b21c-4fd1-9516-fb2f2d934118/dns-node-resolver/0.log" Jul 07 14:40:54.348345 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:54.348317 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b7586867f-jj6zh_d7f1e163-33f3-469c-a11a-e1cd268a89fe/registry/0.log" Jul 07 14:40:54.391822 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:54.391799 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8mhsp_a1a809a6-2c4c-4c61-956a-a49b09d2da26/node-ca/0.log" Jul 07 14:40:55.367394 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:55.367361 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678zmqr6_092f4611-6943-4d62-b7e0-7e18ea270d57/istio-proxy/0.log" Jul 07 14:40:55.479501 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:55.479461 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-szr94_b483707a-b864-41c1-b8dc-d651806901a7/discovery/0.log" Jul 07 14:40:56.500517 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:56.500487 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4lx4_2a66d209-1ba4-4e2e-b631-3118ba9b7199/serve-healthcheck-canary/0.log" Jul 07 14:40:57.243326 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:57.243298 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gg4cd_ca65422c-ff55-4b7c-9238-ee9cbe4caf66/kube-rbac-proxy/0.log" Jul 07 14:40:57.265814 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:57.265790 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gg4cd_ca65422c-ff55-4b7c-9238-ee9cbe4caf66/exporter/0.log" Jul 07 14:40:57.287499 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:57.287474 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gg4cd_ca65422c-ff55-4b7c-9238-ee9cbe4caf66/extractor/0.log" Jul 07 14:40:57.610675 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:57.610646 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-hg9dz" Jul 07 14:40:59.873547 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:40:59.873521 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723910-v4m4x_2de75cfc-5630-4ffd-ab20-cc5b1ff2fa2e/cleanup/0.log" Jul 07 14:41:00.263565 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:41:00.263536 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d498b796-q9vkg_8d60e77a-5d16-452c-aa5e-6adb2d68ff3c/manager/0.log" Jul 07 14:41:00.287263 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:41:00.287220 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d498b796-q9vkg_8d60e77a-5d16-452c-aa5e-6adb2d68ff3c/copy-manifests/0.log" Jul 07 14:41:01.559074 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:41:01.559046 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678zmqr6_092f4611-6943-4d62-b7e0-7e18ea270d57/istio-proxy/0.log" Jul 07 14:41:01.658879 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:41:01.658844 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-szr94_b483707a-b864-41c1-b8dc-d651806901a7/discovery/0.log" Jul 07 14:41:01.890902 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:41:01.890823 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c9dfbb547-mznpc_697a56e9-b0fe-434a-b89f-6b7b4dc90de6/manager/0.log" Jul 07 14:41:01.919868 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:41:01.919843 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8kxht_9a1e4a2e-c357-4385-88fe-c93e83990c7b/openshift-lws-operator/0.log" Jul 07 14:41:03.083140 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:41:03.083104 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678zmqr6_092f4611-6943-4d62-b7e0-7e18ea270d57/istio-proxy/0.log" Jul 07 14:41:03.189525 ip-10-0-136-167 kubenswrapper[2583]: I0707 14:41:03.189489 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-szr94_b483707a-b864-41c1-b8dc-d651806901a7/discovery/0.log"